Instruction-progress and landmark-memory supervision in VLN training
Training-time state supervision for vision-language navigation looks ready to become a standard ablation and baseline, not a niche add-on. Dual-Anchoring reports that a Video-LLM agent improves by 8.7 success-rate points on R2R-CE and 8.8 points on RxR-CE over StreamVLN when it is forced to write out instruction progress and preserve landmark memory during training. The useful part for robotics teams is the shape of the intervention: the paper adds explicit progress and memory targets without extra inference cost at deployment. That is a concrete build path for teams already running VLN stacks in simulators or indoor robots. Add one head that predicts completed versus remaining sub-goals, add one memory target tied to passed landmarks, and check whether long-horizon failures change before touching the policy architecture.
The adoption blocker is annotation and evaluation discipline. This paper gets there with 3.6 million synthesized progress samples and 937,000 grounded landmark samples, so most labs will start with a smaller internal version. A cheap test is straightforward: take an existing VLN benchmark run, label a few thousand trajectories with sub-goal completion text and landmark recall targets, then compare failure modes on long instructions rather than headline success alone. If the same pattern holds, progress drift and memory drift should become regular tracked metrics in VLN training runs, because they point to the error before the agent starts wandering.