--- kind: ideas granularity: day period_start: '2026-05-02T00:00:00' period_end: '2026-05-03T00:00:00' run_id: 14f082e7-7c9b-4271-8e35-dd9fc877b0b9 status: succeeded topics: - vision-language-action - robot manipulation - test-time compute - error recovery - real-time control tags: - recoleta/ideas - topic/vision-language-action - topic/robot-manipulation - topic/test-time-compute - topic/error-recovery - topic/real-time-control language_code: en pass_output_id: 127 pass_kind: trend_ideas upstream_pass_output_id: 126 upstream_pass_kind: trend_synthesis --- # Execution-time control checks for VLA robots ## Summary Robot VLA policies are gaining practical control logic around the action head. The concrete work is an uncertainty gate for expensive action selection, a status monitor for recovery, and evaluation that records trigger rate, recovery success, and action latency together. ## Uncertainty-gated candidate action selection for long manipulation tasks Robot teams running PI0-style policies can add a small decision gate before spending extra inference on action candidates. VLA-ATTC samples two action chunks with different random seeds, measures their Dynamic Time Warping distance, and treats high distance as action uncertainty. Low-uncertainty steps execute directly. High-uncertainty steps reuse one vision-language prefill, sample multiple action chunks, and pass them through a Relative Action Critic that picks a winner by pairwise comparison. This is a concrete deployment change for long-horizon manipulation, where one bad action can spoil the whole run. The paper reports PI0 on LIBERO-LONG moving from 82.8% to 90.6% average success with the adaptive setting, and PI0.5 moving from 90.6% to 94.0%. On real Agilex Piper tasks, PI0 rises from 46.0% to 58.7%. The reported 20.8 Hz control rate matters because candidate search only helps if it stays inside the robot’s timing budget. A useful first test is to log action-chunk disagreement on existing robot rollouts, set an offline percentile threshold, and replay only the high-disagreement steps through candidate sampling. The decision to adopt should depend on whether success improves without pushing the controller below its required frequency. ### Sources - [VLA-ATTC: Adaptive Test-Time Compute for VLA Models with Relative Action Critic Model](../Inbox/2026-05-02--vla-attc-adaptive-test-time-compute-for-vla-models-with-relative-action-critic-model.md): Summarizes the uncertainty gate, Relative Action Critic, success gains on LIBERO-LONG and Agilex Piper tasks, and the reported 20.8 Hz control rate. - [VLA-ATTC: Adaptive Test-Time Compute for VLA Models with Relative Action Critic Model](../Inbox/2026-05-02--vla-attc-adaptive-test-time-compute-for-vla-models-with-relative-action-critic-model.md): Describes the need to quantify situational difficulty, limit multi-action sampling overhead, and trigger test-time deliberation only on uncertain steps. ## Status monitoring and recovery memory for disturbed robot rollouts Manipulation deployments should test a status monitor that watches the policy’s own execution state and triggers recovery when the robot is in a faulty state. Sentinel-VLA adds a learned `[MONITOR]` query that reads the VLM key-value cache and classifies the current step as Initial, Normal, New-subtask, or Error. The policy keeps memory for the plan, current subtask, and error reflections, then conditions the action expert on the image, instruction, status, and memory. The user-visible pain is simple: a robot that misses a grasp or grabs the wrong object may keep executing the original action sequence. Sentinel-VLA reports 54.7% average success on disturbed RLBench tasks, compared with 46.0% for PI0 and 48.4% for OneTwoVLA. On real Agilex Piper tasks across Stack cube, Pour water, and Sweep rubbish, it reports 60.0% average success. The monitor’s latency claim is also small enough for control loops: 13 ms/action on an RTX4090, with error detection at 97.4% on RLBench and 90.6% on a real-world error set. The practical build is a labeled disturbed-rollout set: inject gripper, pose, and semantic errors into successful trajectories, add recovery waypoints, and train the monitor alongside the action model. Teams should inspect false negatives first, since missed error states are the failures most likely to let a bad rollout continue. ### Sources - [Sentinel-VLA: A Metacognitive VLA Model with Active Status Monitoring for Dynamic Reasoning and Error Recovery](../Inbox/2026-05-02--sentinel-vla-a-metacognitive-vla-model-with-active-status-monitoring-for-dynamic-reasoning-and-error-recovery.md): Summarizes the Status Monitor, thought memory, EC-Gen disturbed trajectory generation, success results, latency, and error-detection rates. - [Sentinel-VLA: A Metacognitive VLA Model with Active Status Monitoring for Dynamic Reasoning and Error Recovery](../Inbox/2026-05-02--sentinel-vla-a-metacognitive-vla-model-with-active-status-monitoring-for-dynamic-reasoning-and-error-recovery.md): Names the operational failure mode: VLA policies can keep acting after runtime errors such as grasping an empty kettle. ## Latency-aware benchmarks for execution-time reasoning in VLA policies VLA evaluation should report when execution-time reasoning is triggered, how often it recovers a disturbed rollout, and what it costs per action. The two papers point to the same adoption blocker: extra reasoning can improve manipulation, but robot controllers still need a stable action rate. A benchmark table should include ordinary task success, disturbed-task success, trigger rate for uncertainty or error states, recovery success after the trigger, and measured action latency on the target GPU. VLA-ATTC reports success gains while preserving 20.8 Hz control by routing only uncertain steps through candidate sampling. Sentinel-VLA reports 13 ms/action while adding status classification and recovery memory. Those measurements make success alone an incomplete deployment metric. This change is cheap for labs already collecting robot rollouts. Add trace logging for uncertainty scores, status labels, trigger decisions, selected action chunks, and wall-clock inference time. The useful comparison is between a fast one-pass policy and the same policy with execution-time judgment under the same timing budget. ### Sources - [VLA-ATTC: Adaptive Test-Time Compute for VLA Models with Relative Action Critic Model](../Inbox/2026-05-02--vla-attc-adaptive-test-time-compute-for-vla-models-with-relative-action-critic-model.md): Reports adaptive deliberation, success improvements, and the 20.8 Hz control frequency for VLA-ATTC. - [Sentinel-VLA: A Metacognitive VLA Model with Active Status Monitoring for Dynamic Reasoning and Error Recovery](../Inbox/2026-05-02--sentinel-vla-a-metacognitive-vla-model-with-active-status-monitoring-for-dynamic-reasoning-and-error-recovery.md): Reports disturbed-task success, status monitoring, error-detection rates, and 13 ms/action latency for Sentinel-VLA.