Planner-controlled retries and task-state memory for frozen VLA policies
Robot teams can wrap a frozen VLA with a planner that assigns free-space motion, grounding, staging, and release to analytic primitives, then invokes the VLA for short contact-rich actions. Each invocation should record the subgoal, elapsed time, contact or gripper event, observed outcome, and retry count. The planner can use this episode state to re-stage after an empty grasp, repeat a local action, or advance to the next subgoal.
Harness VLA reached 82.4% success on LIBERO-Pro, compared with 50.0% for direct use of the same frozen baseline. TFP provides complementary evidence for storing progress inside the policy: its event-sensitive memory raised real-robot object-swap success from 3/20 to 15/20. A focused pilot can use one multi-stage task with object-position changes and intermittent occlusion, then compare direct execution with the wrapper on completion rate, unnecessary repeated actions, recovery rate, and added latency.