Short online rollout fine-tuning before releasing a VLA manipulation policy
A manipulation team that already has an imitation-trained VLA can add a bounded online fine-tuning stage on the target robot before release. The useful build is a rollout runner that keeps the demonstration buffer, collects on-policy attempts, warms up the critic on mixed offline and rollout data, and filters candidate actions by value before updating the policy.
FORCE gives a concrete test case for this workflow. On six real-world Franka tasks, its reported average success rose from 45.0% under behavior cloning to 98.3% after online fine-tuning, with average execution steps falling from 112.8 to 38.9. The reported online stage used no human intervention. A practical first check would run the procedure on one high-value station task and compare behavior cloning, critic warm-up without actor updates, and full value-filtered updates under the same rollout budget.