Online VLA fine-tuning station with old-task regression checks
Robot teams trialing pretrained VLA policies can build a small post-training station around online rollouts, human correction, sparse reward detectors, replay, and a fixed action-normalization setting. The target user is the operator who sees a policy reach a new task after fine-tuning, then finds that earlier skills have degraded.
EXPO-FT gives the practical template: keep the pretrained policy as the base, train a lightweight edit policy for action-chunk corrections, let a Q-function choose between base and edited chunks, and store human corrections from online rollouts in replay. The reported real-robot result is 30/30 success on eight manipulation tasks after an average of 19.1 minutes of online data, with final success judged by a human observer.
The regression side matters because sequential VLA fine-tuning can erase prior tasks. In a real-world continual-learning study, plain fine-tuning dropped Stack Bowl from 100.0 to 15.0 and Hang Cup from 97.5 to 25.0, while replay with a 0.2 buffer ratio, 0.2 replay frequency, and fixed action normalization reached a 93.5 final average score across four tasks. A useful adoption check is to run the new task and all previously accepted tasks after each fine-tuning stage, using the same action scaling across the deployment line.