Action-chunk caching for flow-based VLA control loops
Teams deploying flow-based VLA policies should add an external action-chunk cache to the inference path and measure the success-latency curve under the same task distribution. ActionCache stores past intermediate action chunks with compact multimodal keys, retrieves a nearby chunk for the current context, and either executes it directly or refines it for one or two flow steps. The practical test is small: build the cache from successful rollouts, set a similarity threshold for fallback to full generation, and compare control latency, cache hit rate, and task success on repeated manipulation tasks.
The reported numbers make this worth a direct engineering trial. On VLABench with π0.5, the full model reaches 38.8% success with 18.8 ms action-head latency. ActionCache with no refinement reaches 32.9% success at 1.6 ms, and the one-step version reaches 32.4% at 3.6 ms. Simple one-step generation without retrieval falls to 6.8%, so the useful part is reuse from a similar context, not only fewer flow steps. This is a concrete fit for labs where the VLA action head is a large share of the control-loop budget and retraining the backbone is expensive.
Sources
- Document 819