Bounding-box-guided planner and action policy for cluttered long-horizon manipulation
Robot teams working on long-horizon table manipulation can now test a planner-executor split with a concrete grounding interface: have a VLM produce the next subtask, target object, and bounding box, then pass both global scene tokens and a high-resolution crop of that box into a separate action policy. HiVLA reports 83.3% average success on RoboTwin 2.0 versus 70.6% for H-RDT, with larger gains on harder tasks and small-object work in clutter. The operational point is narrow and useful: bounding-box-guided local crops give the controller object detail without dropping scene context, while the planner stays out of low-level motor tuning. A cheap validation step is to add planner-produced crops to one cluttered pick-place or tool-use task and compare failure modes against a single-stream policy: missed target identity, poor grasp placement, and loss of multi-step progress are the errors to watch first.