Geometry-aware action prediction
GeoAlign and GeoSem-WAM both treat geometry as a control signal, not just a perception side channel. GeoAlign derives geometry features from RGB, lets the robot state query local spatial features, and feeds compact geometry tokens into the action decoder. It reports 99.0% average success on LIBERO and 78.8% on eight real ALOHA tasks, with large gains on transparent bottles and tape-roll insertion.
GeoSem-WAM applies the same pressure to World Action Models (WAMs), which learn predictive latent states for action. It trains on future RGB, geometry, and semantic maps, then removes the dense prediction heads at deployment. The reported real Franka success rises to 95.4% compared with 88.9% for Fast-WAM, and LIBERO ablations show gains when geometry and semantic supervision are combined.