Trend

Robot policy work is being tested against geometry, contact, and real execution

Day · 2026-06-03 · Embodied AI

Robotics dominates the day, with policy quality treated as an execution problem. The strongest papers add geometry, physical validation, success scoring, or spatial memory before deployment. OSCAR, 3DThinkVLA, and MAD give the clearest evidence.

Geometry-guided VLA policies

Vision-language-action (VLA) papers center on signals that make actions physically meaningful. 3DThinkVLA aligns Qwen3-VL visual features with VGGT 3D features and distills a spatial reasoning anchor into normal action prompts. It reports 98.7% average success on LIBERO and 81.0% on LIBERO-PLUS while using only 2D images at inference.

VISTA attacks the data side of the same problem. It adapts Universal Manipulation Interface (UMI) demonstrations by training on an 8M-sample fisheye VQA set and filtering trajectories for completeness, continuity, self-collision risk, and execution fidelity. ForesightFlow adds a lighter policy-improvement path: each action chunk carries generated success-potential scores, giving best-of-K selection without a separate critic. Its real-world bimanual success rate is 35.4%, above IDQL at 32.6%, with reported training compute falling from 287 to 178 GPU hours.

World models for policy evaluation and spatial memory

World-model work is tied to measurable control outcomes. OSCAR uses 2D kinematic skeleton videos as action conditions for a 2B-parameter video world model that spans robot arms and human hands. On a 200-clip benchmark, it reaches PSNR 24.24 and SSIM 0.846, and it runs at 2.214 FPS on the reported GH200 test.

MAD applies a related predictive idea to quadrotors, training a DreamerV3-style recurrent model to predict local occupancy and visibility maps. The learned policy reaches 9.66 m/s in simulation and 5.05 m/s in real forest flight. A separate quadrotor study adds a caution: the model with the strongest simulation policy score failed on the real platform, while other models reached the target through narrow gaps. The authors find cross-environment reconstruction quality more useful for real transfer than simulated win rate alone.

Contact-rich data exposes limits of vision-only manipulation

HapTile adds touch and operator feedback to the VLA data mix. The dataset contains 1,726 demonstrations across 38 tasks and 9 skills, with language, third-person RGB, wrist RGB, fingertip tactile images, robot state, 7D actions, timestamps, and haptic feedback at 15 Hz. The strongest gains appear where contact decides success: peg insertion with π0 rises from 0% using vision-only input to 90% with raw tactile images, and whiteboard wiping rises from 50% to 100% with tactile marker features.

The results are not uniformly positive. Pouring degrades when tactile marker features are added in the reported baselines. That makes the dataset useful as a diagnostic tool: touch helps on some contact-heavy tasks, but policy architectures still need better ways to combine tactile signals with visual and language inputs.

NewerFull operating loops define agentic coding evaluationOlderAgent work is being judged by complete loops, visible failures, and auditable evidence