Trend

Robot learning is being judged by labels, contact, timing, and task context

Day · 2026-06-11 · Embodied AI

Robot learning papers in this period tie model gains to deployable constraints: reliable labels, contact control, latency, and task-specific grounding. SPARC, Mana, and LabVLA show the main emphasis: make the data and policy match the physical task before scaling the model.

Reliable grounding data

Several papers treat grounding errors as a data problem. SPARC auto-labels robot demonstrations with interacted-object boxes, trajectories, and phase labels, then filters them with a reliability score based on motion, gripper proximity, and robot-body overlap. On IA-Bench, it reports 80.2% interacted-object localization accuracy, compared with 58.1% for a detector-confidence baseline, and keeps 77.6% coverage at a 90% precision operating point.

LabVLA builds laboratory supervision in simulation because standard vision-language-action (VLA) policies rarely see lab instruments, liquids, and protocol workflows. Its RoboGenesis engine creates 2,947 annotated assets, more than 1,000 textures, 10,000 lab scenes, and demonstrations across 16 robot platforms. GIVE adds human gestures to VLA inputs for handover: skeleton overlays, fingertip rays, and short semantic gesture descriptions raise real-world handover success to 80.0%, compared with 0.0% for the base policy in the reported trials.

Contact-rich dexterity

Dexterous manipulation papers focus on the physical source of failure: thin tools slip, tactile sensors vary by hardware, and hand mechanics shape contact before software sees a stable state. Mana generates grasp keyframes for articulated tools, then fills contact-rich phases with short-horizon reinforcement learning. It reports zero-shot sim-to-real transfer on tongs, pliers, clothespins, and syringes, with many per-task success rates around 0.6 to 0.8 across 10 trials.

FTP-1 tackles tactile transfer by mapping heterogeneous tactile inputs into a shared morphology-aware token space. It pretrains on about 3,000 hours of data from 26 sources and 21 tactile sensors, then reports 66.66% average success on UniVTAC and 46.6% on unseen sensor setups, compared with 15.0% for its FTP-pi0.5 baseline. MCR-Bionic Hand adds a hardware-side argument: a musculoskeletal hand with 23 bones, 61 wrist ligaments, more than 103 soft-tissue constraints, and 46 muscle units can encode useful grasp pre-shaping and fingertip force paths in its structure.

Policy structure for real execution

Execution papers add structure around when a robot sees, how two arms act, and how action tokens are decoded under latency limits. The real-time autoregressive policy paper changes action-token chunking and uses constrained decoding so inference stays within a fixed latency budget. On LIBERO, pi0-REALFAST reaches 95.7% average task success, compared with 89.4% for pi0 plus real-time control and 94.7% for pi0.5 plus real-time control.

The bimanual manipulation paper separates visual routing from action routing. A View-Selective Visual Router reweights left and right wrist-camera tokens, and an Interaction-Aware Action Mixture-of-Experts chooses coordinated or arm-wise action pathways. On six RoboTwin 2.0 tasks, the full model reaches 69.6% average success, compared with 41.9% for the monolithic baseline. In three long-horizon real-world tasks, the reported gain over the same baseline is 43.3 percentage points.

World models with action scores

World-model papers make prediction useful by adding action values, events, or direct control outputs. WEAVER predicts future latent states, rewards, and decoded observations from multiview inputs and action chunks. It reports FID 10.20 and FVD 27.83 on DROID exterior-view validation at 16 NFE, a 0.870 correlation with real-world success rate for policy evaluation, and a 38% real-world success-rate improvement for pi0.5 without extra real-world interaction.

EA-WM adds event prediction and verification to feature rollouts. Its verifier scores imagined futures by task progress, semantic consistency, physical feasibility, and uncertainty; on the LIBERO wine-rack task, an online hybrid setup reaches 97/100 success at horizon 20. NavWAM applies the same action-centered idea to goal-conditioned visual navigation by learning future views, action chunks, and goal-progress values together. In real-robot tests, it reaches the goal in 19 of 24 episodes, compared with 14 of 24 for OmniVLA and 4 of 24 for NWM.

NewerCoding agents need bounded tools and deliberate human checkpointsOlderCoding agents are being managed as production workers