SLO-qualified model-serving scheduler for multi-robot factory tasks
Factory robot teams running VLA, planner, safety, and monitor models should test a shared GPU serving pool with task-level SLOs before buying one accelerator path per robot. ROSA shows the concrete shape of the workflow: a declarative task file records the robot fleet, model components, prompts, call rates, retry rules, and fallback actions such as stop, resend, replan, or call a human. The scheduler then chooses model placement, request routing, batching, and per-task action rates against SLO-qualified action throughput.
A cheap validation is to replay logged robot observations through the current serving setup and a shared Ray Serve-style pool, then count only actions that arrive inside the task SLO and allow the robot to keep working safely. ROSA reports up to 12.06x higher SLO-qualified factory productivity than dedicated serving baselines on 8 NVIDIA H200 GPUs with up to 64 virtual robots, and up to 2.44x higher qualified factory action throughput than shared-server baselines without its scheduler. The adoption blocker is concrete: lower model latency is useful only when it changes safe task progress, and factory workloads include idle time during physical motion that dedicated GPU allocations waste.