Executable control and verification now set the ceiling for coding agents
This week, coding-agent progress depended on the control layer around the large language model (LLM): executable harnesses, runtime checks, and repository workflows.
Topic summary
Long Horizon Evaluation
Executable Feedback for Coding-Agent Workflows
Coding-agent teams can improve repository work by requiring executable bug reproductions, testing harness changes against held-out tasks, and supervising test generation with live coverage signals.
Executable harnesses now determine agent cost, reliability, and test-time gains
Agent performance is increasingly determined by the executable control layer around the model. TTHE improves fixed large language models (LLMs) by editing their harnesses from unlabeled traces, while…
Agent Workflow Optimization and Validation
Agent teams can cut inference cost by adapting the control program to a bounded workflow, improve deployed behavior through trace-driven harness edits, and diagnose long runs with checkpoint-level grading.