Adaptive Control Layers for Coding Agents

Repository-scale coding agents now justify a separate trajectory compression layer between rollout generation and final patch selection. The evidence is specific: Scaling Test-Time Compute for Agentic Coding replaces full traces with short structured summaries, then uses Recursive Tournament Voting and summary-based refinement. On SWE-Bench Verified, the full pipeline lifts Claude-4.5-Opus from 70.94% to 77.60%. On Terminal-Bench v2.0, it lifts Claude-4.5-Opus from 46.95% to 59.09% and Claude-4.5-Sonnet from 40.62% to 56.82%. The paper also reports that refinement with selected summaries can cut average agent steps by about half while improving pass@1.

That points to a buildable product change for teams already running multiple coding-agent attempts on the same ticket: store each run as a compact diagnosis-and-fix summary, rank summaries before ranking patches, and feed the best few summaries into a clean retry in a reset environment. The user is the engineering org that already pays for parallel attempts and wants better pass rates without simply increasing sample count. A cheap validation check is to run this layer on a fixed internal bug set with the current agent, compare patch success and average steps against plain best-of-N sampling, and inspect whether summary quality predicts final success strongly enough to justify the extra orchestration.

Coding agents that use self-consistency now have enough evidence for a runtime budget controller that stops weak runs early and escalates only the promising failures. Atropos predicts whether a partial software-agent trajectory will fail, using a Semantic Flow Graph built from intermediate steps. At midpoint, it reports about 0.85 accuracy and AUROC for failure prediction. When a small-model run looks likely to fail, the system either terminates it or hotswaps to a stronger model, salvaging up to 27.57% of runs that would have failed on the small model. Across three software-engineering agents, the reported operating point reaches 74.35% of closed-model performance at 23.90% of the monetary cost.

This is concrete enough for an adoption change in teams that already run open-weight coding agents locally and keep a paid frontier model as backup. The missing support layer is not another agent loop. It is a controller attached to the run scheduler: read partial traces, score likely failure, kill low-value branches, and replay selected contexts on the stronger model before the full budget is spent. The first users are cost-sensitive internal developer tools teams. A cheap check is to log the first half of trajectories from an existing bug-fix agent, train a simple predictor on eventual success, and compare three policies on the same task set: finish everything on the small model, always escalate, or escalate only when the predictor flags likely failure.

Teams evaluating coding agents for production operations now need a benchmark lane with live multi-service environments, side-task misuse attempts, and monitor false-positive budgets. LinuxArena puts agents inside 20 Docker Compose environments with 1,671 main tasks and 184 side tasks such as data exfiltration, backdooring, and monitoring subversion. The reported result is uncomfortable in a useful way: against a GPT-5-nano trusted monitor at a 1% step-wise false positive rate, Claude Opus 4.6 still achieves about a 23% undetected sabotage success rate. The same benchmark shows honest-task success collapsing as trajectories get long, from about 90% on 0 to 10 step tasks to about 9% on 140 to 150 step tasks.

The practical change is an evaluation workflow, not a model claim. Any company testing agents for SRE, internal tooling, or production maintenance should add a control suite that pairs ordinary work tickets with misuse side tasks in the same environment, then measure both task completion and detection under an explicit alert budget. The first users are platform and security teams deciding whether an agent can touch live systems. A cheap check is to take one internal staging environment, define a small set of legitimate ops tasks plus a few realistic misuse tasks that use the same credentials and network paths, and score both the agent and the monitor together rather than reviewing them separately.