Software-agent work is getting more explicit about specs, checks, and whole-repository tasks

Repository-scale coding work has stronger evidence when the system carries its own plan and checks its own output. ReCodeAgent splits translation into analysis, planning, translation, and validation, then reports 99.4% compilation success and 86.5% test pass rate across 118 projects and four language pairs. REAgent uses the same broad pattern for issue fixing: build a structured requirement first, score it with generated tests, then refine it until the requirement is good enough to drive a patch. The reported gain is 9.17% to 24.83% in resolved issues over baselines. The common point is simple: repository agents improve when specification and verification are first-class steps inside the loop, not cleanup added at the end.

Benchmark design is getting closer to what developers actually ask agents to do. CLI-Tool-Bench starts from an empty workspace and grades complete CLI tools by command behavior, output, and file-system effects. Even the best models stay below 43% overall success. SWD-Bench scores documentation by whether it helps answer development questions, locate feature files, and recover implementation details across a repository. It also reports a downstream 20% improvement in SWE-Agent issue solving when better documentation is used. The period’s evaluation work is less interested in polished local outputs and more interested in whether an agent can complete a repository task that another system can verify.

Product work is packaging the agent runtime itself as the deliverable. Claude Managed Agents exposes a hosted loop with tools, code execution, web access, persistent sessions, and server-side event history. That puts runtime control, steering, and environment setup on the platform side instead of the application team. The evidence here is product documentation, not benchmark data, so the claim is narrower than the research papers. Still, it fits the day’s theme: teams want agent behavior that arrives with execution, state, and control surfaces already wired in.