Research idea

Execution control layers for software agents

Week · 2026-W16 · Software Intelligence

The clearest near-term builds are operational control layers around coding agents: a hard sandbox replay gate before patch acceptance, an agent-run software analysis setup flow that stops on verified project evidence, and a typed action contract layer for enterprise actions. Each case is supported by papers that move past fluent traces and report concrete execution, validation, or permission mechanisms with measurable effects.

3 ideas

Sandbox replay gate for repository patch acceptance

A repository agent can ship with a mandatory execution gate before any patch is accepted. The evidence this week is specific enough to support a concrete build: run every proposed edit inside an isolated container, require fail-to-pass tests to pass with no pass-to-pass regressions, and feed real stdout, stderr, and test failures back into a repair loop. AgentForge reports 40.0% resolution on SWE-bench Lite with this structure, using a network-isolated Docker sandbox and up to three debugger retries. That is a stronger operational pattern than accepting patches from model output alone.

The first user is the team already trying code agents on test-bearing repositories and seeing plausible diffs fail in CI. A cheap check is narrow: take one repository with stable tests, insert a hard execution requirement before merge, and measure how many agent patches survive replay without human cleanup. If the pass rate rises while review burden falls, the gate is doing useful work. If the repository lacks reliable tests, this workflow stalls fast, so the build should begin where execution already has teeth.

Agent-run software analysis setup with evidence-based completion checks

Teams adopting analyzers, fuzzers, symbolic execution tools, and profilers can use an agent that owns the full setup-and-proof workflow, not just command generation. AnalysisBench gives a concrete target for that build: create an isolated container, install the tool, build the project, generate any tool-specific prerequisites, run the analysis, and stop only when the run produces project-specific evidence. AnalysisAgent reached 94% verified success on 35 tool-project tasks, while the best baseline reached 77%. The paper also shows why this support layer matters: self-validation still overstated success, with a 15% false-positive rate against manual verification.

The practical product is a setup runner for internal AppSec and performance teams who lose time wiring tools into unfamiliar repositories. The fast validation step is to pick one painful internal analyzer rollout, have the agent produce a reproducible environment plus one evidence artifact that a human would already trust, and compare elapsed setup time with the current manual path. Stopping criteria need to be strict. A successful build or a --help screen is not enough if the analyzer did not produce real project output.

Typed action contract layer for enterprise agent execution

Enterprise coding and operations agents need an execution layer that exposes only typed actions the current user is allowed to run, validates inputs before side effects, and routes execution through the application's own services. Two papers point to the same adoption blocker. Claude Code’s analyzed codebase puts most of its complexity in permission modes, context compaction, hooks, and tool control around a simple model loop. BAL reports that typed action contracts, runtime permission filtering, workspace scoping, and approval gates completed 23 of 25 enterprise scenarios with zero unsafe executions, while an unconstrained setup completed 17 of 25.

A concrete build is a contract registry for high-risk actions such as deployment, ticket changes, user administration, and data export. Each action definition needs an input schema, permission predicate, validation function, execution callback, and result format. The first buyer is the team blocked on letting agents touch production systems. The cheapest test is to wrap a small set of existing internal actions and replay known bad cases, especially wrong-entity edits and cross-workspace requests, to see whether the contract layer blocks them before execution.