Stateful evaluation is becoming the default bar
Evaluation is getting closer to real software work. Daily trend syntheses repeatedly center on execution, replay, and repository state. SWE-STEPS and ABTest make agents act across sequential changes and behavior-driven tests. ProdCodeBench and IndustryCode keep claims tied to production-derived or industrial tasks. The common bar is simple: an agent has to survive state, tools, and longer task horizons.