Execution-time feedback in code generation
Code models are getting tighter feedback inside the generation loop. Think-Anywhere trains a model to insert reasoning at hard points during code writing and reports 70.3 average pass@1, above 61.0 for the base model and 68.4 for a GRPO baseline. ConSelf uses execution behavior to decide which self-generated training problems are worth learning from, then weights preference learning by behavioral agreement; the reported gain is smaller, 2.73% to 3.95%, but the method removes the need for teacher models or test oracles. The common pattern is practical: more of the training signal comes from executable behavior at the moment decisions are made, not from a single plan written up front.