Self-evolving agents are stuck at acceptance: one paper finds selection is a coin flip, another skips evaluation
RSI Frontier, issue 1. arXiv:2611.23068 audits 7 agent-evolution methods over 1,030 evolution runs: selection picks the better candidate 49.7% of the time, and large reported gains mostly come from evaluation shortcuts (median 17.6 to 0.8 pp once graders are repaired). arXiv:2611.21056 (ELITE) runs no evaluation inside the loop, ties DGM and HGM on a SWE-bench Pro subset, transfers better, and costs 1/4 to 1/6 as much. This post reproduces two shortcuts on SkillOpt-Lite's public data and uses a toy model to show how noise inflates in-loop scores.