Recursive Self-Improvement in AI: From Bounded Self-Refinement to Autonomous Research Loops

Key points

• Problem: AI systems increasingly take part in their own improvement, from revising outputs and changing their harnesses to training on self-generated data and doing AI research, yet the literature lumps fundamentally different ambitions under words like self-refine, self-reward, self-play and self-evolve. The authors note that existing surveys cover single slices such as on-policy distillation or tree search with rewards, and that to their knowledge no survey covers the four categories jointly, from bounded self-refinement to open-ended recursive self-improvement (RSI).
• Scope: This is a survey that collects and classifies literature. It gathers 1,250 arXiv papers from 2024 to 2026: a seed harvest of 871 papers across seven threads plus a targeted supplement of 379 papers on self-evaluation, test-time training and zero-data self-play. According to the README, the official GitHub repository deepgrounding/recursive-self-improvement holds corpus_v2.csv with taxonomy assignments, the seed snapshot, scripts for reclassification, supplemental harvest, bibliography and figures, and the manuscript source (main.md, matching arXiv v1).
• Taxonomy: The first axis is what the system improves: deployment-time self-evolution (393 papers), training-time self-iteration (340), self-evaluation (318) and Auto Research (139), plus a foundations, limits and safety family (60). The second axis is who validates the loop, in three degrees: human-in-the-loop, human-on-the-loop and closed loop. The authors report that nearly all of the 1,250 papers study bounded self-refinement in human-on-the-loop cells, where humans audit outcomes.
• Argument: The authors rank improvement signals into a verification hierarchy of formal verifiers (proof checkers, type systems), execution feedback (tests, compilers, benchmarks), learned judges (reward models, LLM-as-judge) and intrinsic signals (confidence, self-consistency, likelihood), and observe, as a qualitative pattern across the corpus, that demonstrated self-improvement strength tracks this hierarchy. They group failure modes into four: the self-confirming loop, collapse, diversity collapse and frame lock-in (continuing to optimize a stale objective). The foundations family is the smallest of the five at 60 of 1,250 papers, and the authors suggest that governance-grade measurement of self-improvement is the most underpopulated research niche the survey found.
• Evidence: In the Mirror Loop study cited by the authors, models from three providers ran ten rounds of ungrounded self-critique across four task families and informational change declined 55% across iterations, while one verification step at iteration three restored forward movement. In the cited SkillsBench result, human-authored skills raised pass rates by 16.2 points while LLM-authored skills gave no measurable gain. The cited A-Evolve-Training ran the entire post-training loop of a 30B model for four rounds with no human in the loop, within a human-specified objective and search space, and reached 0.86 on a public leaderboard, near the 0.87 of the top human submission.
• Limits: The authors describe the corpus as a recency-biased sample, and say that because 74% of papers were posted in 2026, citation counts are near zero and cannot be read as impact. Roughly 54 of the 379 supplemental papers are peripheral query bleed that remain in the corpus counts, and classification and corrections come from a single annotator. Industrial RSI practice inside frontier labs is observable only through what labs publish.

Paper links

External research summaries. These are not HDATF publications or measured product results.