AutoResearch AI: Towards AI-Powered Research Automation for Scientific Discovery

Key points

• Problem: AI research systems now reach into long workflows that run from literature grounding through hypotheses, experiments, validation, and reporting, yet they differ in autonomy, domain, execution environment, validation mechanism, and human oversight, so they are hard to compare in one frame. The authors note that pipeline breadth can be mistaken for scientific autonomy, and that current systems are strong at search, drafting, and coding but much weaker at validation, rejection, and reproducibility.
• Scope: This paper is a survey. Table 1 groups surveys, workflow-level systems, and open-source projects and marks the autonomy level of each system and project, and Table 2 sorts evaluation instruments by evaluative role into discovery, experimentation and verification, deep research and synthesis, and review and provenance. The official repository (Mr-Tieguigui/Autoresearch) is, per its README, a static project page that shows the survey figures, made of index.html and a static folder with styles, scripts, and figures.
• Taxonomy: The authors define five levels from L0 (human only) to L4 (AI autonomous) by how humans and AI split control, execution, and validation, and call the human-steered L1 and L2 region Vibe Research. They split L2 into single-step execution (L2-S), interactive workflow automation (L2-I), and pipeline automation under human verification (L2-P), and use a conservative rule that places each system at the lowest level consistent with its demonstrated workflow role.
• Workflow stages: The authors split the technical foundations into five stages, literature grounding, hypothesis formation and planning, experimentation and tool use, feedback and validation, and reporting, and sort the recurring approaches within each stage. For example, grounding has four regimes (search-centered, evidence-centered, structure-centered, literature-memory), and validation has three (execution-coupled reruns, critique-mediated validation, expert- or temporally-grounded validation).
• Evaluation and domains: The authors propose five evaluation dimensions, novelty, validity, impact, reliability, and provenance, so that outputs are judged on scientific credibility instead of task completion alone. Across domains, they place computational and formal sciences, whose artifacts are executable and replayable, at the highest level currently observed, and medicine and clinical research and economics and social sciences in early-to-middle L2. They conclude that no domain yet gives convincing evidence of robust L3 or L4 scientific autonomy.
• Limits: Table 1 is a selection of structurally important works rather than a full catalog, and its levels show the primary autonomy regime suggested by each work's workflow scope, execution capability, and degree of human oversight rather than a performance ranking. The authors state that novelty still has no agreed measurable definition, so current evaluations lean on weak proxies such as dissimilarity from prior papers, LLM-as-a-judge, or human expert judgment.

Paper links

External research summaries. These are not HDATF publications or measured product results.