AI for Scientific Discovery is a Social Problem

Key points

• Problem: AI is increasingly applied to scientific research, but its benefits remain unevenly distributed across communities and disciplines, and so far they have concentrated in domains with strong data infrastructure and well-coordinated research communities. Technical challenges such as limited data, fragmented standards, and unequal access to computing are well known, but the authors argue that social and institutional factors are often the primary constraints.
• Argument: This is a position paper that builds its case from literature, survey statistics, and case studies. The authors argue for reframing AI for science as a collective social project in which sustainable collaboration and equitable participation are prerequisites for technical progress. They define scientific success as strong predictive performance together with explanations that reveal causal relationships, experimental validation, integration with theory, and broad accessibility, and they hold that systems that merely optimize benchmark prediction accuracy fall short of this standard.
• Taxonomy: The authors sort the barriers into four: community dysfunction (the autonomous AI scientist narrative, undervalued data and infrastructure work, and communication and education gaps between fields), misaligned research priorities (a focus on narrow domain applications and neglect of upstream computational bottlenecks shared by many fields, such as density functional theory (DFT) calculations and partial differential equation (PDE) solvers), data fragmentation (incompatible formats and standards, and high-dimensional, low-sample-size scientific data), and infrastructure inequity (gaps in access to computing). They see commercial AI scientist systems as predominantly focused on literature search, summarization, and hypothesis generation from existing text while largely avoiding the experimental validation and mechanistic investigation that define scientific discovery.
• Proposals: The four remedies are strengthening collaboration and education across fields (standardized interfaces and APIs, collaborative development platforms, and training that builds hybrid expertise), structuring upstream challenges through shared benchmarks, standardizing and curating data around simple formats such as CSV (comma-separated values) or Parquet, and building community-owned, sustainable infrastructure. The authors argue that research funding should prioritize computational challenges with broad applicability over numerous domain-specific applications, and that reproducible science should be rewarded in hiring, tenure evaluations, and citation counts.
• Evidence: CASP (the critical assessment of protein structure prediction) has run biennial blind prediction competitions, in which predictions are submitted before the experimental structures are released, since 1994, building clear success metrics and challenging test cases, and the authors credit this groundwork for AlphaFold's breakthrough at the 14th round (CASP14) in 2020. On data, they cite the harmonization of nine Cancer Imaging Archive files, which took 329.5 hours over six months, and the growth of the Protein Data Bank from seven structures in 1971 to more than 230,000 structures. On resources, they cite figures that only 5% of Africa's AI research community has the computing power complex AI tasks need and that African researchers face six-day iteration cycles against 30-minute cycles in G7 countries.
• Limits: The authors note that the paper synthesizes challenges across biology, chemistry, materials science, physics, and climate science to highlight structural patterns, so specific constraints vary by field and some recommendations may need adapting to particular subdisciplines or regulatory environments. Several arguments rely on studies and surveys that do not cover the full diversity of scientific institutions, especially in underrepresented regions, and fast progress in machine learning may change some of the technical limitations discussed. The discussion of governance and incentives is high level, so implementing it would need detailed policy design and negotiation among stakeholders, and both authors disclose a potential conflict of interest as employees of Hugging Face, which the paper cites as one collaborative platform.

Paper links

External research summaries. These are not HDATF publications or measured product results.