Diversity Collapse in Multi-Agent LLM Systems: Structural Coupling and Collective Failure in Open-Ended Idea Generation
- Published
- Source
- arXiv
- Paper number
- 158
- Field
- Agents / Multi-Agent / Safety
- arXiv ID
- 2604.18005
Key points
- The assumption that multi-agent LLM systems inherently broaden idea diversity on complex creative tasks has been only weakly validated.
- When the underlying LLMs are homogeneous, different roles in a MAS often amplify shared pretraining biases rather than introducing true novelty, leading to computational inefficiency and early convergence.
- A lack of idea diversity in exploratory domains can trap users in narrow solution spaces, create overconfidence in suboptimal answers, and suppress unconventional hypotheses.
- We conducted a systematic empirical study using scientific research proposal generation as the task and evaluated diversity at three levels: model intelligence, agent cognition, and system dynamics.
- We developed a general three-stage multi-agent ideation pipeline consisting of role instantiation, iterative deliberation using a specified topology, and proposal synthesis by an editor agent.
- We quantified diversity with four complementary metrics, such as Vendi Score and Semantic Dispersion, and explored solutions by varying agent personas, group size, and communication topologies such as Nominal Group Technique (NGT) and Subgroups.
Paper links
External research summaries. These are not HDATF publications or measured product results.