Loop the Loopies!
- Published
- Source
- arXiv
- Paper number
- 658
- Field
- LLMs / NLP
- arXiv ID
- 2607.16051
Key points
- It introduces a layer-loop method and shows that it is more efficient for MoE than the existing model-loop approach.
- It outperforms a vanilla 30B-A3B model under the same compute budget.
- It records state-of-the-art math reasoning with 92.10% on AIME and 94.21% on AMC.
- It achieves gold-medal-level performance at IMO 2025 and IPhO 2025 without tools.
Paper links
External research summaries. These are not HDATF publications or measured product results.