Agent-as-a-Router: Agentic Model Routing for Coding Tasks

Published
Source
arXiv
Paper number
481
Field
AI / General
arXiv ID
2606.22902

Key points

  • Experiments show that the performance bottleneck in LLM routers is information deficit, not a lack of reasoning ability.
  • When performance statistics are provided, it outperforms heuristic routers by 15.3% relative improvement.
  • The Context-Action-Feedback loop continuously accumulates execution-based experience in streaming tasks.
  • ACRouter reaches 49.98% AvgPerf in distribution and 62.50% AvgPerf on out-of-distribution agentic programming.
  • Static routers such as classifiers and bandits collapse out of distribution, but ACRouter preserves generalization.
  • CodeRouterBench is a regret-based router evaluation environment with about 10K tasks, 8 LLMs, and execution-verified scores.

Paper links

External research summaries. These are not HDATF publications or measured product results.

Read original (opens in a new tab)