Mixture-of-Agents paper measures per-token 'sufficient compute' and shows routing/drafting gains
arXiv:2610.02491v1 introduces a Mixture-of-Agents (MoA) methodology that measures each token's upper-bound 'sufficient compute' by testing which of 15 progressively larger models can reproduce a reference token; a 0.5B agent reproduces 92–95% of tokens, while the costliest 10% of tokens account for an estimated 64–80% of FLOPs. Using the MoA-derived map, model routing and drafting strategies reduce projected latency (e.g., from 7.59s to 5.12s on MATH-500) and cut draft-token use and projected latency versus fixed baselines, indicating remaining headroom for smarter allocation controllers.