swarm scaling
In plain wordsGetting better AI results by putting many AI agents on a task at once instead of letting one think longer — faster, but more expensive for each gain.
Improving performance on a task by increasing the number of AI agents working on it in parallel while holding each agent's reasoning length fixed — a form of inference scaling alongside longer chains of thoughtchain of thought, n.: Getting an AI to write out its reasoning step by step before giving an answer, the way a student shows their working. This often makes answers to math and logic problems more accurate. (see test-time computetest-time compute, n.: The computing effort an AI model spends while answering a question, as opposed to while being trained. Letting a model think longer or try many answers can make it markedly smarter.). Analyzing published multi-agent results for frontier models in 2026, Toby Ord found a single agent the most token-efficient: each fourfold increase in agents roughly doubled the total tokens needed for the same score, so ten agents working together matched a single agent given only about three to five times as many tokens. The payoff is speed, since parallel agents can finish in a fraction of the wall-clock time. Ord expressed the coordination penalty with economists' 'stepping on toes' parameter λ — N agents together match one agent working N^λ times as long — estimating λ at roughly 0.5–0.7 across benchmarks, values that matter for models of an intelligence explosionintelligence explosion, n.: The idea that once AI gets good enough at improving AI, each smarter version could build a smarter one faster still, so abilities would snowball far beyond human level in a short time..
Swarm scaling got us the answer overnight instead of in a week, at four times the token bill.
Origin
Named by the philosopher Toby Ord in the essay 'Swarm Scaling' (September 2026), an analysis of published multi-agent results for OpenAI models that was cross-posted to LessWrong and the Effective Altruism Forum and discussed in Jack Clark's Import AI newsletter.
Related
- test-time computetest-time compute, n.: The computing effort an AI model spends while answering a question, as opposed to while being trained. Letting a model think longer or try many answers can make it markedly smarter.
- agent swarmagent swarm, n.: A large group of AI agents working at the same time on parts of a problem, usually with little central control — a name loosely borrowed from swarms of insects.
- multi-agent systemmulti-agent system, n.: A setup in which several AI agents, each with its own role or point of view, work together — or compete — on a problem, passing messages and results among themselves.
- scaling lawsscaling laws, n.: Measured patterns showing that an AI model's error shrinks smoothly and predictably as the model is made bigger and given more data and computing power, so labs can forecast a giant model's performance from small, cheap experiments.
- intelligence explosionintelligence explosion, n.: The idea that once AI gets good enough at improving AI, each smarter version could build a smarter one faster still, so abilities would snowball far beyond human level in a short time.
- orchestrator–worker patternorchestrator–worker pattern, n.: A way of organizing AI teamwork, like a newsroom: an editor AI decides which stories a big assignment needs, sends reporter AIs to cover them at the same time, and turns what they file into one report.
Sources
- Ord, T. (2026). Swarm Scaling. September 2026 (cross-posted to LessWrong). lesswrong.com/posts/6cb7qd3RSkgnviCpf/swarm-scaling
- Clark, J. (2026). Import AI 475: Swarm scaling; Google DeepMind watermarks biology; and the AI science economy. 5 October 2026. jack-clark.net/2026/10/05/import-ai-475-swarm-scaling-google-deepmind-watermarks-biology-and-the-ai-science-economy
Mentioned in
Toby OrdToby Ord, prop. n.: An Australian philosopher at Oxford who helped found effective altruism and estimated, in his book 'The Precipice', that unaligned AI is the largest threat to humanity's future this century.