Impressive NVIDIA paper on cutting agent costs.
For long-horizon agent tasks, you want the capable model for the early | Hanami
Impressive NVIDIA paper on cutting agent costs.
For long-horizon agent tasks, you want the capable model for the early steps and a cheaper model for the rest. Handing off in the other direction saves little or nothing.
AgentBaton learns when to make that one switch from patterns in task progress. Each check has a median latency of 338 ms on one H100.
Across 11 model pairs and two benchmarks, it cuts API cost by 65.9% on average while largely keeping accuracy. Some pairs gain up to 8.8 points over running the capable model alone.
The handoff happens once per task, so it is easy to add to an existing agent loop.
If your agent bills are dominated by a frontier model, you might want to test one capable-to-cheap handoff before building a full router.
https://t.co/dLhuwCMo2N
Chat with Paper: https://t.co/5NgyprpqvB
Retweeted by @KyeGomezB from @dair_ai(Historical earnings: For fiscal 2027Q2 (period ended 2026-07-26), NVIDIA reported basic EPS of 4.87, diluted EPS of 4.85, net income of USD 118.010 billion, and revenue of USD 177.837 billion.
Consensus expectations: For fiscal 2027Q3 (event date 2026-11-17), consensus expects EPS of 2.49 and revenue of USD 111.356 billion.)