Agents
Interesting paper from Microsoft on context-guided model routing. They found a nice trick to achieve cost-aware model routing for agents in …
Interesting paper from Microsoft on context-guided model routing. They found a nice trick to achieve cost-aware model routing for agents in a multi-turn setting at the user-turn level. If you route ag
Interesting paper from Microsoft on context-guided model routing. They found a nice trick to achieve cost-aware model routing for agents in a multi-turn setting at the user-turn level. If you route agent turns between a cheap model and an expensive one, they suggest giving the router the session history. Microsoft tested zero-shot routing on multi-turn spreadsheet agents. At the same offloading rate, a router that reads the history passes 3.3 points more tasks than one that sees only the current request. Prompt caching adds a cost to every switch. Switching from the expensive model to the cheap one recovers its cache cost within two calls. Switching up did not break even in their tests. The cheap model's cost advantage also shrank from 6.8x to 3.2x on longer sessions. https://arxiv.org/abs/2610.19292 Chat with Paper: https://academy.dair.ai/papers/whose-turn-is-it-context-guided-model-routing-for-stateful-agents-2610.19292
Related
- RCR-Router: Efficient Role-Aware Context Routing for Multi-Agent LLM Systems with Structured Memory
- Nice paper on agent memory. It explores an effective routing mechanism for memory in agents. The overall finding is that you want a separate…
- New paper from Microsoft on compressing agent context at test time. If your agent gets worse as its interaction history grows, this method i…
Source: DAIR.AI (X) | 2026-10-16