Model Releases
New Model, Old Habits: Behavior Transfer under Model Swapping in Multi-Session LLM Agents
arXiv:2610.19712v1 Announce Type: new Abstract: Multi-session agents can switch between LLMs to balance performance and inference cost. Such switches require transferring a history for continuity, yet
arXiv:2610.19712v1 Announce Type: new Abstract: Multi-session agents can switch between LLMs to balance performance and inference cost. Such switches require transferring a history for continuity, yet their effects on the recipient remain underexplored. Through controlled experiments with multi-session tasks, we uncover behavior transfer: recipients tend to adopt reasoning and action patterns from the models that generated their histories. This effect is most evident with raw-history transfer but is substantially reduced by summarization. Based on these findings, we propose Direction- and Authorship-aware Summarization of History (DASH) that preserves stronger-model behavior while minimizing weak-to-strong transfer via summarization. Experiments with repeated swaps show that DASH outperforms raw-history transfer and naive summarization baselines. These results suggest that effective multi-model orchestration requires considering not only which model to use, but also which behavioral patterns to carry forward.
Related
- Strong Drafts Need Compact Memories: Long-Context Speculative Decoding with Compressed KV Cache
- Resample or Reroute? Budget-Aware Test-Time Model Selection for Large Language Models
- BUDDY: BUdget-Driven DYnamic Depth Routing for Adaptive Large Language Model Inference
- Conformal Cascade: Distribution-Free Accuracy Guarantees for Multi-Tier LLM Inference
- Specialize Roles, Mix Deployments: Pushing the Cost-Accuracy Frontier of LLM Agent Teams
Source: arXiv cs.LG | 2026-10-15