RoPE at the End of Its Rope? Theory, Diagnosis, and Mitigation of Long-Context Failures
arXiv:2609.39929v1 Announce Type: cross Abstract: Long-context failures of RoPE-based language models can arise from RoPE's intrinsic tradeoff between maintaining stable token preferences and distingu