Fractional Rotation, Full Potential? Investigating Performance and Convergence of Partial RoPE
arXiv:2603.11611v2 Announce Type: replace-cross Abstract: Rotary Positional Embedding (RoPE) is widely used in transformers to encode relative positional information, yet the effect of applying RoPE t