R^2PO: Decoupling Rollout and Inference Policies for LLM Reasoning
arXiv:2601.11960v3 Announce Type: replace-cross Abstract: Existing reinforcement learning methods for LLM reasoning implicitly assume that the policy generating training trajectories should coincide w