PR2: Predictive Routing Replay for MoE-Based LLM Reinforcement Learning
arXiv:2606.00395v1 Announce Type: cross Abstract: Mixture of Experts (MoE) Large Language Models (LLMs) achieve strong performance at scale. However, reinforcement learning (RL) on MoE-based LLMs ofte