UMM-RM: An Upcycle-and-Merge MoE Reward Model for Mitigating Reward Hacking
DGX agentarXiv:2512.00724v3 Announce Type: replace Abstract: Reward models (RMs) are critical to reinforcement learning from human feedback (RLHF). However, policy models can exploit biases or spurious correla