VRPO: Rethinking Value Modeling for Robust RL under Noisy Supervision in LLM Post-Training
arXiv:2508.03058v2 Announce Type: replace Abstract: Reinforcement Learning (RL) in real-world environments often suffers from ambiguous or incomplete reward supervision, which undermines policy stabil