Cross-Rollout Bellman Closure for Long-Horizon Agentic Reinforcement Learning
arXiv:2609.35082v1 Announce Type: new Abstract: Group-based reinforcement learning such as GRPO trains LLM agents by comparing rollouts sampled for each task, without a learned critic. In long-horizon