A Robust widetilde{O}(1/sqrt{T}) Rate for Unprojected TD Learning with Linear Function Approximation
DGX agentarXiv:2506.01052v3 Announce Type: replace Abstract: We investigate the finite-time convergence properties of Temporal Difference (TD) learning with linear function approximation, a cornerstone of rein