Convergence of Two-Timescale Markovian Stochastic Approximations with Applications in Reinforcement Learning
arXiv:2605.31172v1 Announce Type: new Abstract: This work studies the convergence of two-timescale stochastic approximations (SA), a class of iterative algorithms that update two sets of parameters in