From Policy Evaluation to Off-Policy Control: Provable Emergence of In-Context Q-Learning
arXiv:2610.18057v1 Announce Type: new Abstract: Transformers can implement reinforcement-learning algorithms in context, yet how off-policy control emerges within Transformers remains poorly understoo