Beyond Linear Attention: Softmax Transformers Implement In-Context Reinforcement Learning
DGX agentarXiv:2605.07333v1 Announce Type: new Abstract: In-context reinforcement learning (ICRL) studies agents that, after pretraining, adapt to new tasks by conditioning on additional context without parame