In-Context Optimization for Retrieval-Augmented Generation: A Gradient-Descent Perspective
arXiv:2605.26356v1 Announce Type: new Abstract: In-context learning has recently been linked to implicit gradient descent in linear self-attention models, suggesting that context can induce a forward-