On the Convergence of Stochastic Low-Rank Adaptation
DGX agentarXiv:2607.21975v1 Announce Type: new Abstract: Low-rank adaptation (LoRA) optimizes J(B,A)=mathcal L(W_base+sBA) over two adapters B in R^{m imes r} and A in R^{r imes n} that form a low-rank update