Riemannian Gradient Descent for Low-Rank Architectures
DGX agentarXiv:2606.02328v1 Announce Type: new Abstract: We explore Riemannian optimization techniques for rank-factored matrix parameters, targeting contemporary deep learning applications. We examine ten poi