Layerwise LQR for Geometry-Aware Optimization of Deep Networks
arXiv:2605.04230v1 Announce Type: new Abstract: Geometry-aware optimizers such as Newton and natural gradient can improve conditioning in deep learning, but scalable variants such as K-FAC, Shampoo, a