Clean: Second-order LLM Training at Linear Memory Cost via Nystrom Sketching
DGX agentarXiv:2610.04204v1 Announce Type: new Abstract: Training large language models (LLMs) entails a fundamental trade-off: memory-efficient optimizers such as Adam discard cross-parameter curvature, where