MSign: An Optimizer Preventing Training Instability in Large Language Models via Stable Rank Restoration
DGX agentarXiv:2602.01734v2 Announce Type: replace Abstract: Training instability remains a critical challenge in large language model (LLM) pretraining, often manifesting as sudden gradient explosions that wa