OPTScientist: Multi-Agent Discovery of Typed Optimizer Programs for Transformer Pretraining
DGX agentarXiv:2607.20486v1 Announce Type: new Abstract: Designing optimizers for modern deep learning remains a challenging scientific problem, requiring the joint consideration of optimization geometry, stat