Learning Rate Transfer for Hybrid Transformer-SSM Architectures
DGX agentarXiv:2610.01172v1 Announce Type: new Abstract: We study learning rate (LR) scaling for hybrid architectures combining Transformer and State-Space Model (SSM) blocks, a class adopted by several recent