Boundary Mass and the Soft-to-Hard Limit in Mixture-of-Experts
DGX agentarXiv:2605.02124v1 Announce Type: new Abstract: Softmax-routed mixture-of-experts models approach hard routing as the temperature tends to zero, but this limit is singular near routing ties. This pape