Beyond the Previous Layer: Residual Predictive Structure in Sparse MoE Routing
arXiv:2609.17940v1 Announce Type: new Abstract: Sparse mixture-of-experts models route each token through a sequence of expert selections. We ask whether the immediately preceding selection adequately