Mixture of Channel Experts: Static Sparse Supports with Input-Adaptive Mixing for Pointwise Projections
DGX agentarXiv:2608.23794v1 Announce Type: cross Abstract: Mixture-of-Experts (MoE) scales language models by routing each input through a small set of independently parameterized experts. We show that copying