LoopMoE: Unifying Iterative Computation with Mixture-of-Experts for Language Modeling
arXiv:2606.04438v1 Announce Type: cross Abstract: Mixture-of-Experts (MoE) and looped architectures scale models along two orthogonal axes, namely parameter capacity and effective depth. However, main