A Declarative-Procedural Perspective on Expert Routing in Bilingual Mixture-of-Experts Language Models
arXiv:2608.15102v1 Announce Type: new Abstract: We investigate whether Mixture-of-Experts (MoE) language models develop linguistically structured expert routing during bilingual language acquisition.