Scaling Multilingual Mixture-of-Experts: How Language Coverage Changes Capacity and Compute Allocation
arXiv:2610.20247v1 Announce Type: new Abstract: Multilingual models share capacity across languages, so adding languages can hurt performance on existing ones. Mixture-of-experts models expand this ca