Expert Upcycling: Shifting the Compute-Efficient Frontier of Mixture-of-Experts
DGX agentarXiv:2604.19835v1 Announce Type: cross Abstract: Mixture-of-Experts (MoE) has become the dominant architecture for scaling large language models: frontier models routinely decouple total parameters f