OmniMoE: An Efficient MoE by Orchestrating Atomic Experts at Scale
DGX agentarXiv:2602.05711v2 Announce Type: replace-cross Abstract: Mixture-of-Experts (MoE) architectures are evolving towards finer granularity to improve parameter efficiency. However, existing MoE designs f