TopoCompress: Topology Aware Token Compression Algorithm for Distributed Edge MoE Inference
DGX agentarXiv:2609.26061v1 Announce Type: cross Abstract: Mixture-of-experts (MoE) models improve capacity with moderate overhead by sparsely activating experts per token. However, deploying MoE across resour