ZeRO-Prefill: Zero Redundancy Overheads in MoE Prefill Serving
arXiv:2605.02960v1 Announce Type: new Abstract: Production LLM workloads increasingly serve discriminative tasks, such as classification, recommendation, and verification, whose answers are read from