EStream: Fast and Memory-Efficient MoE Prefill through Expert Virtualization on Mobile NPUs
DGX agentarXiv:2609.06551v1 Announce Type: cross Abstract: Mobile vendors and application developers increasingly deploy LLMs on smartphones for diverse prefill-only services. Yet current systems rely mainly o