MTServe: Efficient Serving for Generative Recommendation Models with Hierarchical Caches
DGX agentarXiv:2604.22881v1 Announce Type: cross Abstract: Generative recommendation (GR) offers superior modeling capabilities but suffers from prohibitive inference costs due to the repeated encoding of long