Tokens are All You Need: Dual-purpose Semantic IDs for Achieving LLM-Level I/O Efficiency in recommendation systems
arXiv:2607.24865v1 Announce Type: cross Abstract: Large-scale recommendation systems face 'Memory Wall' bottlenecks due to massive, dense embedding tables. While generative retrieval uses discrete tok