VQ-Logits: Compressing the Output Bottleneck of Large Language Models via Vector Quantized Logits
DGX agentarXiv:2505.10202v2 Announce Type: replace Abstract: Large Language Models (LLMs) have achieved remarkable success but face significant computational and memory challenges, particularly due to their ex