CSV-Decode: Certifiable Sub-Vocabulary Decoding for Efficient Large Language Model Inference
arXiv:2511.21702v2 Announce Type: replace-cross Abstract: Large language models face significant computational bottlenecks during inference due to the expensive output layer computation over large voc