Training Parallel Speculative Draft Models by Directly Minimizing Expected Decoding Rounds
arXiv:2610.10411v1 Announce Type: cross Abstract: Speculative decoding accelerates large language model inference by using a low-cost draft model to propose tokens that the full-size target model veri