DBLAST: Dependent Block Drafting for Stochastic Speculative Decoding
DGX agentarXiv:2608.05448v1 Announce Type: new Abstract: Speculative decoding accelerates large language models' inference by using a lightweight drafter to propose multiple future tokens and a target model to