UBTree: Parallel Tree Drafting via Unigram and Bigram Models for Speculative Decoding
DGX agentarXiv:2609.39972v1 Announce Type: new Abstract: Speculative decoding accelerates language model inference by verifying multiple draft tokens in a single target-model pass. Recent parallel drafters hav