SpecBlock: Block-Iterative Speculative Decoding with Dynamic Tree Drafting
DGX agentarXiv:2605.07243v1 Announce Type: new Abstract: Speculative decoding accelerates LLM inference by drafting a tree of candidate continuations and verifying it in one target forward. Existing drafters f