H-Spec: Parallel Speculative Decoding Without a Drafter-Side KV Cache
DGX agentarXiv:2609.24197v1 Announce Type: new Abstract: Speculative decoding losslessly accelerates large language model inference by having a lightweight draft model predict future tokens for verification by