DRelay: Global Draft Context for Prefix-Aware Parallel Speculative Decoding Repair
DGX agentarXiv:2610.01439v1 Announce Type: new Abstract: Parallel drafting reduces the drafting overhead of speculative decoding for large language models (LLMs), but its gains remain limited by the accepted p