Domino: Decoupling Causal Modeling from Autoregressive Drafting in Speculative Decoding
DGX agentarXiv:2605.29707v1 Announce Type: new Abstract: Speculative decoding accelerates LLM inference by drafting multiple tokens and verifying them in parallel with the target model. However, its practical