MARS: Unleashing the Power of Speculative Decoding via Margin-Aware Verification
DGX agentarXiv:2601.15498v2 Announce Type: replace Abstract: Speculative Decoding (SD) accelerates autoregressive large language model (LLM) inference by decoupling generation and verification. While recent me