VIA-SD: Verification via Intra-Model Routing for Speculative Decoding
arXiv:2606.12243v1 Announce Type: cross Abstract: Speculative decoding (SD) addresses the high inference costs of LLMs by having lightweight drafters generate candidates for large verifiers to validat