TIDE: Temporal Incremental Draft Engine for Self-Improving LLM Inference
DGX agentarXiv:2602.05145v2 Announce Type: replace-cross Abstract: Speculative decoding can substantially accelerate LLM inference, but realizing its benefits in practice is challenging due to evolving workloa