Windowed-MTP: Removing the Full-Context Draft-KV Tax at Million-Token Context
arXiv:2607.21535v1 Announce Type: cross Abstract: Speculative decoding accelerates autoregressive generation by having a cheap draft propose tokens that a target verifies in parallel. Frontier models