Trajectory-Retrieval Speculative Decoding: When Does a Model's Own History Help?
DGX agentarXiv:2610.07350v1 Announce Type: new Abstract: Long chain-of-thought reasoning increases sequential decoding cost while creating a growing history of potentially reusable continuations. We investigat