Experience-Driven Dynamic Exits for LLMs with Reinforcement Learning
arXiv:2606.03113v1 Announce Type: new Abstract: Large Language Models suffer from slow autoregressive inference. While self-speculative decoding accelerates this process, its efficiency is hampered by