When Perplexity Lies: Generation-Focused Distillation of Hybrid Sequence Models
arXiv:2603.26556v3 Announce Type: replace-cross Abstract: Converting a pretrained Transformer into a more efficient hybrid model through distillation offers a promising approach to reducing inference