Dual-Space Knowledge Distillation with Key-Query Matching for Large Language Models with Vocabulary Mismatch
arXiv:2603.22056v2 Announce Type: replace Abstract: Large language models (LLMs) achieve state-of-the-art (SOTA) performance across language tasks, but are costly to deploy due to their size and resou