Learning What to Distill: Bilevel Top-K Token Selection for Self-Distillation in Large Language Models
DGX agentarXiv:2610.07247v1 Announce Type: new Abstract: Large language models have shown strong reasoning capabilities, but their high inference costs make knowledge distillation an important approach for tra