Budgeted LoRA: Distillation as Structured Compute Allocation for Efficient Inference
DGX agentarXiv:2605.04341v1 Announce Type: cross Abstract: We study distillation for large language models under explicit compute constraints, with the goal of producing student models that are not only cheape