When pre-training hurts LoRA fine-tuning: a dynamical analysis via single-index models
DGX agentarXiv:2602.02855v2 Announce Type: replace Abstract: Pre-training on a source task is usually expected to facilitate fine-tuning on similar downstream problems. In this work, we mathematically show tha