ORBIT: Preserving Foundational Language Capabilities in GenRetrieval via Origin-Regulated Merging
arXiv:2605.12419v1 Announce Type: new Abstract: Despite the rapid advancements in large language model (LLM) development, fine-tuning them for specific tasks often results in the catastrophic forgetti