ACE: Adapter Consolidation across Experts for Parameter-Efficient Fine-Tuning of MoE LLMs
DGX agentarXiv:2609.06072v1 Announce Type: new Abstract: Parameter-efficient fine-tuning (PEFT) of mixture-of-experts (MoE) models commonly attaches a separate low-rank adapter to each expert. This expert-wise