From Experts to Sub-experts: Fine-grained Parameter-Efficient Fine-Tuning for MoE LLMs
DGX agentarXiv:2609.25655v1 Announce Type: new Abstract: As large language models (LLMs) scale rapidly, dense full-parameter adaptation becomes increasingly expensive, motivating sparse and modular architectur