MLorc: Momentum Low-rank Compression for Memory Efficient Large Language Model Adaptation
DGX agentarXiv:2506.01897v5 Announce Type: replace Abstract: With increasing size of large language models (LLMs), full-parameter fine-tuning imposes substantial memory demands. To alleviate this, we propose a