SigmaScale: LLM Compression with SVD-based Low-Rank Decomposition and Learned Scaling Matrices
DGX agentarXiv:2606.07098v1 Announce Type: new Abstract: We present SigmaScale, a method for learning auxiliary scaling matrices S to aid truncated Singular Value Decomposition (SVD) based Large Language Model