CAT-Q: Cost-efficient and Accurate Ternary Quantization for LLMs
DGX agentarXiv:2606.26650v1 Announce Type: cross Abstract: In this paper, we present CAT-Q, Cost-efficient and Accurate Ternary Quantization, for compressing and accelerating LLMs. Unlike existing state-of-the