Tetra: Serving Leech-Lattice Quantized LLMs at 2.7 Bits per Parameter
DGX agentarXiv:2609.35465v1 Announce Type: new Abstract: Leech-lattice quantization gives good quality at two bits per weight, but its codebooks hold more than 10^14 points, too many for a lookup table. Our ea