Towards Green AI: Evaluating Energy Efficiency for Quantized LLM Inference
DGX agentarXiv:2610.17531v1 Announce Type: new Abstract: While it is known that quantization of large language models (LLMs) reduces memory usage via lower-bit weights, studies quantifying the resulting impact