Understanding the Energy Scaling of Large Language Model Inference Across Context Lengths and Attention Architectures
DGX agentarXiv:2608.25096v1 Announce Type: new Abstract: The growing adoption of large language models (LLMs) has raised increasing concerns about the energy consumption and environmental impact of inference.