Hardware
Reduce your GPU power limit
Setting a GPU power limit using nvidia-smi reduces heat output by approximately 20% with only a 5-8% inference speed loss. Undervolting the GPU can reduce power consumption by 5-15% with zero performa
Setting a GPU power limit using nvidia-smi reduces heat output by approximately 20% with only a 5-8% inference speed loss. Undervolting the GPU can reduce power consumption by 5-15% with zero performance loss. For NVIDIA GPUs like the RTX 4090, using a command like nvidia-smi -pl 350 provides a practical way to manage sustained LLM workloads while preventing thermal throttling.
Source: r/ollama | 2026-05-16