Model Releases
Heat!
As in actual physical heat. How are people coping with the heat that running a decent inference rig pumps out? I've got dual 5060 Ti GPUs and a relatively modest CPU (Intel 14 Core Ultra 5 245KF Deskt
As in actual physical heat. How are people coping with the heat that running a decent inference rig pumps out? I've got dual 5060 Ti GPUs and a relatively modest CPU (Intel 14 Core Ultra 5 245KF Desktop on an Msi MPG Z890 motherboard) and if I use it for a coding session or similar with Qwen 3.8 27B then it heats up the room terribly. I know the energy consumed has to go somewhere, but I didn't realise it would be this bad. Would throttling the GPUs' power consumption a bit make any difference? They hit about 170W each at full tilt. submitted by /u/andrewh2000 [link] [comments]
Related
- How well do multiple GPUs scale for LLM inference? (Trying to understand the basics)
- Running DeepSeek V4 Flash Q4_K_XL at ~100 tok/s prompt processing on 4× RTX 3060 12GB
- After pushing 1M+ tokens through Qwen 3.8 27B, here is my optimal llama.cpp config for 16GB VRAM (73k Context, Agentic Coding)
- Building a budget 32GB → 48GB VRAM home AI server: 2-3x RX 9060 XT 16GB vs RTX 5060 Ti 16GB, AM5 vs used EPYC?
- Ran DS V4-Flash-0731 Locally on 3xMI50 32GB @ ~15 t/s TG
Source: r/LocalLLaMA | 2026-08-28