Local Ai
Mac mini for running LLMs and AI agents 24/7: Prioritize RAM or CPU/GPU performance?
I’m planning to get a Mac mini mainly to run local LLMs and AI agents 24/7. I plan to run models up to 27B parameters with Q4 quantization, and maybe not for coding, maybe just for everday task and mo
I’m planning to get a Mac mini mainly to run local LLMs and AI agents 24/7. I plan to run models up to 27B parameters with Q4 quantization, and maybe not for coding, maybe just for everday task and model exploration. I’m trying to figure out whether I should prioritize more RAM or a more powerful chip. For example, I’m considering: M4 with 32GB RAM M4 Pro with 24GB RAM For this kind of workload, which matters more: having more memory to run larger models, or better CPU/GPU performance for faster inference? I’d love to hear from anyone running a similar setup! submitted by /u/secsilm [link] [comments]
Related
- ... so, yeah.
- PSA for M5Ultra owners running LLMs: set your prefill step to 8192
- Can someone point me in the right direction of what model(s) to look at for a newer user?
- Best Local LLMs - August 2026
Source: r/LocalLLaMA | 2026-10-13