Local Ai
which model to use on local 24gb mac mini M4 pro
So, i have been building some apps that should run on the local every user system, tried gemma4 although its fast and great at reasoning its not as good in instructions following and tool calling. tri
So, i have been building some apps that should run on the local every user system, tried gemma4 although its fast and great at reasoning its not as good in instructions following and tool calling. tried qwen3.5:9b-mlx too but though its good at tool calling and instructions it lacks in the generic reasoning in compare to gemma4. Any suggestions which model to use ? Also suggest any reranking model that I can use in local ollama, I used qllama/bge-reranker-v2-m3:Q4_K_M but my ollama crashes every time i use it. submitted by /u/time_pass_done [link] [comments]
Related
- What's model should I run?
- Looking for advice - first time local LLM run
- Hi I'm new and don't have a good PC, which model you recommend? And how can I load HAHA?
- Can't get a good coding setup on Macbook Pro M3 Max 36GB
Source: r/ollama | 2026-07-24