Local Ai
Small uncensored model for everyday questions on a CPU-only laptop?
Hey everyone, I'm looking for a small uncensored model to run locally with Ollama. Nothing fancy. I just want something I can ask everyday questions without it refusing or lecturing me every other mes
Hey everyone, I'm looking for a small uncensored model to run locally with Ollama. Nothing fancy. I just want something I can ask everyday questions without it refusing or lecturing me every other message. Quick explanations, help with phrasing stuff, general "what's the deal with X" questions. It doesn't need to be perfect or great at coding. My setup is a Lenovo ThinkPad L14 Gen 3 with a Ryzen 5 PRO 5675U, 32 GB RAM and no dedicated GPU, so everything runs on the CPU. I'm fine with it being a bit slow, but it should stay usable and not take a minute per answer. Which models would you recommend for this? Is it worth going for something around 7-8B with my RAM, or are 3-4B models good enough for casual use? Also curious whether you prefer abliterated models or proper uncensored fine-tunes, and which quantization you'd pick. Thanks! submitted by /u/Jaywolfy02 [link] [comments]
Related
- What are the most capable LLM models I can run on my laptop?
- Downloading an AI model just to hit an OOM error is the worst. 📉
- OLLAMA_KV_CACHE_TYPE is global, not per-model. That is why one model got noticeably worse when you quantised the cache and the others did not.
Source: r/ollama | 2026-10-07