Model Releases
[16GB AMD] Smartest local model that also does not refuse? 7950X + RX 6950 XT
I want the smartest local model I can run that also does not refuse. Not a tiny 'uncensored' 8B. Not a censored model with a jailbreak prompt. Tried dolphin-llama3:8b with a custom SYSTEM prompt. It c
I want the smartest local model I can run that also does not refuse. Not a tiny "uncensored" 8B. Not a censored model with a jailbreak prompt. Tried dolphin-llama3:8b with a custom SYSTEM prompt. It complies, but answers are short and vague. I want the newest strong base (Qwen / Gemma / Mistral / Dolphin 24B class) with refusals actually removed: abliterated, Heretic, or a real refusal-free finetune. Specs: - CPU: Ryzen 9 7950X - GPU: AMD Radeon RX 6950 XT 16GB - RAM: 32GB DDR5-6000 - OS: Windows 11 - Runner: Ollama now, will switch to LM Studio / llama.cpp / KoboldCpp Vulkan or ROCm only. No CUDA builds. Q4 is fine if it fits in 16GB, partial CPU offload is ok if it stays usable. Which exact Hugging Face GGUF are people running right now for this: highest quality, lowest refusal? submitted by /u/Allnamesstolen [link] [comments]
Related
- Testing Qwen 3.8 27B running locally on a single 5090 via Ollama
- QWEN 3.8 27B Q8 Quant - Setup Instructions Help
- I built a desktop benchmark for local Ollama models — TTFT, tok/s, VRAM, with a HuggingFace GGUF catalogue
- Which uncesored model smaller than Qwen3.8 27B?
Source: r/ollama | 2026-10-02