Local Ai
Run Unsloth Qwen3.5 ggufs or your finetuned version in Ollama
This Reddit post from r/ollama discusses how to run Unsloth's quantized GGUF versions of Qwen3.5 — Alibaba's model family including variants such as 35B-A3B, 27B, 122B-A10B, and smaller models like 0.
This Reddit post from r/ollama discusses how to run Unsloth's quantized GGUF versions of Qwen3.5 — Alibaba's model family including variants such as 35B-A3B, 27B, 122B-A10B, and smaller models like 0.8B, 2B, 4B, and 9B — locally via Ollama, as well as how to run custom fine-tuned versions of these models. It likely covers the steps to load Unsloth's GGUF files (which use Unsloth Dynamic 2.0 for state-of-the-art quantization performance, upcasting important 4-bit layers to 8 or 16-bit ) into Ollama, and may also address how to export fine-tuned models to GGUF format for use with llama.cpp/Ollama . Users are also likely advised on practical considerations such as disabling thinking mode and adjusting the context length window, which Ollama may default to a low
Related
- qwen3.5 no se instala
- Use the Same Model Across Ollama, LM Studio, Jan, and your Favorite Local AI Apps
- any decent model to run on 9070xt locally
- Recommended Model for a 4060ti 8gb and 16gb ram
- Any models?
Source: r/ollama | 2026-04-13