Local Ai
gguf import with vision / mmproj, not working!
This r/ollama thread addresses a known compatibility issue where importing multimodal GGUF models into Ollama using a separate mmproj (multimodal projector) file fails to enable vision capabilities. O
This r/ollama thread addresses a known compatibility issue where importing multimodal GGUF models into Ollama using a separate mmproj (multimodal projector) file fails to enable vision capabilities. Ollama has a unique way of handling GGUFs, as it integrates the mmproj into the actual model file , meaning that externally sourced GGUF + mmproj file pairs specified via a Modelfile do not reliably produce working image input support. Ollama's handling of the visual projector (mmproj) appears broken for several architectures, likely due to incorrect tensor mapping or missing support, while the same model files work correctly with llama.cpp.
Related
- Tried Ollama Cloud, just realize only Kimi model accept images
- Using Ollama Gemma4 models via OpenWebUI on my phone and it’s been a good experience
- Run Unsloth Qwen3.5 ggufs or your finetuned version in Ollama
- llama4 108b
Source: r/ollama | 2026-04-15