Model Releases
Qwen 3.8 flash with Ollama
Hi All. Just tried to down the NVFP4 version from Ollama but it’s the MLX!? Anyone else been able to access this version? Only have 1 DGX so wanted the smaller footprint for user with Hermes. Any sugg
Hi All. Just tried to down the NVFP4 version from Ollama but it’s the MLX!? Anyone else been able to access this version? Only have 1 DGX so wanted the smaller footprint for user with Hermes. Any suggestions? submitted by /u/ramorez117 [link] [comments]
Related
- Ollama + Qwen
- I subscribed to Ollama Pro today. deepseek-v4-flash:0731 works great and serves as a solid alternative, and glm-5.3-flash:cloud works fine as well.
- Qwen3.8-27B on M1 Max 32GB: MLX 15.8 tok/s vs llama.cpp 9.7 tok/s - but llama.cpp prefill is faster
Source: r/ollama | 2026-09-13