Prism-ML Ollama Support

If anyone is interested in using Ollama with the Prism-ML model prism-ml/Bonsai-27B-gguf · Hugging Face I setup a repo with an install script that patches Ollama and pulls the Prism-LM llama.cpp code for Q1_0 support. The script builds the whole things locally, so do it on a fast machine. You can do --dry-run to make sure you can build. The script prompts for RocM build only or Autodiscover GPU arch. When the build succeeds run the script again with the --install flag. It's all in the docs. CUDA AND ROCM are massive so the script maximized thread count and takes advantage of ccache when possible, and opting not to build one or the other will save a lot of time. xInterlopeRx/ollama: Get up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models. As with all things internet, read before running. This does not break model compatibility, but there is no Darwin support yet. submitted by /u/Available-Ad6250 [link] [comments]

Source: r/ollama | 2026-09-21