Local Ai
ollama multi gpu installer bugs
I've been struggling with the ollama update process. I have both nvidia and amd GPUs in my system. I have two instances of ollama running on different ports for this to work around issues. AMD 7800xt
I've been struggling with the ollama update process. I have both nvidia and amd GPUs in my system. I have two instances of ollama running on different ports for this to work around issues. AMD 7800xt is using rocm. nvidia 4060ti is using their cuda stack. The Ollama install script stops when it detects nvidia-smi and doesn't download the AMD ROCm libraries. I've reported this problem already. It's just getting to be a hassle with each iteration. I'm curious if anyone else has a setup like this and it's also a problem for them. I had created a bug report for this problem. The reason I have a hybrid setup is GPU availability and price. I bought the 7800XT first but couldn't find another one for a remotely reasonable price. The 4060ti was reasonable and it can handle the two models I need running all the time for spam filtering. The 7800XT is the one i use for on demand models. submitted by /u/laffer1 [link] [comments]
Source: r/ollama | 2026-09-30