Local Ai
Ollama with Docker OpenWebUi using CUDA/GPU Support container - Can't get it working
This is a r/ollama community support thread where a user is struggling to configure Ollama and Open WebUI together in Docker containers with NVIDIA CUDA/GPU acceleration enabled. Common issues in this
This is a r/ollama community support thread where a user is struggling to configure Ollama and Open WebUI together in Docker containers with NVIDIA CUDA/GPU acceleration enabled. Common issues in this setup involve correctly installing the NVIDIA Container Toolkit, passing GPU resources through to the container using --gpus all or Docker Compose device reservations, and ensuring proper inter-container networking so Open WebUI can communicate with the Ollama backend. The thread likely involves community troubleshooting around misconfigured docker run or docker-compose.yml settings, deprecated environment variables, or missing driver/toolkit prerequisites.
Related
- Using Ollama Gemma4 models via OpenWebUI on my phone and it’s been a good experience
- Cannot search pdf document using WebUI and Ollama
- Has anyone actually gotten a reliable local AI system running?
- Recommended Model for a 4060ti 8gb and 16gb ram
- Tried running LLMs locally to save API costs… ended up waiting 13 minutes for ONE response 🤡
Source: r/ollama | 2026-04-12