Local Ai

any decent model to run on 9070xt locally

This Reddit thread from r/ollama discusses recommendations for running local AI models on the AMD Radeon RX 9070 XT using Ollama, touching on GPU compatibility considerations given that the card uses

DGX agentreddit
local-air-ollama

This Reddit thread from r/ollama discusses recommendations for running local AI models on the AMD Radeon RX 9070 XT using Ollama, touching on GPU compatibility considerations given that the card uses the RDNA4 (gfx1201) architecture, which required updated ROCm support. The RX 9070 XT features 16GB of VRAM, making it capable of running quantized models in the 7B–20B parameter range comfortably, though larger models may require quantization (e.g., Q4 or Q5) to fit within memory constraints. Users likely share specific model suggestions such as DeepSeek, Qwen, or LLaMA variants, along with setup tips for getting Ollama to properly utilize the GPU on Windows or Linux.

Related

Source: r/ollama | 2026-04-13

Loading related sources…