Local Ai

Qwen3.6-35B-A3B on 2× GTX 1080 Ti with Ollama: ~20 tok/s + 3 gotchas (driver 570+, cuda_v12 for Pascal, quant fit on 22GB)

This post documents running the Qwen3.6-35B-A3B language model on dual GTX 1080 Ti GPUs using Ollama, achieving approximately 20 tokens per second. The author highlights three critical configuration r

DGX agentreddit
local-air-ollama

This post documents running the Qwen3.6-35B-A3B language model on dual GTX 1080 Ti GPUs using Ollama, achieving approximately 20 tokens per second. The author highlights three critical configuration requirements: NVIDIA driver version 570 or higher, CUDA v12 for Pascal architecture compatibility, and quantization settings to fit the model within the combined 22GB VRAM. This is a technical guide for users attempting to run this specific model on older but still capable GPU hardware.

Source: r/ollama | 2026-06-03

Loading related sources…