Qwen 3.8 27B run just 0.7tok/s on 5060ti 16GB

I just tried to run Qwen 3.8 27B 4bit qwant on 5060ti 16GB and got terrible results. With Qwen 3.6 I got something around 15-20 tok/s. Are there any combination of parameters or tweeks how to push the speed higher, at least to 10+tok/s or the HW is just poor for that use case? I heard the sweet spot is 24GB Vram but still i was thinking that it will be possible to run it somehow also on 16GB. Thanks for answers submitted by /u/spellsingerka [link] [comments]

Source: r/ollama | 2026-09-07