Model Releases
What setup do you use, which harness? and how do you customize it to run qwen 3.8 flash next swift with a high context length and a reasonable amount of tok/sec?
As i use a rather tiny setup 12gb vram gpu and 32bg ram, i was wondering: What setup do you use, which harness? and how do you customize it to run qwen 3.8 flash next swift with a high context length
As i use a rather tiny setup 12gb vram gpu and 32bg ram, i was wondering: What setup do you use, which harness? and how do you customize it to run qwen 3.8 flash next swift with a high context length and a reasonable amount of tok/sec? submitted by /u/LearnNTeachNLove [link] [comments]
Related
- What settings do you use for running Qwen3.8-Flash-Next in llama.cpp?
- You can offload most of Qwen3.8-Flash-Next's KV cache to RAM with little decode slowdown
- Qwen 3.8 Flash Next q4_k_m, 130k context, q8 cache on 16GB VRAM ann 64GB RAM, 15-20 t/s on 4080
- Experience report - Qwen 3.8 Flash Next on memory rich, GPU poor setup
Source: r/LocalLLaMA | 2026-10-11