You can offload most of Qwen3.8-Flash-Next's KV cache to RAM with little decode slowdown
I'm pretty sure it can be done with any model based on qwen4exp, which Qwen's next local models will be based on. You can use a quant that barely fits in VRAM and still run at the model's maximum cont