Model Releases
Halogen + Qwen Flash Next keeps getting better
With latest Halogen version update (0.17.2), decode is consistently at ~45 tps even at high context with Qwen 3.8 Flash Next on a 128GB Strix Halo. This is some great work u/peonist-ai. Have been pump
With latest Halogen version update (0.17.2), decode is consistently at ~45 tps even at high context with Qwen 3.8 Flash Next on a 128GB Strix Halo. This is some great work u/peonist-ai. Have been pumping out commit after commit with QFN. Its crazy good for a 177ish billion model. I dont think we are apprciating it enough 😂 Opus 5.5 plan implemented and reviewed by QFN is such high quality ❤️ https://preview.redd.it/yyji811t28uh1.png?width=1358&format=png&auto=webp&s=99d119ea46982d0b8710b1ff6a817551096a26c4 submitted by /u/deepu105 [link] [comments]
Related
- If you are running Qwen 3.8 Flash Next on Strix Halo, use this software for inference. It's so much faster than llama.cpp especially at high context.
- Qwen3.8 Flash Next now at 1.2k t/s prefill on Strix Halo
Source: r/LocalLLaMA | 2026-10-08