Model Releases
176 t/s decode and 6,450 t/s prefill with Q4 Qwen-3.8 Flash-Next on 2xR9700 + 64GB DDR5 using Deadcode's Radiance engine
https://preview.redd.it/kudj7xii5ivh1.png?width=1508&format=png&auto=webp&s=07712e81310b81aceb2cf8f4d8a7c2eadeb0c304 Just built a new PC, full parts list is here. I am using Deadcode's Radiance infere
https://preview.redd.it/kudj7xii5ivh1.png?width=1508&format=png&auto=webp&s=07712e81310b81aceb2cf8f4d8a7c2eadeb0c304 Just built a new PC, full parts list is here. I am using Deadcode's Radiance inference engine, optimized for 2xR9700 and his Q4. The throughput benchmark tool is BetterBench. submitted by /u/Athabasco [link] [comments]
Related
- qwen4exp fixes in llama.cpp
- Quad R9700 AI Pro with vLLM-Radiance easily reaching 17,6k PP
- Qwen 3.8 27b with DSH(DeepSeek Harness) is Amazing!! Experiences so far and perfomance.
Source: r/LocalLLaMA | 2026-10-14