Did anyone do a full bench of e.g. Qwen Flash Next IQ4 and Qwen 27b FP8? Here are some

edit: had to change formatting as I’m on mobile noe and the table broke.. I let Codex do a quick eval on Qwen 3.8 Flash Next IQ4_XS (served via vLLM + r9v) and Qwen 3.8 27B FP8 (served via vLLM + Radiance) This was not the full eval. I only ran a reduced quick test because the full version would take way too long on my system. Results: MMLU-Pro Flash Next IQ4_XS: 83.8% 27B FP8: 75.0% GPQA Diamond Flash Next IQ4_XS: 42.5% 27B FP8: 27.5% GSM8K Flash Next IQ4_XS: 97.5% 27B FP8: 90.0% German MGSM Flash Next IQ4_XS: 92.5% 27B FP8: 90.0% IFEval Flash Next IQ4_XS: 89.6% 27B FP8: 89.6% The quick test took around 2h in total. The next, more complete iteration would already be >8h on my system, so I don’t really have time for the full eval right now. The 250-case “fast” trial took 36m 27s on 27B FP8 and 2h 05m 47s on Flash Next IQ4_XS. !! Important: MMLU is only 80 random questions here, so obviously don’t take the exact numbers too seriously. Same for the other evals, all not full. This is more of a quick comparison than a proper full benchmark run. Of course for both quants the same questions were used For reference, I’m running 64 GB DDR5 and 2x R9700. Recent r9v updates were not implemented here. With 128 GB DDR5 you could also use tcclaviger’s MXFP4 quant of Flash Next, which should make the QFN run around 2x faster. Any suggestions for more indicative benchmarks? Anyone did a bigger comparison? There are so many comments every week saying FP8 27B is better than low quants of QFN. I would consider IQ4_XS pretty low already though, and neither in daily use nor in this quick eval do I really see that. For single-user use I’d still prefer even the low quant of QFN. Concurrency is different though. On my system FP8 27B is around 4x faster than QFN there submitted by /u/smallDeltaBigEffect [link] [comments]

Source: r/LocalLLaMA | 2026-09-25