Model Releases
Strata + Qwen 3.8 Flash Next: fast, but what's it costing in quality?
Lots of hype around Strata lately and the speeds look great. But everything I see is tokens per second and needle tests. Has anyone checked if quality holds up? Same GGUF on llama.cpp should answer th
Lots of hype around Strata lately and the speeds look great. But everything I see is tokens per second and needle tests. Has anyone checked if quality holds up? Same GGUF on llama.cpp should answer the quant question, but Strata also prunes experts. Does that cost anything in actual use? submitted by /u/msalsas [link] [comments]
Related
- Basalt: Flash-Next at 665 tok/s structured, 354 prose on a 5090 + 5060 Ti (2.6x Strata)
- Qwen3.8 flash next ISTA-DASLab GGUF 50t/s TG and 1500t/s PP with 12GB VRAM and 64GB RAM Laptop on 'Strata' engine
- Basalt: Fast Blackwell inference engine for Qwen 3.8 Flash Next (and how we got vision for free)
- Qwen Flash Next @ 137 tok/s & 3,497 tok/s Prefill w/ 512k context on a 5090, 192gb ram, Windows Build, comparing Strata and Infernix
Source: r/LocalLLaMA | 2026-10-17