Model Releases
BeeLlama.cpp: advanced DFlash & TurboQuant with support of reasoning and vision. Qwen 3.6 27B Q5 with 200k context on 3090, 2-3x faster than baseline (peak 135 tps!)
BeeLlama.cpp is an optimized implementation featuring advanced DFlash and TurboQuant quantization techniques with support for reasoning and vision capabilities. The project demonstrates running Qwen 3
BeeLlama.cpp is an optimized implementation featuring advanced DFlash and TurboQuant quantization techniques with support for reasoning and vision capabilities. The project demonstrates running Qwen 3.6 27B with Q5 quantization and 200k context window on an RTX 3090 GPU, achieving 2-3x faster performance than baseline with peak throughput of 135 tokens per second.
Source: r/LocalLLaMA | 2026-05-09