Model Releases
Deepseek V4 Flash 2-bit quant is the first model I can run locally that achieves 100% in this SQL benchmark
I really like to use this one SQL benchmark when testing new models. I had another post some time ago with my benchmarks, but I decided to post a new one because of how well Deepseek did. I like the b
I really like to use this one SQL benchmark when testing new models. I had another post some time ago with my benchmarks, but I decided to post a new one because of how well Deepseek did. I like the benchmark because it's quick to run, is pretty "real-world" and requires good reasoning to build the correct SQL queries and almost no frontier models can achieve 100%. My old post: https://www.reddit.com/r/LocalLLaMA/comments/1s9mkm1/benchmarked_18_models_that_i_can_run_on_my_rtx/ Benchmark with results from other models: https://sql-benchmark.nicklothian.com https://github.com/nlothian/llm-sql-benchmark My setup is dual 3080 20GB GPUs with 96GB RAM and 9800X3D. I managed to run Deepseek V4 Flash with a custom IQ2_M GGUF with some tensors grafted from antirez GGUF and running it on a modified ds4 engine from antirez, getting 300pp and 11-12tg. Mainline llama.cpp gives me only 100pp and 8tg or something like that. To my surprise, Deepseek is the first local model I can realistically run locally that actually did ALL tests correctly. The only models according to the benchmark website that could do this were Opus 4.7 and GPT-5.5. Results together with all my old benches: 25: Deepseek-v4-Flash-IQ2_M-grafted đŠđŠđŠđŠđŠ đŠđŠđŠđŠđŠ đŠđŠđŠđŠđŠ đŠđŠđŠđŠđŠ đŠđŠđŠđŠđŠ 24: unsloth/Qwen3.6-27B-MTP-GGUF:Q8_0 đŠđŠđŠđŠđŠ đŠđŠđŠđŠđŠ đŠđŠđŠđŠđŠ đŠđŠđŠđŠđŠ đŠđŠđĽđŠđŠ 24: unsloth/Qwen3.5-122B-A10B-GGUF:UD-Q4_K_XL đŠđŠđŠđŠđŠ đŠđŠđŠđŠđŠ đŠđŠđŠđŠđŠ đŠđŠđŠđĽđŠ đŠđŠđŠđŠđŠ 23: unsloth/Qwen3.5-122B-A10B-GGUF:Q6_K đŠđŠđŠđŠđŠ đŠđŠđŠđŠđŠ đŠđŠđŠđŠđŠ đŠđŠđŠđĽđŠ đĽđŠđŠđŠđŠ 23: unsloth/Qwen3.5-27B-MTP-GGUF:UD-Q6_K_XL đŠđŠđŠđŠđŠ đŠđŠđŠđŠđŠ đŠđŠđŠđŠđŠ đŠđŠđŠđĽđŠ đĽđŠđŠđŠđŠ 23: DavidAU/Qwen3.6-40B-Claude-4.6-Opus-Deckard-Heretic-Uncensored-Thinking-NEO-CODE-Di-IMatrix-MAX-GGUF:Q4_K_M đŠđŠđŠđŠđŠ đŠđŠđŠđŠđŠ đŠđŠđĽđŠđŠ đŠđŠđŠđĽđŠ đŠđŠđŠđŠđŠ 23: unsloth/Qwen3.6-35B-A3B-GGUF:UD-Q8_K_XL đŠđŠđŠđŠđŠ đŠđŠđŠđŠđŠ đŠđŠđĽđŠđŠ đŠđŠđŠđĽđŠ đŠđŠđŠđŠđŠ 23: bartowski/Qwen_Qwen3.5-27B-GGUF:IQ4_XS đŠđŠđŠđŠđŠ đŠđŠđŠđŠđŠ đŠđŠđŠđŠđŠ đŠđŠđŠđĽđŠ đĽđŠđŠđŠđŠ 23: bartowski/Qwen_Qwen3.5-27B-GGUF:IQ3_XS đŠđŠđŠđŠđŠ đŠđŠđŠđŠđŠ đŠđŠđŠđŠđŠ đŠđŠđŠđĽđŠ đĽđŠđŠđŠđŠ 23: unsloth/Qwen3.5-122B-A10B-GGUF:UD-IQ3_XXS đŠđŠđŠđŠđŠ đŠđŠđŠđŠđŠ đŠđŠđŠđŠđŠ đŠđŠđŠđĽđŠ đĽđŠđŠđŠđŠ 23: h34v7/Jackrong-Qwopus3.5-27B-v3-GGUF:Q3_K_M đŠđŠđŠđŠđŠ đŠđŠđŠđŠđŠ đŠđŠđŠđŠđŠ đŠđŠđŠđĽđŠ đĽđŠđŠđŠđŠ 22: unsloth/Qwen3.5-35B-A3B-GGUF:UD-Q6_K_XL đŠđŠđŠđŠđŠ đŠđŠđŠđŠđŠ đŠđŠđĽđŠđŠ đŠđŠđŠđĽđŠ đĽđŠđŠđŠđŠ 22: mradermacher/Qwen3.5-27B-Claude-4.6-Opus-Reasoning-Distilled-i1-GGUF:Q3_K_M đŠđŠđŠđŠđŠ đŠđŠđŠđŠđŠ đŠđŠđŠđŠđŠ đŠđĽđŠđĽđŠ đĽđŠđŠđŠđŠ 22: Jackrong/Qwen3.5-27B-Claude-4.6-Opus-Reasoning-Distilled-v2-GGUF:Q4_K_M đŠđŠđŠđŠđŠ đŠđŠđŠđŠđŠ đŠđŠđŠđŠđŠ đŠđŠđĽđĽđŠ đĽđŠđŠđŠđŠ 21: unsloth/Qwen3.6-27B-MTP-GGUF:UD-Q6_K_XL đŠđŠđŠđŠđŠ đŠđŠđŠđŠđŠ đŠđĽđŠđŠđŠ đŠđŠđŠđĽđŠ đŠđ¨đĽđŠđŠ 21: unsloth/MiniMax-M2.7-GGUF:UD-IQ3_XXS đŠđŠđŠđŠđŠ đŠđŠđŠđŠđŠ đŠđŠđŠđŠđŠ đŠđŠđŠđĽđŠ đĽđĽđĽđŠđŠ 21: unsloth/NVIDIA-Nemotron-3-Super-120B-A12B-GGUF:UD-Q4_K_S đŠđŠđŠđŠđŠ đŠđŠđŠđŠđŠ đŠđŠđŠđŠđŠ đŠđŠđŠđ¨đĽ đĽđ¨đŠđŠđŠ 20: unsloth/Qwen3-Coder-Next-GGUF:UD-Q5_K_XL đŠđŠđŠđŠđ¨ đŠđŠđŠđŠđŠ đŠđŠđ¨đŠđŠ đŠđŠđŠđĽđ¨ đĽđŠđŠđŠđŠ 20: unsloth/gemma-4-31B-it-qat-GGUF:UD-Q4_K_XL đŠđŠđŠđŠđŠ đŠđŠđŠđŠđŠ đĽđŠđŠđŠđŠ đ¨đŠđŠđĽđŠ đĽđŠđŠđĽđŠ 20: unsloth/Qwen3.6-35B-A3B-GGUF:UD-Q6_K_XL đŠđŠđŠđŠđŠ đŠđŠđŠđŠđŠ đŠđŠđĽđŠđŠ đŠđŠđŠđĽđŠ đĽđĽđĽđŠđŠ 20: bartowski/Qwen_Qwen3.5-397B-A17B-GGUF:IQ1_M đŠđŠđŠđŠđŠ đŠđŠđŠđŠđŠ đŠđŠđĽđŠđŠ đŠđŠđŠđĽđŠ đĽđ¨đĽđŠđŠ 20: unsloth/gemma-4-26B-A4B-it-GGUF:UD-Q6_K_XL đŠđŠđŠđŠđŠ đŠđŠđŠđŠđŠ đŠđŠđŠđŠđŠ đŠđŠđŠđĽđĽ đ¨đĽđŠđĽđŠ 20: mradermacher/Qwen3.5-35B-A3B-Claude-4.6-Opus-Reasoning-Distilled-i1-GGUF:Q6_K đŠđŠđŠđŠđŠ đŠđŠđŠđŠđŠ đŠđŠđĽđŠđŠ đĽđŠđŠđĽđŠ đĽđĽđŠđŠđŠ 19: unsloth/gemma-4-31B-it-GGUF:Q4_K_M đŠđŠđŠđŠđŠ đŠđŠđŠđŠđŠ đŠđŠđŠđĽđŠ đ¨đŠđŠđ¨đŠ đĽđĽđŠđĽđŠ 19: unsloth/gemma-4-E4B-it-GGUF:UD-Q8_K_XL đŠđŠđŠđŠđŠ đŠđŠđŠđŠđŠ đŠđŠđŠđĽđŠ đŠđŠđŠđĽđŠ đĽđĽđĽđĽđŠ 19: Goldkoron/Qwen3.5-397B-A17B-REAP35:IQ2_XS_Gv2 đŠđŠđŠđŠđŠ đŠđŠđŠđŠđŠ đĽđŠđŠđŠđŠ đŠđŠđŠđĽđŠ đĽđŠđĽđĽđĽ 19: unsloth/GLM-4.7-Flash-GGUF:UD-Q6_K_XL đŠđŠđŠđŠđŠ đŠđŠđŠđŠđŠ đŠđŠđĽđŠđŠ đŠđŠđŠđĽđ¨ đĽđ¨đŠđĽđŠ 18: unsloth/GLM-4.5-Air-GGUF:Q5_K_M đŠđŠđŠđŠđŠ đŠđŠđŠđŠđŠ đŠđŠđĽđŠđŠ đĽđŠđŠđĽđŠ đ¨đ¨đĽđŠđ¨ 18: bartowski/nvidia_Nemotron-Cascade-2-30B-A3B-GGUF:Q6_K_L đŠđŠđŠđŠđŠ đŠđŠđŠđŠđŠ đŠđŠđ¨đŠđŠ đŠđŠđŠđĽđŠ đ¨đ¨đĽđ¨đ¨ 17: Jackrong/Qwopus3.5-9B-v3-GGUF:Q8_0 đŠđŠđŠđŠđŠ đŠđŠđŠđŠđŠ đŠđĽđĽđŠđŠ đĽđŠđĽđĽđĽ đĽđŠđŠđŠđ¨ 16: unsloth/Qwen3-Coder-Next-GGUF:UD-Q4_K_XL đŠđŠđŠđŠđ¨ đŠđŠđŠđŠđŠ đŠđŠđ¨đŠđŠ đĽđ¨đŠđĽđ¨ đĽđ¨đŠđ¨đŠ 16: byteshape/Devstral-Small-2-24B-Instruct-2512-GGUF:IQ3_S đŠđŠđŠđŠđŠ đŠđŠđŠđŠđŠ đĽđŠđ¨đŠđŠ đŠđŠđ¨đĽđ¨ đ¨đ¨đĽđ¨đŠ 16: mradermacher/Qwen3.5-9B-Claude-4.6-HighIQ-THINKING-i1-GGUF:Q6_K đŠđŠđŠđŠđŠ đŠđŠđŠđŠđŠ đŠđŠđ¨đĽđŠ đĽđŠđĽđĽđ¨ đĽđŠđĽđŠđ¨ 14: mradermacher/Qwen3.5-9B-Claude-4.6-HighIQ-INSTRUCT-i1-GGUF:Q6_K đŠđŠđŠđŠđŠ đŠđŠđŠđŠđŠ đĽđŠđĽđŠđŠ đŠđ¨đĽđĽđ¨ đ¨đ¨đĽđ¨đ¨ 14: unsloth/GLM-4.6V-GGUF:Q3_K_S đŠđŠđŠđŠđŠ đŠđŠđŠđŠđŠ đĽđŠđ¨đ¨đŠ đĽđŠđŠđ¨đ¨ đ¨đ¨đ¨đ¨đ¨ 5: bartowski/Tesslate_OmniCoder-9B-GGUF:Q6_K_L đ¨đ¨đ¨đ¨đ¨ đ¨đ¨đ¨đŠđŠ đŠđ¨đ¨đŠđ¨ đ¨đ¨đŠđ¨đ¨ đ¨đ¨đ¨đ¨đ¨ 5: unsloth/Qwen3.5-9B-GGUF:UD-Q6_K_XL đ¨đ¨đ¨đ¨đ¨ đ¨đ¨đ¨đŠđŠ đ¨đŠđ¨đ¨đŠ đ¨đŠđ¨đ¨đ¨ đ¨đ¨đ¨đ¨đ¨ Note: unsloth/Qwen3.5-122B-A10B-GGUF:UD-Q4_K_XL is most likely a fluke. Q6_K doesn't achieve 24/25, it's just lucky rounding for this Q4 quant I suppose. submitted by /u/grumd [link] [comments]
Source: r/LocalLLaMA | 2026-08-04