Model Releases
quants for K2-Horizon are now available
You can finally downloads quants from: https://huggingface.co/IFM/K2-Horizon-MoVA-36B-A4B-GGUF https://preview.redd.it/cfhl43pps4rh1.png?width=2800&format=png&auto=webp&s=313eab309fb407a0a0e5da61e2a12
You can finally downloads quants from: https://huggingface.co/IFM/K2-Horizon-MoVA-36B-A4B-GGUF https://preview.redd.it/cfhl43pps4rh1.png?width=2800&format=png&auto=webp&s=313eab309fb407a0a0e5da61e2a120c677d3d3cd https://huggingface.co/IFM/K2-Horizon-32B-GGUF https://preview.redd.it/jeh7lg6ss4rh1.png?width=2800&format=png&auto=webp&s=1982d31b019c5b85db68ea4520e380ce5748b03e https://huggingface.co/IFM/K2-Horizon-7B-GGUF https://preview.redd.it/xy699t9us4rh1.png?width=3800&format=png&auto=webp&s=a1420ba20d63aabe10eac7d11d6188da264ca814 https://huggingface.co/IFM/K2-Horizon-3.7B-GGUF https://preview.redd.it/rq5jiqzvs4rh1.png?width=3800&format=png&auto=webp&s=6fbd59b5b419a63185b4c844b87d7240f0932001 https://huggingface.co/IFM/K2-Horizon-0.9B-GGUF https://preview.redd.it/7bydjf4xs4rh1.png?width=3800&format=png&auto=webp&s=535ec81b2ca7b556715b0c1999964b697f9e6b40 however their llama.cpp PR is still in progress so you need to use the fork submitted by /u/jacek2023 [link] [comments]
Related
- Döner Bench DeepSeek-V4-Flash IQ2_XS running on a single RTX 3090
- Deepseek V4 flash 0731 ranks #21 on Agent Arena
- Qwen3.8-27B IQ3_XXS wrote a correct multilayer TMM on a 16 GB Quadro — after 100 minutes, 3 compactions, and 108k output tokens
- is this good? 262k Qwen3.8:27B-Q4_K_M
Source: r/LocalLLaMA | 2026-09-22