Local Ai
Currently having high success with this little niche finetune i found sitting in the corner of huggingface
Currently having high success with this little niche finetune i found sitting in the corner of huggingface If you want to try it out here is a smaller quantisation iq3_s works really well in my codeba
Currently having high success with this little niche finetune i found sitting in the corner of huggingface If you want to try it out here is a smaller quantisation iq3_s works really well in my codebases. Original Model: https://huggingface.co/tsinghua-sigs-robot-lab/VeriLoop-E2-GGUF Smaller Quant: https://huggingface.co/tahaalam2009/VeriLoop-E2-GSQ-RCO-GGUF submitted by /u/Express_Quail_1493 [link] [comments]
Related
- Are there any experimental small models (9B or less) which are out or currently being trained using engram/n-grams?
- Is there a better small model than Qwen3.5 4B for a fast local AI assistant?
- Qwen3.8 Flash AP Quants
- R9V Update: now ~100 tok/s in TG on Qwen3.8 Flash Next IQ4_XS on x2 R9700 + 128GB RAM. Fixed crashes with n-gram SSD streaming, improved diagnostics, plus pinned images. Q4_K_XL now supported, 50 tok/s TG.
Source: r/LocalLLaMA | 2026-10-08