Local Ai
d3-edge (0.6B) fine-tuned outperformed d3 (27B) decision model
Took vLLM-SR d3-edge (0.6B), fine-tuned it with simple SFT + LoRA, and compared it against the much larger d3 (27B). With just a few thousand training examples, the 0.6B model actually outperformed th
Took vLLM-SR d3-edge (0.6B), fine-tuned it with simple SFT + LoRA, and compared it against the much larger d3 (27B). With just a few thousand training examples, the 0.6B model actually outperformed the 27B model on typed decisions and nearly matched it on Banking77. I strongly believe we should be fine-tuning small, specialized decision models rather than using large general-purpose models for every task. Colab - https://colab.research.google.com/drive/1wze4PA3GBrxRLYhzzFK7czlmvAgRdA9P?usp=sharing submitted by /u/mshubham [link] [comments]
Related
- Can a 4B local model actually feel like an AI assistant?
- omni-d1 600M by Liquid AI running in the browser using WebGPU
- DecisionTune 1.0: a 395M encoder that picks from your options offline, about 10 ms per short decision on MLX (Apache-2.0)
Source: r/LocalLLaMA | 2026-10-16