Hardware
little-coder vs just Pi
Hi, I use hermes as a harness, and I am pleased with it, but sometimes Hermes's context size is a bit too much for my system, so I wanted to delegate or straight up use a lighter option for coding tas
Hi, I use hermes as a harness, and I am pleased with it, but sometimes Hermes's context size is a bit too much for my system, so I wanted to delegate or straight up use a lighter option for coding tasks. I run a laptop with a 8gb nvidia card and 40gb of ram. And qwen3.6 35b-a3b or similar tier models are a good trade of quality/speed. The point is, I found little-coder (there is also smallcoder), which promises a small context and a setup of extensions over Pi tailored for small models like qwen3.6 35b-a3b itself. But I wonder if it wouldn't be better to just run just Pi with its barebones system prompt and tools. Any opinions, tests, or experiences in this matter? submitted by /u/Botoni [link] [comments]
Related
- Multilingual Tiny (3.7B) Reasoning MoE pretrained from scratch on a consumer-grade GPU
- PiKV: KV Cache Management System for Mixture of Experts
Source: r/LocalLLaMA | 2026-09-07