Ling 3.0 Tiny makes an amazing auxillery model for Hermes (Qwen 3.8 27B as the primary model)

Just got the setup dialed in yesterday. Getting really good results and is making 3.8 usage feel faster in hermes. I got Qwen to specifically use Ling tiny for simple tasks like context compression and summerization tasks. (basically anything that is not intellegence critical) Ling has like 5x faster t/s and over 5K prompt processing on my hardware. Its really been solid. Posting so hopefully more people consider it who have vram to spare. Q6 with KV Q8 and 131K context uses under 10gb of vram. The cool thing is I have the agent set up in a way that It can dynamically use ling as needed if it feels like its appropriate to do so. I havent noticed a quality dropoff in my hermes agent as a whole. my wall time for task completion has for sure decreased. My assistant has an assistant. lol submitted by /u/My_Unbiased_Opinion [link] [comments]

Source: r/LocalLLaMA | 2026-08-20