Model Releases
Is there a cache bug in the Claude Code CLI when using external models, or maybe even within the tool itself?
I read this somewhere and wasn't sure if it's still an issue or if it only affects external models versus all models used via the Claude Code CLI. 'This latest Ollama update finally fixes that issue w
I read this somewhere and wasn't sure if it's still an issue or if it only affects external models versus all models used via the Claude Code CLI. "This latest Ollama update finally fixes that issue where using Claude Code would break the KV Cache every single time. It actually got fixed a little while ago, but I'm sharing this because it'll be useful for anyone building harnesses. If you use Claude Code a lot, you might have noticed that about two weeks ago, it started constantly showing 'Token Left: ...' in every round of work, telling you exactly how much of your token limit is left. That right there was the problem. Claude Code was inserting it as a system tag like <total_tokens>...token</total_tokens>, but it was just shoving it right at the beginning of the history. This caused a KV cache miss every single round because instead of putting it somewhere sensible, it was stuck at the very front. This made anyone using Claude Code via Ollama burn through tokens like crazy because the KV cache couldn't catch anything. The latest Ollama version fixes this by just straight-up ignoring that tag. It's not a massive deal, but I wanted to flag this for people writing harnesses so they know to watch out for stuff like this." submitted by /u/OkResponsibility9182 [link] [comments]
Related
Source: r/ollama | 2026-08-28