Update your chat template for dsv4 if you're using llama.cpp

Following some recent commits in llama.cpp, preserve_thinking behavior for chat templates included in older DSV4 ggufs got broken. This makes the model pretty dumb in a coding agent context. Adding kwargs won't fix it. Just add: --chat-template-file /path/to/llama.cpp/models/templates/deepseek-ai-DeepSeek-V4.jinja to override the gguf's template with the new one the contributors created. submitted by /u/computehungry [link] [comments]

Source: r/LocalLLaMA | 2026-07-28