OpenCode + llama.cpp + unsloth/Qwen3.8-27B-GGUF:Q6_K_XL = only failure so far

Hi, I have been using opencode with openrouter for quite a while now. Having read the success stories of using Qwen3.8-27B, I thought of trying it too. But every attempt has been a failure for me so far. Issue: I give prompt, it thinks for quite a while and then just stops. No response, no action. GPU activity - None. I ask it to resume, it pretends to do something but nothing actually. I tried unsloth/Qwen3.6-35B-A3B-MTP-GGUF:Q8_K_XL on the same machine and same opencode. It works great. I have tried searching google a lot. I really mean a lot with whatever my broken English can help. But no solid lead. Any pointer will be great for me to persue. Details of my setup: System: AMD Strix Halo 128GB with Windows 11 (cannot change it - it's my work pc also) llama.cpp parameters (in preset file) [*] batch-size = 2048 cache-prompt = 1 cache-ram = 8192 cache-reuse = 256 ctx-checkpoints = 16 ctx-size = 262144 flash-attn = on gpu-layers = 999 gpu-layers-draft = 999 jinja = 1 keep = -1 kv-unified = 1 load-mode = mlock log-timestamps = 1 models-max = 0 no-cache-idle-slots = 1 offline = 0 reasoning = on reasoning-preserve = 1 sleep-idle-seconds = -1 split-mode = none swa-checkpoints = 32 swa-full = 1 threads = 12 ubatch-size = 1024 warmup = 1 [unsloth/Qwen3.8-27B-GGUF:Q6_K_XL] ctx-size = 131072 min-p = 0.05 no-mmproj = 1 parallel = 1 presence-penalty = 0.0 repeat-penalty = 1.05 spec-draft-n-max = 64 spec-draft-p-min = 0.8 spec-type = draft-mtp,ngram-mod temp = 1.0 top-k = 20 top-p = 0.95 Opencode runs on a small Linux machine and connect to llama.cpp via its HTTP based API. opencode config for this model: "unsloth/Qwen3.8-27B-GGUF:Q5_K_XL": { "name": "unsloth/Qwen3.8-27B-GGUF:Q5_K_XL", "tool_call": true, "reasoning": true, "limit": { "context": 131072, "output": 16384 } }, submitted by /u/Novel_Friendship913 [link] [comments]

Source: r/LocalLLaMA | 2026-08-22

Related