Horsey challenge | Strata Fork | Qwen 3.8 FN NVFP4

So I wanted to try the horsey challenge myself on the latest engine i been testing which is a strata fork by sergqwer. https://github.com/sergqwer/strata-nvfp4. I seen a post earlier and seen i believe it was a iq3 i think and it was pretty dope so i thought i try out the NVFP4. I wasn't expecting to share but i actually that it did pretty darn good with its current time it took total. I did change the prompt because this was the second try because the first one got botched because Qwen wanted to leave like 15+ headless windows open when testing the html. I scrolled to another window while it was working and realized my window was lagging lmao. That test i ended it like 45 min in. Which then i retried with new prompt and this time it was much faster. I had this fork up and running a few days now. I had to tweak some settings for a higher compaction i believe at the 220k-230k mark. It didn't need compaction this time as it was under the limit but when I use it for long runs projects using unity headless, Blender headless and some other things like image gen for texture i will be compacting a lot. Its only been a couple days but so far its been fairly great to anything I have used prior. That goes for the engine and the current model i'm using. This is just to share and contribute to how far we come to accessing models on single gpu and being able to have a chance at some of these things. Maybe it'll motivate more people to show their work a bit more often. I know this sub has motivated me a lot to start sharing and also appreciate all that has helped to contribute for anything Local. Thank you to the original Strata Team, Sergqwer for the fork, windowsxp811203 for your model I converted over to work with Strata, and the Qwen Team for the amazing drops. *The charts were organized by Ai only, it was easier to have it sort it nicer and clean it. Also I did a prtsc video capture if you ask about quality of vid. Prompt here also that i had to edit myself lol. "Create a low-poly 3D horse running in a seamless loop using Three.js. Build it procedurally from primitive geometry, animate the legs, body, head, and tail, and return a single self-contained HTML file. Also when you use headless chrome make sure to kill your process that you don't need anymore. we dont need all these headless chromes lagging our system when we don't need it" The stack Hardware: RTX 5090 32GB · Ryzen 7 9800X3D · 192GB DDR5-5600 · Windows 11 Engine: strata-nvfp4 (fork of Niko1221/Strata by sergqwer) running on Windows, fronted by llama-swap as the model switcher Model: Qwen3.8-Flash-Next 125B-A6B hybrid MoE — abliterated checkpoint, self-converted to NVFP4 Weights: NVFP4 experts (4.5-bit, calibrated scales) + Q8_0 dense KV cache: int8 PLE table: bf16 Embeddings: bf16 MTP: draft head, spec 5, spec-min-p 0.7 Context: 262,144 max Compaction: custom trip line at 220,144 Sampling: temp 0.8 / presence_penalty 0.3 / min_p 0.02 Vision: fp32 mmproj, encoder on CPU RAM tier: 63 GiB pinned experts; hot experts cached in VRAM; misses computed CPU+PCIe overlapped with GPU Harness: dsh (web GUI), OpenAI API | Metric | Value | |---|---| | Wall: first message → last reply | 33m 45s | | − my approval latency (25 permission prompts) | −10m 35s | | = pure agent working time | 23m 10s | | Steps | 87 | | Output tokens (thinking + code + tool calls) | 124,443 | | Fresh input tokens | 96,334 | | Cache-read tokens | 9,340,144 (99.0% hit rate) | | Decode (per-step, approval-adjusted) | median 116 t/s · mean 103 · peak 171 | | TTFT | median 0.7s (max 24.9s at deep context) | | Prefill (fresh tokens) | mean 3,332 t/s · peak 6,623 t/s | | Longest single burst | 21,279 tokens | | Compactions | 0 (never hit the 220k line in 33 min) | TOOL CALLS — 107 total, 14m 10s of tool runtime submitted by /u/Beneficial-Ad-8127 [link] [comments]

Source: r/LocalLLaMA | 2026-10-13

Related