Agents
Is anyone running Qwen3.8 Flash Next with a 1M context?
So, while doing a search to read the model card again, and because I didn't memorize the huggingface URL, I saw an AI 'answer' at the top of the search, stating that while it natively supports a ~244k
So, while doing a search to read the model card again, and because I didn't memorize the huggingface URL, I saw an AI "answer" at the top of the search, stating that while it natively supports a ~244k context, it could go to 1M using YaRN. That's the first I have heared of both, the 1M context, and YaRN. Has anyone used that method? I want to use this model for a Hermes agent, so a long context could be good...I think. But I am still waiting for my mobo to ship, so for now all I can do is ask. x) Thanks! submitted by /u/IngwiePhoenix [link] [comments]
Related
- First few days of qwen3.8-flash-next on 4x R9700 - it's been really interesting so far
- Qwen3.8-Flash-Next at 170K context on a single 96 GB card. ~110 tok/s.
- Qwen3.8-Flash-Next (5.05bpw + ngram at bf16) exl3 on one r9700: 863 t/s prefill and 35 t/s decode at 230k context (256k max), is that ok or am i missing something?
- Qwen3.8-Flash-Next (95.5 GiB) on a 64GB Mac at ~27 tok/s, checkpoint + fork
Source: r/LocalLLaMA | 2026-10-10