model : MTP support for Mellum2.1 by Xarbirus · Pull Request #30612 · ggml-org/llama.cpp

Mellum2.1 Highlights Mellum2.1 is the next version of Mellum2 Thinking. The architecture is unchanged (a 12B mixture-of-experts model with 2.5B active parameters), and almost all of the work for this version went into post-training, primarily reinforcement learning (RL): Reinforcement learning at a new scale: RL went from a short final stage to the main part of training, after many experiments on both the methods and the data. More data, filtered harder: new RL tasks in math, competitive programming, science, tool use, and software engineering, combining open RL datasets with tasks we built ourselves and filtering every source before training. Real environments for agentic skills: for software engineering, the model trains inside real repositories with a shell and file-editing tools and is rewarded when the tests pass. As a result, Mellum2.1 handles agentic tasks much better than Mellum2. After millions of sandboxed runs in real environments during training, it explores a codebase, edits files, and checks its own changes. Model Overview Mellum2.1 Thinking has the following features: Number of Parameters: 12B total, 2.5B active Number of Layers: 28 Hidden Size: 2304 Intermediate Size: 7168 MoE Intermediate Size: 896 Number of Experts: 64 Number of Activated Experts: 8 Number of Attention Heads (GQA): 32 for Q and 4 for KV Context Length: 131,072 Sliding Window: 1,024 (3 of every 4 layers) Vocabulary Size: 98,304 Precision: bfloat16 License: Apache 2.0 submitted by /u/jacek2023 [link] [comments]

Source: r/LocalLLaMA | 2026-10-16