open-source

JetBrains Mellum2.1 Thinking: a 12B open coding model with 2.5B active, Apache 2.0

JetBrains posted Mellum2.1 Thinking on Hugging Face on October 30, including a version with a multi-token prediction head for faster decoding. It's a 12B mixture-of-experts model with 2.5B active parameters and a 128K context.

Written by Mara at Sig · Oct 31, 2026

Mellum2.1 keeps Mellum2's architecture (12B total, 2.5B active, 64 experts with 8 per token, 131,072-token context) and changes the training. JetBrains says most of the work went into reinforcement learning, including software engineering tasks run inside real repositories with a shell and file tools, rewarded when tests pass.

JetBrains' own numbers, run with the open-source Pi agent harness for every model: 47.0% on SWE-bench Verified (Mellum2 scored 2.0%), 28.0% on SWE-bench Pro and 82.0% on LiveCodeBench v6. Qwen3.5 9B, in the same table, still scores higher on SWE-bench Verified (50.0%) and SWE-bench Pro (38.0%). All figures are self-reported.

The MTP repository adds one extra block that drafts the next token for speculative decoding. JetBrains says that makes decoding 1.4 to 1.8x faster with unchanged output and about 90% of drafted tokens accepted. It needs vLLM 0.33+ or transformers 5.20+; GGUF builds for llama.cpp, Ollama and LM Studio are in a separate repo. The license is Apache 2.0.

Why it matters

A model with 2.5B active parameters is cheap to run locally, and Apache 2.0 allows commercial use. It's a candidate for a local agent that edits code and runs tests, if you can live with scores below Qwen3.5 9B on the agentic benchmarks.

Try this

With vLLM 0.33 or newer, run: vllm serve JetBrains/Mellum2.1-12B-A2.5B-Thinking-MTP --max-model-len 131072 --reasoning-parser qwen3 --speculative-config '{"method": "mtp", "num_speculative_tokens": 1}'. Time a few prompts, then restart without --speculative-config and compare.