RELEASE · MODELS · #4010
Thinking Machines Lab releases Inkling 2 Mini — looped MoE model for local use
Inkling 2 Mini is a new multimodal looped transformer Mixture-of-Experts from Thinking Machines Lab (~26B physical params, ~3B active per token) that reuses 24 physical layers with a triple-pass loop to behave like a deeper model, supports 1M-token context, image+text inputs, mixed-precision NVFP4/MXFP8 expert weights, and a DSpark drafter; a variable-loop research checkpoint (TML-d24-varloop-research) is also provided. The model is packaged for local and datacenter inference with transformers, llama.cpp, MLX and SGLang support and is reported to lead many benchmarks in its class.
KEY POINTS
- Inkling 2 Mini is a new multimodal looped transformer Mixture-of-Experts from Thinking Machines Lab (~26B physical params, ~3B active per token) that reuses 24 physical layers with a triple-pass loop to behave like a deeper model, supports 1M-token context, image+text inputs, mixed-precision NVFP4/MXFP8 expert weights, and a DSpark drafter; a variable-loop research checkpoint (TML-d24-varloop-research) is also provided.
- The model is packaged for local and datacenter inference with transformers, llama.cpp, MLX and SGLang support and is reported to lead many benchmarks in its class.
- This release demonstrates a practical looped-MoE design that increases logical depth and capacity while keeping checkpoints small, aimed at making high-capacity multimodal models viable for local and on‑premise deployments.
WHY IT MATTERS
This release demonstrates a practical looped-MoE design that increases logical depth and capacity while keeping checkpoints small, aimed at making high-capacity multimodal models viable for local and on‑premise deployments.
SOURCES & TIMELINE
2TLDR; Inkling 2 Mini is a new looped transformer model. It’s a multimodal Mixture-of-Experts with ~26B physical total and 3B active parameters per token. It uses a neat trick to increase capacity: some layers are visited in a loop that repeats three times, which makes it work like it had more parameters. It supports a 1M-token context size, accepts images and text inputs. Thinking Machines Lab ships the model in a mi…
Thinking Machines has released Inkling 2 Mini, a so-called looped transformer. A looped transformer runs certain layers multiple times for each token. Inkling 2 Mini runs 12 of its 24 layers three times in a row. That lets the model reason internally for longer without generating more text, finding the right answer with fewer tokens, according to Thinking Machines . The open mixture-of-experts model has 26.4 billion …