SGLang

2026-10-30

COMPANIES · 1 SOURCE · NVIDIA Developer

NVIDIA packages Dynamo 1.4.2 into validated Kubernetes runtime recipes with AICR

NVIDIA's DSX AI Factory Platform adds Dynamo 1.4.2 and its cluster dependencies into reproducible, validated runtime recipes via the NVIDIA AI Cluster Runtime (AICR). AICR pins component versions, captures GPU/DR A, scheduling, networking and monitoring requirements, offers a five-step render/deploy/validate flow (snapshot, generate recipe, render bundle, deploy via Helmfile/GitOps, validate), and documents routing options (TCP + ZMQ) including a Gateway API / EPP ingress path; NATS is now opt-in.

6.0

2026-10-29

MODELS · 5 SOURCES · Mistral AI · WIRED AI · Hugging Face · The Decoder · TechCrunch AI

Mistral releases Mistral Large 4 (Le Chonk) weights — 1T-parameter open multimodal model

Mistral released the weights for Mistral Large 4 (Le Chonk), a 1‑trillion‑parameter natively multimodal model, claiming leading open‑weight results on coding and defensive cybersecurity benchmarks and new three-mode reasoning options to trade off cost and performance. The company says the model was trained on European infrastructure, is fully open‑weight, shows gains on FrontierCode (19.7%) and artificial analysis indexes (coding 48%, cyber 51%), and achieves a 96.6% average refusal rate on malicious cyber prompts while supporting self-hosted deployment.

8.0

2026-10-25

COMPANIES · 1 SOURCE · InfoQ AI, ML & Data Engineering

Google open-sources ML Drift GPU engine for on-device AI inference

Google released ML Drift, an Apache-2.0 open-source, cross-platform GPU compute engine for on-device AI and ML inference that abstracts multiple low-level APIs (OpenGL ES, OpenCL, Metal, WebGPU). ML Drift powers LiteRT, adds unified shaders via tensor virtualization, extensible custom ops, 5D tensor support, and hardware-specific optimizations for Arm, Intel, and Qualcomm GPUs; Google says it replaces the legacy TensorFlow Lite GPU delegate and reports lower memory overhead and app-level latency improvements in Chrome, YouTube Shorts, Photos, Adobe apps, and Snapchat.

8.0

2026-10-16

MODELS · 1 SOURCE · AWS Machine Learning

Reflection releases Beam 1.0 — a 501B-parameter open-weight agentic coding model available on AWS

Reflection AI released Beam 1.0, an open-weight sparse mixture-of-experts model (501 billion total parameters, 23 billion active parameters, 1M token effective context) for agentic coding and long-horizon workflows. Beam 1.0 weights are published on Hugging Face under an Apache 2.0 license and the model is available via Amazon SageMaker JumpStart in US East (N. Virginia and Ohio) with deployment options including JumpStart real-time endpoints, SageMaker HyperPod Inference, and self-managed runtimes via SGLang or vLLM; checkpoints are offered in BF16, FP8, and NVFP4 formats.

8.0

2026-10-16

MODELS · 1 SOURCE · Hugging Face

Reflection releases Beam — 501B MoE open model with 1M-token context (Apache‑2.0)

Reflection published Beam, a 501B-parameter mixture-of-experts (MoE) language model on Hugging Face under the Apache‑2.0 license. Beam runs ~23B parameters per token, supports text input with a 1M-token context window, targets coding and agentic use cases, ships with a Rust performance harness and day‑0 support for transformers, vLLM and SGLang, and includes recipes for inference, SFT and RL.

8.0

2026-10-15

MODELS · 4 SOURCES · Hugging Face · NVIDIA Developer · The Decoder · TechCrunch AI

Meta releases Muse Spark Open — 816B-parameter open-weight multimodal MoE model

Meta published Muse Spark Open, an open-weight mixture-of-experts (MoE) model with ~816 billion parameters (≈42B active per token) that accepts text, images, audio, and video and supports up to a 1,048,576-token context window. Meta says the model is optimized for agentic coding workflows (reading, writing, debugging code and tool calls); checkpoints are available in BF16 (safetensors, ~1.5 TB) and an NVFP4 4-bit format tuned for NVIDIA Blackwell GPUs.

9.0

2026-09-24

MODELS · 1 SOURCE · Hugging Face

Liquid AI publishes DSpark drafter for LFM2.5-VL-3B, accelerating VLM decoding up to 3.13×

Liquid AI released a DSpark draft model for its vision‑language model LFM2.5‑VL‑3B that adds speculative decoding to speed up token decoding (up to 3.13× on-device, 2.66× on H100) while increasing model size by ~280M parameters (≈8.9%). The drafter ships with day‑one integrations for llama.cpp, MLX‑VLM and SGLang and is available on Hugging Face in Safetensors and GGUF formats; measured end‑to‑end gains ranged up to 2.62× on edge and 2.27× on GPU across MMSpec tasks.

7.0

2026-09-23

CODING · 1 SOURCE · NVIDIA Developer

SWE-Serve benchmark shows many patches that pass local tests fail live serving for SGLang

SWE-Serve is a new benchmark that turns 83 merged SGLang pull requests into 53 executable inference-serving tasks across six families; 19 tasks start a real server and validate patches through the full serving path. Across those live-serving tasks, the same patches pass 45.9% of the time with the complete verifier versus 69.4% when live-serving checks are excluded (roughly one in three otherwise-passing patches fail live checks); multi-domain tasks show a 21.3 percentage-point lower pass rate, and closed-book model pass@1 scores (11 models, mini-swe-agent) ranged from 34.6%–75.5% with Claude Opus 5 and GPT-5.6 Sol among top performers.

7.0

2026-03-16

MODELS · 1 SOURCE · Mistral AI

Mistral releases Small 4: 119B MoE multimodal model with 256k context (Apache 2.0)

Mistral announced Mistral Small 4, a 119B-parameter hybrid Mixture-of-Experts model (128 experts, 4 active) that accepts text and image inputs, offers a 256k context window, and includes a configurable reasoning_effort parameter; it is released under the Apache 2.0 license. The company says Small 4 unifies capabilities from its Magistral, Pixtral, and Devstral lines, targets chat, coding/agentic, and complex-reasoning use cases, claims substantial latency and throughput gains versus Mistral Small 3, and is available across vLLM, llama.cpp, SGLang, Transformers and other runtimes.

9.0