Deepseek open-sources DeepInfer inference engine used by V4.1-Flash
Deepseek has released DeepInfer, its internal inference framework, under the Apache License 2.0. DeepInfer — which builds on vLLM with optimized compute kernels, distributed multi-chip processing, and faster text-generation techniques — powers the company's V4.1-Flash model; Deepseek also published deepseek-recipe to replicate its API token processing and plans to open-source code for future models.