sglang v0.5.21
sglang v0.5.21
摘要
# Highlights *779 PRs from 227 contributors.* ## New models | Model | Type | Cookbook | |---|---|---| | DeepSeek-V4.1 Flash | LLM / VLM | [link](https://docs.sglang.io/cookbook/autoregressive/DeepSeek/DeepSeek-V4_1) | | GigaChat 3.5 | LLM / VLM |
Highlights
779 PRs from 227 contributors.
New models
| Model | Type | Cookbook |
|---|---|---|
| DeepSeek-V4.1 Flash | LLM / VLM | link |
| GigaChat 3.5 | LLM / VLM | link |
| IQuest-Q1 | LLM / VLM | link |
| MiMo-V2.6 / MiMo-V2.6-Pro | LLM / VLM | link |
| Ling-3.0-flash-VL | LLM / VLM | link |
| DiffusionGemma | Diffusion | link |
| Qwen-Image 2.1 | Diffusion | link |
| Anima Base v1.0 | Diffusion | link |
| Ming-Image 0.1 Design / Design-Layer | Diffusion | link |
| FLUX 3 Action | Diffusion | link |
Key features
- PD instances can switch between prefill and decode on the fly, no restart needed (#28403).
- The prefix cache now runs on a Rust core by default (#39627).
- DeepSeek-V4.1 gets 22% faster first token on long prompts (#40352).
- Kimi K3 gets 20.6% higher prefill throughput in PD serving (#40045).
- More accurate results under PP, DP attention, and CP, with layer communication now handled by SGLang (guide, #41557).
- New Decisions API (
/v1/decisions) turns an LLM / VLM into a low-latency classifier and scorer (docs, #41208). - Score API (
/v1/score) scores all candidates in one request (#38965, #41188). - Run MiniMax-H3 with SGLang Diffusion inside ComfyUI (#35990).
To upgrade
uv pip install --prerelease=allow sglang==0.5.21
| Platform | Docker image |
|---|---|
| NVIDIA (CUDA 13) | lmsysorg/sglang:v0.5.21 |
| AMD MI35x | lmsysorg/sglang:v0.5.21-rocm10-mi35x |
| AMD MI30x | lmsysorg/sglang:v0.5.21-rocm10-mi30x |
| Intel GPU | lmsysorg/sglang:v0.5.21-xpu |
| Intel CPU | lmsysorg/sglang:v0.5.21-xeon |
Full Release Notes
[余略，详见 https://github.com/sgl-project/sglang/releases/tag/v0.5.21]
译自 GitHub · 版本发布 · 录于 二〇二六年十月二日