chore(deps): bump sglang[all] from 0.4.6.post4 to 0.4.9.post4

[dependabot]

Bumps sglang[all] from 0.4.6.post4 to 0.4.9.post4.

Release notes

Sourced from sglang[all]'s releases.

Release v0.4.8

Highlights

OpenAI-Compatible Server Refactor

Re-structured the OpenAI-compatible server to support production and enterprise environments. Key improvements include:

• Consistent metrics and logging for better observability and debugging.

• Unified error handling, request validation, and processing logic for improved reliability and maintainability.

• Improved request tracking across sessions and components.

• Fixed bugs in embedding requests and reasoning parsers.

This work was a collaborative effort involving engineers from academic and industry institutions. Special thanks to the Oracle Cloud team and the SGLang team and community — including @​slin1237, @​CatherineSue, @​key4ng, @​JustinTong0323, @​jhinpan, @​yhyang201, @​woodx9 and @​whybeyoung — for their invaluable contributions.

DeepSeek R1 FP4 on Blackwell GPU

Added support for DeepSeek R1 with FP4 and MTP on NVIDIA Blackwell GPU.

• Integrated FlashInfer NVFP4 MoE, supporting TP, EP, and DP.

• Supported 2-stream shared expert execution.

• Achieved up to 90 TPS per user at isl/osl/bs = 1k/1k/16 on B200.

Further optimization in progress. Special thanks to the FlashInfer, NVIDIA Enterprise Products, Novita AI, DataCrunch, Google Cloud, and SGLang teams — especially @​Alcanderian and @​pyc96 — for their critical contributions.

Breaking Change: OpenAI-Compatible API Module Moved

The sglang/srt/openai_api directory has been removed and replaced with sglang/srt/entrypoints/openai.

Update your imports to the new module path. For example:

- from sglang.srt.openai_api.protocol import Tool
+ from sglang.srt.entrypoints.openai.protocol import Tool

What's Changed

• Update README.md by @​merrymercy in sgl-project/sglang#7040
• [Docker] Upgrading base image from 24.04 to 24.12 by @​Swipe4057 in sgl-project/sglang#7043
• fix 24.12 docker by @​zhyncs in sgl-project/sglang#7045
• Minor cleanup of fa3 backend by @​merrymercy in sgl-project/sglang#6999
• Fix eagle on AMD by @​merrymercy in sgl-project/sglang#7051
• Clean up server_args.py by @​merrymercy in sgl-project/sglang#7037
• Minor style fix in cuda_graph_runner.py by @​merrymercy in sgl-project/sglang#7053
• [WA] fix output data is nan in CI test "test_moe_eval_accuracy_large.py" by @​kkHuang-amd in sgl-project/sglang#7021
• [fix] libmlx5.so already in base image by @​HanHan009527 in sgl-project/sglang#7060

... (truncated)

Commits

• 2272c2a chore: bump v0.4.9.post4 (#8305)
• 3ec0b21 [CI] Fix flaky threshold (#8370)
• 58c468f Fix FP4 MoE accuracy from missing routed_scaling_factor (#8333)
• f8ca236 fix: kimi k2 xgrammar crash (#8367)
• d8ee156 [Feat] Add reasoning parser for Qwen/Qwen3-235B-A22B-Thinking-2507 (#8363)
• 7181ec8 fix: upgrade nccl version (#8359)
• ed2e313 Clean up server_args, triton cache manager (#8332)
• f8260f2 [Bugfix][Feat] Add XML-ish grammar in EBNFComposer and fix misc bugs in Qwen3...
• 12cb760 Add H20-3e fused MoE kernel tuning configs for Qwen3-Coder-480B-A35B-Instruct...
• 1b9cea5 [P/D] Support ipv6 in P/D scenario (#7858)
• Additional commits viewable in compare view

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.

---

Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR:

• @dependabot rebase will rebase this PR
• @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
• @dependabot merge will merge this PR after your CI passes on it
• @dependabot squash and merge will squash and merge this PR after your CI passes on it
• @dependabot cancel merge will cancel a previously requested merge and block automerging
• @dependabot reopen will reopen this PR if it is closed
• @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
• @dependabot show <dependency name> ignore conditions will show all of the ignore conditions of the specified dependency
• @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
• @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
• @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)

[dependabot]

Superseded by #10.