ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA
NVIDIA
SGLang
Container
NVIDIA
NVIDIA
SGLang

SGLang is a fast serving framework for large language models and vision language models. The NVIDIA SGLang NGC Container is optimized for GPU acceleration, and contains a validated set of libraries that enable and optimize GPU performance.

LayerLabelCreated
ce14fd23706fb84629c43c2213730b2739c56876a81e46a6861972f0b5040da4CONFIG
Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /workspace; ExposedPorts 6006/tcp, 8888/tcp
10/24/2025 11:24 PM UTC
5ea5cfe39afb6c63725ed258357820a22fa3fa0bc371a041044fae34c2e1bbd4ARG
NVIDIA_BUILD_REF=e9664def266e3db7826eac06f5632bd10d1f24a2
10/24/2025 11:24 PM UTC
5c6d0e6b1d64acfd715443149c38e4588d3d82d103b112f8dbd3eb7ac4c218cdLABEL
com.nvidia.build.id=225072021
10/24/2025 11:24 PM UTC
6c7cce117c21c23d5a69287b8c2e9957e2bf650f95ce2ea6ea62134f2fe121b4ENV
NVIDIA_BUILD_ID=225072021
10/24/2025 11:24 PM UTC
e544a969846a3603e4ae6c7f50de32208678405ce9b8f93228b7468ea306c99cARG
NVIDIA_BUILD_ID=225072021
10/24/2025 11:24 PM UTC
2be4a097cca0a713b14c7ccd98c9c1b4391e992c3716f79db381049a9457db76ENV
NVIDIA_SGLANG_VERSION=25.10
10/24/2025 11:24 PM UTC
3094a75774b2068f33f4564a0acff868c388eca10c26283fcb4a47e22bc7176dARG
NVIDIA_SGLANG_VERSION=25.10
10/24/2025 11:24 PM UTC
378b8c2ab3e268a0b5b99df087a3b1b6465541606bf00742530a205b863a4138LABEL
com.nvidia.sglang.version=0.5.3rc1+779d6808
10/24/2025 11:24 PM UTC
69c58fb406d893f1f1695fe910b7f4c310c6964c2aad3e440490e3b5c0bfed8bENV
NVIDIA_PRODUCT_NAME=SGLang
10/24/2025 11:24 PM UTC
4c1b9593bc3e0c46921656c185beafc161a73524f180fb92f96c352cdce0507cENV
SGLANG_FLASH_ATTN_SRC_DIR=/opt/sglang/flash-attention/
10/24/2025 11:24 PM UTC
...

NVIDIA uses cookies to improve your experience on our web site. We and our third-party partners also use cookies and other tools to collect and record information you provide as well as information about your interactions with our websites for performance improvement, analytics, and to assist in marketing efforts. By clicking "Accept All", you consent to our use of cookies and other tools as described in our Cookie Policy. You can manage your cookie settings by clicking on "Manage Settings." By continuing to use this site or by clicking one of the buttons below, you agree to our Terms of Service (which contains important waivers). Please see our Privacy Policy for more information on our privacy practices.