ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIAKit SDK - Windows (PB25h1)NVIDIAKit SDK - Linux (PB25h1)NVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA
NVIDIA
vLLM
Container
NVIDIA
NVIDIA
vLLM

vLLM is a fast and easy-to-use library for LLM inference and serving. The NVIDIA vLLM NGC Container is optimized for GPU acceleration, and contains a validated set of libraries that enable and optimize GPU performance.

LayerLabelCreated
371a24d2f094a59bb3fa0bad24fef2c56f756d79e63cb420668a5ceabff99996CONFIG
Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /workspace
12/17/2025 10:58 AM UTC
da4bf176ac43fc0cc45ae4bc35b9814fc9cd305eb702475d53a79307a5f605ecARG
NVIDIA_BUILD_REF=dc105f7a88c555a325097f3b47b365d716e97455
12/17/2025 10:58 AM UTC
7b620379402a724ab1b1db283b50e1102d78923c34d20cd2a32aa4c092f0b2b4LABEL
com.nvidia.build.id=245720121
12/17/2025 10:58 AM UTC
0d6651859e43985ddcd8f79b15ce58c23aadd830178a0ed732cdad1b33c918c0ENV
NVIDIA_BUILD_ID=245720121
12/17/2025 10:58 AM UTC
58bb0e4a8feca1453e89c14e25e5f53e95877413b239a9d9cd48d44ff79aefecARG
NVIDIA_BUILD_ID=245720121
12/17/2025 10:58 AM UTC
2618613c7587d3588d9a218996020c765190a059ef2b46fa27cab774f44c411aENV
NVIDIA_VLLM_VERSION=25.12
12/17/2025 10:58 AM UTC
91c9f487027792742ff31fe16cef02cb575eaed0a2dd781f531164c90ef4f962ARG
NVIDIA_VLLM_VERSION=25.12
12/17/2025 10:58 AM UTC
82a06e5facbd28321d0ab06eb070d338b4260d4ab9a53633d47c468611c669a3LABEL
com.nvidia.vllm.version=0.11.1+9114fd76
12/17/2025 10:58 AM UTC
618f5e3ed70b696017589e880d9e30406e088bc1c3e2115315464a5fca00874dENV
PATH=/usr/local/lib/python3.12/dist-packages/torch_tensorrt/bin:/usr/local/cuda/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/mpi/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/local/ucx/bin:/opt/amazon/efa/bin:/opt/tensorrt/bin
12/17/2025 10:58 AM UTC
279fdad01853933884bd9ea92fa40b5c20972936882d4e629d8e9e525a5f1fb5ENV
NVIDIA_PRODUCT_NAME=vLLM
12/17/2025 10:58 AM UTC
...

NVIDIA uses cookies to improve your experience on our web site. We and our third-party partners also use cookies and other tools to collect and record information you provide as well as information about your interactions with our websites for performance improvement, analytics, and to assist in marketing efforts. By clicking "Accept All", you consent to our use of cookies and other tools as described in our Cookie Policy. You can manage your cookie settings by clicking on "Manage Settings." By continuing to use this site or by clicking one of the buttons below, you agree to our Terms of Service (which contains important waivers). Please see our Privacy Policy for more information on our privacy practices.