ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA
NVIDIA
vLLM
Container
NVIDIA
NVIDIA
vLLM

vLLM is a fast and easy-to-use library for LLM inference and serving. The NVIDIA vLLM NGC Container is optimized for GPU acceleration, and contains a validated set of libraries that enable and optimize GPU performance.

LayerLabelCreated
b26d3e596b0d38903f6c59410ee1515a3394d73352f3b8f4375a09122ee48cf5CONFIG
Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /workspace
06/17/2026 10:55 AM UTC
9c4d9ccab895ded09b217ab8eadb469b56127ff8fbba23850149e091023c462bARG
NVIDIA_BUILD_REF=f767edf48d8b50efef480c8bf10d65a40e686f6c
06/17/2026 10:55 AM UTC
cf35e668ad5c9e3c9c8d9aa5b80403c87c865af926c583c56901e50b9ff68ee4LABEL
com.nvidia.build.id=343129265
06/17/2026 10:55 AM UTC
a94e0587841b13806d9e775703ae887d6ced3b10dc33d5c25985cd58c28066a3ENV
NVIDIA_BUILD_ID=343129265
06/17/2026 10:55 AM UTC
78de37585ae2517c24dd8d7e466ccc40a9058fc0f97f0e88f4aa9459ab0ad549ARG
NVIDIA_BUILD_ID=343129265
06/17/2026 10:55 AM UTC
07a84cff0a96645f49c3b473b1daa63d2e84b3d88d3de616f13f053b0e1d9103ENV
NVIDIA_VLLM_VERSION=26.06
06/17/2026 10:55 AM UTC
c6bc3635da3317ef94c7c4f395d555b181ce9bfd554a2b60b3678ff3e4b16e16ARG
NVIDIA_VLLM_VERSION=26.06
06/17/2026 10:55 AM UTC
e55382efdb6ffab981be030188625c1c1c79096353a1420a04c4a35174f2a05bLABEL
com.nvidia.vllm.version=0.22.1+7b9cb5b7
06/17/2026 10:55 AM UTC
15a296033a800f4539f06deb76b0c81f0b2bbd3207a9fb3a0b5c8b8d411c4b9fENV
PATH=/opt/ffmpeg-safe/bin:/usr/local/lib/python3.12/dist-packages/torch_tensorrt/bin:/usr/local/cuda/bin:/usr/local/nixlbench/bin:/usr/local/nixl/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/mpi/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/local/ucx/bin:/opt/amazon/efa/bin:/opt/tensorrt/bin
06/17/2026 10:55 AM UTC
cd6d1d4e9b77bc030bcf9a681238dde4357212344b82ceaef2c3bcd7addb81adENV
NVIDIA_PRODUCT_NAME=vLLM
06/17/2026 10:55 AM UTC
...

NVIDIA uses cookies to improve your experience on our web site. We and our third-party partners also use cookies and other tools to collect and record information you provide as well as information about your interactions with our websites for performance improvement, analytics, and to assist in marketing efforts. By clicking "Accept All", you consent to our use of cookies and other tools as described in our Cookie Policy. You can manage your cookie settings by clicking on "Manage Settings." By continuing to use this site or by clicking one of the buttons below, you agree to our Terms of Service (which contains important waivers). Please see our Privacy Policy for more information on our privacy practices.