ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIAKit SDK - Windows (PB25h1)NVIDIAKit SDK - Linux (PB25h1)NVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA
NVIDIA
vLLM
Container
NVIDIA
NVIDIA
vLLM

vLLM is a fast and easy-to-use library for LLM inference and serving. The NVIDIA vLLM NGC Container is optimized for GPU acceleration, and contains a validated set of libraries that enable and optimize GPU performance.

LayerLabelCreated
0e4eada6356bc820cd428a3b2c32fe9c886559d63551a964ef1759300635dc4fCONFIG
Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /workspace
03/25/2026 12:56 PM UTC
3ec8db62e009d57a4d5fd97c0f483518c8adaa4d12d840fda6e51876f4434868ARG
NVIDIA_BUILD_REF=4d397af28ead0cbe1371859b81681b7004fe12c2
03/25/2026 12:56 PM UTC
711b80ef9c6ce6c7d5f9c843f437dc93da257d6a5cae7b4a51b42e464009e559LABEL
com.nvidia.build.id=287664876
03/25/2026 12:56 PM UTC
d5951b84b6d7ded9d4f32e487dedf556d619bf1042fe7a15677c6f2080819893ENV
NVIDIA_BUILD_ID=287664876
03/25/2026 12:56 PM UTC
d7a8d95284673353897cbb482d61f54561bebaee21ba8548862ae57b718c84cfARG
NVIDIA_BUILD_ID=287664876
03/25/2026 12:56 PM UTC
4a405d6d2cc1211397bb33e9e15c6f411639613c334232cde3635fb0cda61279ENV
NVIDIA_VLLM_VERSION=26.03
03/25/2026 12:56 PM UTC
440619739f35aca070980b379ce94cbb7d4e7bad4312e8bf84af502aaae4630eARG
NVIDIA_VLLM_VERSION=26.03
03/25/2026 12:56 PM UTC
7ea8a9c9a8b397b307da95d2e84f321f70c32f166b740e875c6a0b43b6c7bc7dLABEL
com.nvidia.vllm.version=0.17.1+a03ca76a
03/25/2026 12:56 PM UTC
cfc2628491a854781aee425da6b48108d5a8fbdbd9b17f36f13a577ef32bd76aENV
PATH=/usr/local/lib/python3.12/dist-packages/torch_tensorrt/bin:/usr/local/cuda/bin:/usr/local/nixlbench/bin:/usr/local/nixl/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/mpi/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/local/ucx/bin:/opt/amazon/efa/bin:/opt/tensorrt/bin
03/25/2026 12:56 PM UTC
69bf14f0b667e52c3f36567e571048d2a33d468096713a405b26af3ebdaf3a75ENV
NVIDIA_PRODUCT_NAME=vLLM
03/25/2026 12:56 PM UTC
...

NVIDIA uses cookies to improve your experience on our web site. We and our third-party partners also use cookies and other tools to collect and record information you provide as well as information about your interactions with our websites for performance improvement, analytics, and to assist in marketing efforts. By clicking "Accept All", you consent to our use of cookies and other tools as described in our Cookie Policy. You can manage your cookie settings by clicking on "Manage Settings." By continuing to use this site or by clicking one of the buttons below, you agree to our Terms of Service (which contains important waivers). Please see our Privacy Policy for more information on our privacy practices.