NVIDIA
NVIDIA
vLLM
Container
NVIDIA
NVIDIA
vLLM

vLLM is a fast and easy-to-use library for LLM inference and serving. The NVIDIA vLLM NGC Container is optimized for GPU acceleration, and contains a validated set of libraries that enable and optimize GPU performance.

LayerLabelCreated
68ac727fa866b0984d2d5a2b7cb64ce271650f239a2c46ddea3fb90129c5bcb8CONFIG
Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /workspace
02/20/2026 10:07 AM UTC
a2ee5d9edbda0c51d5ed7ea80d939861814247fbecab0c456b2fe80d116f2369ARG
NVIDIA_BUILD_REF=db7600950a476c031b123f25536f8f1d7bcb992b
02/20/2026 10:07 AM UTC
ab8aa355f1bd467648e15c0b568d123cd5a77c270b3c0f77f0c7bfe251899598LABEL
com.nvidia.build.id=270699520
02/20/2026 10:07 AM UTC
f00623f542ca395b4104f03fec3568371325ba4f1f531e7810e16592f49a4c10ENV
NVIDIA_BUILD_ID=270699520
02/20/2026 10:07 AM UTC
8c28b9eb0e1f4a8e091e0698808f687c6148a5186c69f58bd934a4f032d3de96ARG
NVIDIA_BUILD_ID=270699520
02/20/2026 10:07 AM UTC
e89baada1d01084afa658f785edd7100598a1b52c8d910715c2f9ca31fdb6411ENV
NVIDIA_VLLM_VERSION=26.02
02/20/2026 10:07 AM UTC
16370c0bf845c93910471ae310df17e6a447543396100b6c137a3a344553b4b5ARG
NVIDIA_VLLM_VERSION=26.02
02/20/2026 10:07 AM UTC
3ab3aade095e1b380f9545258ba6fe8c71a0101b240bdd087e04f2dde6aaaa42LABEL
com.nvidia.vllm.version=0.15.1+befbc472
02/20/2026 10:07 AM UTC
e75fd3e9f3fbb8759405c36756690a0881c1058a2a032abbb68044c425349d64ENV
PATH=/usr/local/lib/python3.12/dist-packages/torch_tensorrt/bin:/usr/local/cuda/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/mpi/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/local/ucx/bin:/opt/amazon/efa/bin:/opt/tensorrt/bin
02/20/2026 10:07 AM UTC
c07d5ec2fe6620999387aa1292503bfae66b5604096d7ecf19b38485abf1b87cENV
NVIDIA_PRODUCT_NAME=vLLM
02/20/2026 10:07 AM UTC
...

NVIDIA uses cookies to improve your experience on our web site. We and our third-party partners also use cookies and other tools to collect and record information you provide as well as information about your interactions with our websites for performance improvement, analytics, and to assist in marketing efforts. By clicking "Accept All", you consent to our use of cookies and other tools as described in our Cookie Policy. You can manage your cookie settings by clicking on "Manage Settings." By continuing to use this site or by clicking one of the buttons below, you agree to our Terms of Service (which contains important waivers). Please see our Privacy Policy for more information on our privacy practices.