NVIDIA
NVIDIA
vLLM
Container
NVIDIA
NVIDIA
vLLM

vLLM is a fast and easy-to-use library for LLM inference and serving. The NVIDIA vLLM NGC Container is optimized for GPU acceleration, and contains a validated set of libraries that enable and optimize GPU performance.

LayerLabelCreated
6692ff3e558eddde6129254422d90afd0c13000cdf6f3c723a5d0d6ea895e10bCONFIG
Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /workspace
04/16/2026 10:00 AM UTC
92a51162a5ab5e8353d213178cb37ce379338f7e9eee501965308b749e8dd783ARG
NVIDIA_BUILD_REF=9f9e9d343209c1835a6da6f9919cc6065279d076
04/16/2026 10:00 AM UTC
17cc67c72f8851547fa3dd76e8b2f336731b1c0e8b54f38289c2e0ace36c78c3LABEL
com.nvidia.build.id=299333413
04/16/2026 10:00 AM UTC
5565daf1172526a37a97acc7ece21f96e995feb9f4de9150c949ecf1e42a2e71ENV
NVIDIA_BUILD_ID=299333413
04/16/2026 10:00 AM UTC
6d0378a1bc1a81e03da4051349d2c52d83436b0cb253beb55fafdb6fcc687813ARG
NVIDIA_BUILD_ID=299333413
04/16/2026 10:00 AM UTC
298b37d1c8bbcd5f1ae5be4a9dd382dfcf95daf2e79fd33ae9ea5585b481325fENV
NVIDIA_VLLM_VERSION=26.04
04/16/2026 10:00 AM UTC
00c95095629f590e856003024bb56d6e1ed37456858d66d0e980b160dabb32fcARG
NVIDIA_VLLM_VERSION=26.04
04/16/2026 10:00 AM UTC
abd9b8a40768bb81165426a8e30e0163084b35b4c9477cf1fba4b46f146d8d76LABEL
com.nvidia.vllm.version=0.19.0+6bc3197f
04/16/2026 10:00 AM UTC
8bf8479872a160e20a4240a8bb2376c544db0090593059884a4db52d33f26d84ENV
PATH=/usr/local/lib/python3.12/dist-packages/torch_tensorrt/bin:/usr/local/cuda/bin:/usr/local/nixlbench/bin:/usr/local/nixl/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/mpi/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/local/ucx/bin:/opt/amazon/efa/bin:/opt/tensorrt/bin
04/16/2026 10:00 AM UTC
979c150119cdd66775ff08236b6294eddce7958e710d0620ac66b1239df08808ENV
NVIDIA_PRODUCT_NAME=vLLM
04/16/2026 10:00 AM UTC
...

NVIDIA uses cookies to improve your experience on our web site. We and our third-party partners also use cookies and other tools to collect and record information you provide as well as information about your interactions with our websites for performance improvement, analytics, and to assist in marketing efforts. By clicking "Accept All", you consent to our use of cookies and other tools as described in our Cookie Policy. You can manage your cookie settings by clicking on "Manage Settings." By continuing to use this site or by clicking one of the buttons below, you agree to our Terms of Service (which contains important waivers). Please see our Privacy Policy for more information on our privacy practices.