Skip to main content
NVIDIA
vLLM Model-Free NIM
Container
NVIDIA
vLLM Model-Free NIM

The vLLM Model-Free NIM is an inference container for running compatible customer-provided models with NVIDIA GPU acceleration.

LayerLabelCreated
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4CMD
08/27/2026 12:17 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENTRYPOINT
/opt/nim/start_server.sh
08/27/2026 12:17 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4USER
nvs:1000
08/27/2026 12:17 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
NIM_BACKEND_PORT=8001
08/27/2026 12:17 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
NIM_SERVER_PORT=8000
08/27/2026 12:17 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
SERVER_START_SCRIPT_PATH=/opt/nim/start_server.sh
08/27/2026 12:17 PM UTC
sha256:c2ab75ae6b589db43960b8720a6d8813a2399de5213a2bc67c4d5e7c101715bcRUN
BASE_IMAGE=nvcr.io/0886876425485018/brightdelta-real/china-vllm-basecontainer-stage2@sha256:0346cd78ad05bf47d2c9eb3a6a47c22217e3595ec65596578c2ec6376879a9eb BACKEND_TYPE=vllm NIM_STACK_COMMIT=6388d047b115683aac70b2d3c49bc3cfc3179c05 TELEMETRY_MODE=0 TELEMETRY_ENDPOINT=0 PIP_INDEX_URL=https://pypi.org/simple NIM_CACHE_PATH=/opt/nim/.cache /bin/bash -o pipefail -c chmod +x /opt/nim/start_server.sh /opt/nim/scripts/generate_nginx_config.sh &&
  chmod 0755 /opt/nim/scripts/runtime_cache_contract.sh &&
  bash -n /opt/nim/scripts/runtime_cache_contract.sh &&
  mkdir -p /opt/nim/.cache /opt/nim/nginx /opt/nim/generated_configs &&
  chown -R 1000.1000 /opt/nim &&
  install -d -o 1000 -g 1000 -m 0755 /opt/nim/.cache/tmp /opt/nim/.cache/huggingface/hub /opt/nim/runtime-cache "/opt/nim/runtime-cache/${BACKEND_TYPE}/cache" "/opt/nim/runtime-cache/${BACKEND_TYPE}/config" /opt/nim/runtime-cache/torchinductor /opt/nim/runtime-cache/triton &&
  chown 0:0 /opt/nim/LICENSE &&
  chmod 0444 /opt/nim/LICENSE &&
  grep -q "NVIDIA Software License Agreement" /opt/nim/LICENSE &&
  grep -q "Product-Specific Terms for NVIDIA AI Products" /opt/nim/LICENSE &&
  ! grep -q "NVIDIA AI Product Agreement" /opt/nim/LICENSE
08/27/2026 12:17 PM UTC
sha256:72c6e1f09d0893f28cdd3f7a2afcec3484f505c5589dcc1de0981569acc58fceCOPY
docker/start_server.sh /opt/nim/start_server.sh
08/27/2026 12:17 PM UTC
sha256:7d3c420ad756be575971b32a15bf51fe9b5ea74c0d91dd63c1f3249087d4d389COPY
docker/scripts/runtime_cache_contract.sh /opt/nim/scripts/runtime_cache_contract.sh
08/27/2026 12:17 PM UTC
sha256:0745e41570bf34dfd518ece51a1354a6d2ef675a3cf45d11dc31592d6fda6fcaCOPY
nginx /opt/nim/scripts
08/27/2026 12:17 PM UTC
...