ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIAKit SDK - Windows (PB25h1)NVIDIAKit SDK - Linux (PB25h1)NVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA
NVIDIA
Dynamo Tensorrt-LLM Runtime
Container
NVIDIA
NVIDIA
Dynamo Tensorrt-LLM Runtime

The Dynamo TensorRT-LLM runtime image is a containerized build of Dynamo + TensorRT-LLM which serves as the base runtime environment for tensorrt-llm based inference with Dynamo's distributed inference framework.

LayerLabelCreated
32c14f6fb38bebc4285f173aa6b64e38676f12fea12f8f346a8d2f31b2adef68CONFIG
Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /workspace
10/10/2025 8:53 PM UTC
0895c68013f695e9c520c00a39f43446df5f293fa6cfb831d4c417dafb0dab1aENTRYPOINT
/opt/nvidia/nvidia_entrypoint.sh
10/10/2025 8:53 PM UTC
9a4337311cbee38e1058c9b633bcfe2c201cbcc7cfa7f899a4248fafff68af37RUN
ARCH_ALT=x86_64 PYTHON_VERSION=3.12 PROM_VERSION=3.4.1 TORCH_VER=2.8.0a0+5228986c39.nv25.6 TORCHVISION_VER=0.22.0a0+95f10a4e SETUPTOOLS_VER=78.1.1 PYTORCH_TRITON_VER=3.3.0+git96316ce52.nvinternal JINJA2_VER=3.1.6 NETWORKX_VER=3.5 SYMPY_VER=1.14.0 PACKAGING_VER=23.2 FLASH_ATTN_VER=2.7.4.post1 MPMATH_VER=1.3.0 HAS_TRTLLM_CONTEXT=0 TENSORRTLLM_PIP_WHEEL=tensorrt-llm==1.1.0rc5 TENSORRTLLM_INDEX_URL=https://pypi.python.org/simple sed '/^#\s/d' /workspace/launch_message.txt > ~/.launch_screen &&
  echo "cat ~/.launch_screen" >> ~/.bashrc &&
  echo "source $VIRTUAL_ENV/bin/activate" >> ~/.bashrc
10/10/2025 8:53 PM UTC
d96c4df820587138138429174338379516853ecffec1dd1bb4cc9c4567fd25bfCOPY
ATTRIBUTION* LICENSE /workspace/
10/10/2025 8:53 PM UTC
3f584be7d021e111c7c8333059142396ebb2a8cc94d7694b60502bd6c8673181COPY
components/ /workspace/components/
10/10/2025 8:53 PM UTC
5b7fd79096d7aa9cfab53efec3350a5b6a672f781baceff529daec708bcdd8a8COPY
deploy /workspace/deploy
10/10/2025 8:53 PM UTC
b2a7f8f847e37d6760009313dd55cb0a98f320e1e9851cdc28956a490c0d3203COPY
benchmarks /workspace/benchmarks
10/10/2025 8:53 PM UTC
885361c5bc07fc1bc9b4378f4b820baf959cfba2126cfd26aaa5610d323f7aa5COPY
examples /workspace/examples
10/10/2025 8:53 PM UTC
7279cd3bf8d8c0da4953ba536189d2f137e2aba2576ff17e899e026e9e373500COPY
tests /workspace/tests
10/10/2025 8:53 PM UTC
85932b10eb51e0134e7c8a27494a0192fe0f09b9a9c2a2ae3a82bc9aa9b70ef1COPY
/usr/local/cuda/lib64/libcusparseLt* /usr/local/cuda/lib64/
10/10/2025 8:53 PM UTC
...

NVIDIA uses cookies to improve your experience on our web site. We and our third-party partners also use cookies and other tools to collect and record information you provide as well as information about your interactions with our websites for performance improvement, analytics, and to assist in marketing efforts. By clicking "Accept All", you consent to our use of cookies and other tools as described in our Cookie Policy. You can manage your cookie settings by clicking on "Manage Settings." By continuing to use this site or by clicking one of the buttons below, you agree to our Terms of Service (which contains important waivers). Please see our Privacy Policy for more information on our privacy practices.