ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA
NVIDIA
Dynamo Tensorrt-LLM Runtime
Container
NVIDIA
NVIDIA
Dynamo Tensorrt-LLM Runtime

The Dynamo TensorRT-LLM runtime image is a containerized build of Dynamo + TensorRT-LLM which serves as the base runtime environment for tensorrt-llm based inference with Dynamo's distributed inference framework.

LayerLabelCreated
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4CMD
—
10/10/2025 8:53 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENTRYPOINT
/opt/nvidia/nvidia_entrypoint.sh
10/10/2025 8:53 PM UTC
sha256:2ebdad9c41561154f0dceb6860e37b6d79d435a2222dfd510a58d221ec2b5300RUN
ARCH_ALT=x86_64 PYTHON_VERSION=3.12 PROM_VERSION=3.4.1 TORCH_VER=2.8.0a0+5228986c39.nv25.6 TORCHVISION_VER=0.22.0a0+95f10a4e SETUPTOOLS_VER=78.1.1 PYTORCH_TRITON_VER=3.3.0+git96316ce52.nvinternal JINJA2_VER=3.1.6 NETWORKX_VER=3.5 SYMPY_VER=1.14.0 PACKAGING_VER=23.2 FLASH_ATTN_VER=2.7.4.post1 MPMATH_VER=1.3.0 HAS_TRTLLM_CONTEXT=0 TENSORRTLLM_PIP_WHEEL=tensorrt-llm==1.1.0rc5 TENSORRTLLM_INDEX_URL=https://pypi.python.org/simple sed '/^#\s/d' /workspace/launch_message.txt > ~/.launch_screen &&
  echo "cat ~/.launch_screen" >> ~/.bashrc &&
  echo "source $VIRTUAL_ENV/bin/activate" >> ~/.bashrc
10/10/2025 8:53 PM UTC
sha256:3552eb760bfe73175fe053c88684f1a651c5e73d57e48d948248d31fdd9227feCOPY
ATTRIBUTION* LICENSE /workspace/
10/10/2025 8:53 PM UTC
sha256:8c0c89eb3cb1d586d4cfd8b4474a3013bb056bed38dac9da7f303f79ac62fe3dCOPY
components/ /workspace/components/
10/10/2025 8:53 PM UTC
sha256:6cefed3739cf6190ee792a60947f9f5b0376be671f1c256c5602b2da7b8a919dCOPY
deploy /workspace/deploy
10/10/2025 8:53 PM UTC
sha256:8775c75af27b593ea9ecd7ef959a1d9801f3ffed5f56d37c61b8298363c03f58COPY
benchmarks /workspace/benchmarks
10/10/2025 8:53 PM UTC
sha256:4bd9614d82629dbd7ab2d4a8420f136c799f405e7966a063fd6d086da35b3179COPY
examples /workspace/examples
10/10/2025 8:53 PM UTC
sha256:7cce76be2c2e0ac3caccf2787c9f18e56415a188b0a06e4b898aff0510a66456COPY
tests /workspace/tests
10/10/2025 8:53 PM UTC
sha256:8b38e52072f27c9debec07e27972770b1ec81a88947a9aaaab3fa9d2bf2ee85cCOPY
/usr/local/cuda/lib64/libcusparseLt* /usr/local/cuda/lib64/
10/10/2025 8:53 PM UTC
...