ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA
NVIDIA
Dynamo Tensorrt-LLM Runtime
Container
NVIDIA
NVIDIA
Dynamo Tensorrt-LLM Runtime

The Dynamo TensorRT-LLM runtime image is a containerized build of Dynamo + TensorRT-LLM which serves as the base runtime environment for tensorrt-llm based inference with Dynamo's distributed inference framework.

LayerLabelCreated
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4CMD
—
09/17/2025 8:58 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENTRYPOINT
/opt/nvidia/nvidia_entrypoint.sh
09/17/2025 8:58 PM UTC
sha256:5dc91f82d726d8f0d54f5e8b291b60c1477d1830f9b83197bb3c83f933d5fbd4RUN
ARCH_ALT=x86_64 TORCH_VER=2.8.0a0+5228986c39.nv25.6 TORCHVISION_VER=0.22.0a0+95f10a4e SETUPTOOLS_VER=78.1.1 PYTORCH_TRITON_VER=3.3.0+git96316ce52.nvinternal JINJA2_VER=3.1.6 NETWORKX_VER=3.5 SYMPY_VER=1.14.0 PACKAGING_VER=23.2 FLASH_ATTN_VER=2.7.4.post1 MPMATH_VER=1.3.0 HAS_TRTLLM_CONTEXT=0 TENSORRTLLM_PIP_WHEEL=tensorrt_llm==1.0.0rc6 TENSORRTLLM_INDEX_URL=https://pypi.python.org/simple sed '/^#\s/d' /workspace/launch_message.txt > ~/.launch_screen &&
  echo "cat ~/.launch_screen" >> ~/.bashrc
09/17/2025 8:58 PM UTC
sha256:03477b23d7183f8248ad18d71b4727b7fea9e19ee368e6c5edbc437e3b70a449COPY
ATTRIBUTION* LICENSE /workspace/
09/17/2025 8:58 PM UTC
sha256:4454adfb57413b5da210b1048dbb8328f31d75a41f28731be1a95c0e59f8abf6RUN
ARCH_ALT=x86_64 TORCH_VER=2.8.0a0+5228986c39.nv25.6 TORCHVISION_VER=0.22.0a0+95f10a4e SETUPTOOLS_VER=78.1.1 PYTORCH_TRITON_VER=3.3.0+git96316ce52.nvinternal JINJA2_VER=3.1.6 NETWORKX_VER=3.5 SYMPY_VER=1.14.0 PACKAGING_VER=23.2 FLASH_ATTN_VER=2.7.4.post1 MPMATH_VER=1.3.0 HAS_TRTLLM_CONTEXT=0 TENSORRTLLM_PIP_WHEEL=tensorrt_llm==1.0.0rc6 TENSORRTLLM_INDEX_URL=https://pypi.python.org/simple python3 -m pip install --no-cache-dir --break-system-packages /workspace/benchmarks
09/17/2025 8:58 PM UTC
sha256:85762c96f31f78fbb7ee2fd208eee9e4a5345db80a221da925e64da40b5506f5COPY
components/backends/trtllm /workspace/components/backends/trtllm
09/17/2025 8:58 PM UTC
sha256:565b5334bb55a6aeb92c7996e48dcbafa5464a702b5dfebd68245027181049a4COPY
deploy /workspace/deploy
09/17/2025 8:58 PM UTC
sha256:b41e43e5be47cfcf7a6809724f2a4db05ce7992ca783dd1893f46e2c2f618d8aCOPY
benchmarks /workspace/benchmarks
09/17/2025 8:58 PM UTC
sha256:24c718927c00edc03cd232f76d8f61dce9de7ef5067b1543633b9437a7e05b4eCOPY
tests /workspace/tests
09/17/2025 8:58 PM UTC
sha256:00d54a24ab8e6171f88634a8feee2f1a97cc43401d6be63b1e15bbb5ffdb6b4dCOPY
/usr/local/lib/python3.12/dist-packages/pytorch_triton-3.3.0+git96316ce52.nvinternal.dist-info /usr/local/lib/python3.12/dist-packages/pytorch_triton-3.3.0+git96316ce52.nvinternal.dist-info
09/17/2025 8:58 PM UTC
...

NVIDIA uses cookies to improve your experience on our web site. We and our third-party partners also use cookies and other tools to collect and record information you provide as well as information about your interactions with our websites for performance improvement, analytics, and to assist in marketing efforts. By clicking "Accept All", you consent to our use of cookies and other tools as described in our Cookie Policy. You can manage your cookie settings by clicking on "Manage Settings." By continuing to use this site or by clicking one of the buttons below, you agree to our Terms of Service (which contains important waivers). Please see our Privacy Policy for more information on our privacy practices.