ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA
NVIDIA
Dynamo Tensorrt-LLM Runtime
Container
NVIDIA
NVIDIA
Dynamo Tensorrt-LLM Runtime

The Dynamo TensorRT-LLM runtime image is a containerized build of Dynamo + TensorRT-LLM which serves as the base runtime environment for tensorrt-llm based inference with Dynamo's distributed inference framework.

LayerLabelCreated
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4CMD
—
11/06/2025 6:26 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENTRYPOINT
/opt/nvidia/nvidia_entrypoint.sh
11/06/2025 6:26 PM UTC
sha256:97895bafd0bef314cb6b73fa422c4611f19c288bd33eafa19dad123c69bfb4dcRUN
ARCH_ALT=x86_64 PYTHON_VERSION=3.12 TORCH_VER=2.8.0a0+5228986c39.nv25.6 TORCHVISION_VER=0.22.0a0+95f10a4e SETUPTOOLS_VER=78.1.1 PYTORCH_TRITON_VER=3.3.0+git96316ce52.nvinternal JINJA2_VER=3.1.6 NETWORKX_VER=3.5 SYMPY_VER=1.14.0 PACKAGING_VER=23.2 FLASH_ATTN_VER=2.7.4.post1 MPMATH_VER=1.3.0 HAS_TRTLLM_CONTEXT=0 TENSORRTLLM_PIP_WHEEL=tensorrt-llm==1.1.0rc5 TENSORRTLLM_INDEX_URL=https://pypi.python.org/simple sed '/^#\s/d' /workspace/launch_message.txt > ~/.launch_screen &&
  echo "cat ~/.launch_screen" >> ~/.bashrc &&
  echo "source $VIRTUAL_ENV/bin/activate" >> ~/.bashrc
11/06/2025 6:26 PM UTC
sha256:83ea660dabf4ece553b9482f5950c27ca9f3e8d40ae6ece66f69f073b00b852dCOPY
ATTRIBUTION* LICENSE /workspace/
11/06/2025 6:26 PM UTC
sha256:3dd460ed11cc5293b0eacfbec083003d96844528e0a947acbaa82e9bec90602aCOPY
recipes/ /workspace/recipes/
11/06/2025 6:26 PM UTC
sha256:4bf72216b86c8dd9ec10afe839b0351d880c5b642c4c77bd1100e289e13e6c5cCOPY
components/ /workspace/components/
11/06/2025 6:26 PM UTC
sha256:df6c7eb0f4cf4689ac57056718579a9c04faf4eb47c92cb68963775b34623c4eCOPY
deploy /workspace/deploy
11/06/2025 6:26 PM UTC
sha256:8d2bf6b2450e803a40719bad15d11dd82d1cdbfe743265880ff6731fdaad683eCOPY
benchmarks /workspace/benchmarks
11/06/2025 6:26 PM UTC
sha256:5a44fa87085bca17bc88856a259fcbce1814c73c6355d7caed2ab566b624c235COPY
examples /workspace/examples
11/06/2025 6:26 PM UTC
sha256:461740212cd3dd7a98a058e61f3d3a84b73be453b658728ae11295acdc7b63c2COPY
tests /workspace/tests
11/06/2025 6:26 PM UTC
...

NVIDIA uses cookies to improve your experience on our web site. We and our third-party partners also use cookies and other tools to collect and record information you provide as well as information about your interactions with our websites for performance improvement, analytics, and to assist in marketing efforts. By clicking "Accept All", you consent to our use of cookies and other tools as described in our Cookie Policy. You can manage your cookie settings by clicking on "Manage Settings." By continuing to use this site or by clicking one of the buttons below, you agree to our Terms of Service (which contains important waivers). Please see our Privacy Policy for more information on our privacy practices.