ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA
NVIDIA
Dynamo Tensorrt-LLM Runtime
Container
NVIDIA
NVIDIA
Dynamo Tensorrt-LLM Runtime

The Dynamo TensorRT-LLM runtime image is a containerized build of Dynamo + TensorRT-LLM which serves as the base runtime environment for tensorrt-llm based inference with Dynamo's distributed inference framework.

LayerLabelCreated
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4CMD
—
11/10/2025 9:06 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENTRYPOINT
/opt/nvidia/nvidia_entrypoint.sh
11/10/2025 9:06 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
TRTLLM_USE_UCX_KVCACHE=1
11/10/2025 9:06 PM UTC
sha256:66cf5057fbce38dc0123db2e7c4da171a7e66143c7c4027a2071b5dfbd51b7b4COPY
tests /workspace/tests
11/10/2025 9:06 PM UTC
sha256:9976e6e659953c3370abca0ba64cd66846af3e5de8afcd3d44072fe557a084eeCOPY
recipes /workspace/recipes
11/10/2025 9:06 PM UTC
sha256:26d2e99bc5b874b1bfd4f5211fe7e50a219f0550e17d566a2bf70b60be9bd880COPY
examples /workspace/examples
11/10/2025 9:06 PM UTC
sha256:70738caafcab69575937fb14345731377b0b2dbd3ae8b2d21046acf1ac3981c4COPY
deploy /workspace/deploy
11/10/2025 9:06 PM UTC
sha256:a0bceedbf22ef90cd92035a1af93a5ec46ac664decd3bc6bd779eb109d0037cbCOPY
components /workspace/components
11/10/2025 9:06 PM UTC
sha256:929977c3f1ef5d689abc7b7ba735b4028df90d56cf202c804a701d483a915aaeCOPY
benchmarks /workspace/benchmarks
11/10/2025 9:06 PM UTC
sha256:b09e0b8bf9d18b941db05edc7d72e308c6df0d7d922b4fcf3d5dc251b01f4ba2COPY
ATTRIBUTION* LICENSE /workspace/
11/10/2025 9:06 PM UTC
...