ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIAKit SDK - Windows (PB25h1)NVIDIAKit SDK - Linux (PB25h1)NVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA
NVIDIA
Dynamo Tensorrt-LLM Runtime
Container
NVIDIA
NVIDIA
Dynamo Tensorrt-LLM Runtime

The Dynamo TensorRT-LLM runtime image is a containerized build of Dynamo + TensorRT-LLM which serves as the base runtime environment for tensorrt-llm based inference with Dynamo's distributed inference framework.

LayerLabelCreated
3fdd22b1f4b10e180b79624133bacd0a243e8f0cacb86ea75a1c1ff853762ab3CONFIG
Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /workspace; ExposedPorts 6006/tcp, 8888/tcp
11/10/2025 9:06 PM UTC
3def53cb844b14c3474a837c3a8d437694dc7759e56fe7631038b24a061e247cENTRYPOINT
/opt/nvidia/nvidia_entrypoint.sh
11/10/2025 9:06 PM UTC
e00f62ef5432544910e38add03958fc706036c27286375f9e7bc709b456d5db4ENV
TRTLLM_USE_UCX_KVCACHE=1
11/10/2025 9:06 PM UTC
dcd778fa478f32f5260c81535b4684978723925b8f08a4cf0bf8e4a5caf28347COPY
tests /workspace/tests
11/10/2025 9:06 PM UTC
818365295b14c5c85140d696974940bd9ca23683919eb6011ffb00e754c22186COPY
recipes /workspace/recipes
11/10/2025 9:06 PM UTC
1f8b484e01b09ee64176e4f2a20ca2b3968d5d73300c59d8cc9262e297003a17COPY
examples /workspace/examples
11/10/2025 9:06 PM UTC
5cfe3c22cc135140c79a8a74102acc231893e52e0a74d81f34cd92289296a76aCOPY
deploy /workspace/deploy
11/10/2025 9:06 PM UTC
69da244c1a7743d53526da31d36624bdeec18197701d155c24a2f15403bee19cCOPY
components /workspace/components
11/10/2025 9:06 PM UTC
bc9ddb476d6d64f1c29129d013204d81370d29ba98353c6db6d8c38047566831COPY
benchmarks /workspace/benchmarks
11/10/2025 9:06 PM UTC
0e0076e0a9939d89245cdb38f936e5e3a0dc0303a86331afe051575a6b8915e1COPY
ATTRIBUTION* LICENSE /workspace/
11/10/2025 9:06 PM UTC
...

NVIDIA uses cookies to improve your experience on our web site. We and our third-party partners also use cookies and other tools to collect and record information you provide as well as information about your interactions with our websites for performance improvement, analytics, and to assist in marketing efforts. By clicking "Accept All", you consent to our use of cookies and other tools as described in our Cookie Policy. You can manage your cookie settings by clicking on "Manage Settings." By continuing to use this site or by clicking one of the buttons below, you agree to our Terms of Service (which contains important waivers). Please see our Privacy Policy for more information on our privacy practices.