ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA
NVIDIA
TensorRT Inference Server
Container
NVIDIA
NVIDIA
TensorRT Inference Server

TensorRT Inference Server provides a data center inference solution optimized for NVIDIA GPUs. It maximizes inference utilization and performance on GPUs via an HTTP or gRPC endpoint, allowing remote clients to request inference for any model that is being managed by the server, as well as providing real-time metrics on latency and requests.

LayerLabelCreated
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4LABEL
com.nvidia.build.ref=d0097f89f55b6d2d7b78049f1406fae33a3e03e0
02/23/2019 2:19 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
NVIDIA_BUILD_REF
02/23/2019 2:19 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4LABEL
com.nvidia.build.id=5627847
02/23/2019 2:19 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
NVIDIA_BUILD_ID=5627847
02/23/2019 2:19 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
NVIDIA_BUILD_ID
02/23/2019 2:19 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENTRYPOINT
/opt/tensorrtserver/nvidia_entrypoint.sh
02/23/2019 2:19 AM UTC
sha256:099b966a50a3da320c49fef49ee1dbe41ae41260e0edd538c837a71223a4ef57COPY
file:1fef0434a6e1f4e057fb67ece24df4e0268defd1c849b62f4050ec1a5973565f in /opt/tensorrtserver
02/23/2019 2:19 AM UTC
sha256:4d8cadb3a6aa6a2e302a39268ba1777af01ba27eb6b320de1879be65bdb10625COPY
dir:34d2d19d0e0af5121a6e9765d2e8e0d79dd6ea353b73f233ec4d8b0966cdc4d8 in lib
02/23/2019 2:19 AM UTC
sha256:28ab70d0aa5330d88c1af03517a39984f9df5680c0b2256cdf9b87ea7324b454COPY
file:2016b629376c0fecb2725d8c4dcb68d12a25bd593ee60ace53d852430caa2d98 in bin/
02/23/2019 2:19 AM UTC
sha256:92b53f2acd9f48aa727cb8b868ec15fd81914ce24e52e1c16b2da17a3dcdf849COPY
file:5e666f796155692be498d908c47ae8d144319cd37ff7987c2f8d8fb640ef2cd7 in LICENSE.pytorch
02/20/2019 7:30 AM UTC
...

NVIDIA uses cookies to improve your experience on our web site. We and our third-party partners also use cookies and other tools to collect and record information you provide as well as information about your interactions with our websites for performance improvement, analytics, and to assist in marketing efforts. By clicking "Accept All", you consent to our use of cookies and other tools as described in our Cookie Policy. You can manage your cookie settings by clicking on "Manage Settings." By continuing to use this site or by clicking one of the buttons below, you agree to our Terms of Service (which contains important waivers). Please see our Privacy Policy for more information on our privacy practices.