ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA
NVIDIA
TensorRT Inference Server
Container
NVIDIA
NVIDIA
TensorRT Inference Server

TensorRT Inference Server provides a data center inference solution optimized for NVIDIA GPUs. It maximizes inference utilization and performance on GPUs via an HTTP or gRPC endpoint, allowing remote clients to request inference for any model that is being managed by the server, as well as providing real-time metrics on latency and requests.

LayerLabelCreated
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4LABEL
com.nvidia.build.ref=1744df0227aecb869d2c72f40491e5918fbb671d
12/03/2018 1:31 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
NVIDIA_BUILD_REF
12/03/2018 1:31 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4LABEL
com.nvidia.build.id=880120
12/03/2018 1:31 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
NVIDIA_BUILD_ID=880120
12/03/2018 1:31 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
NVIDIA_BUILD_ID
12/03/2018 1:31 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENTRYPOINT
/opt/tensorrtserver/nvidia_entrypoint.sh
12/03/2018 1:30 AM UTC
sha256:dba7cc6ff8a281029fe9e5f1b805fccc8bc2ca39c0ad4f24e3dfeab3bee3369eCOPY
file:efee072d36828f125fc5a39ae63dbaba3b9b4547bda7963a5be81c1a936b5661 in /opt/tensorrtserver
12/03/2018 1:30 AM UTC
sha256:1d51632eab59caf50d61513fead97290c69e566a7e368523a522381bdbf6dc56COPY
dir:388bccce91855f6f6bc73a9cae517a17b4dcacbc77fdb26e0752b0e43d9d3963 in lib
12/03/2018 1:30 AM UTC
sha256:6fc0436ccbd660ee319c0c631ed2a10e221e3d4eda4c9946d5ff1d766ca12c9cCOPY
file:623ccf26bc02327c8719a44afedc9b701284674a4dd7ae038e65f54b018fffa1 in bin/
12/03/2018 1:30 AM UTC
sha256:2acce43badd50d53f4b390a7e5d322d84d27e640f52574fcc42dd4d4c2916d4eCOPY
file:5e666f796155692be498d908c47ae8d144319cd37ff7987c2f8d8fb640ef2cd7 in LICENSE.pytorch
12/03/2018 1:30 AM UTC
...

NVIDIA uses cookies to improve your experience on our web site. We and our third-party partners also use cookies and other tools to collect and record information you provide as well as information about your interactions with our websites for performance improvement, analytics, and to assist in marketing efforts. By clicking "Accept All", you consent to our use of cookies and other tools as described in our Cookie Policy. You can manage your cookie settings by clicking on "Manage Settings." By continuing to use this site or by clicking one of the buttons below, you agree to our Terms of Service (which contains important waivers). Please see our Privacy Policy for more information on our privacy practices.