ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA
NVIDIA
NVIDIA MLPerf Inference
Container
NVIDIA
NVIDIA
NVIDIA MLPerf Inference

MLPerf Inference containers are base containers for people interested in NVIDIA's MLPerf Inference submission results

LayerLabelCreated
sha256:68831ca362c01151e7985bf1dbac97b5b656e7c8b060677b209991a7c32a1c30COPY
/mixtral-8x7b-instruct-v0.1-tp1pp1-fp4-e7.25.tar.gz /opt/fp4-quantized-modelopt/
02/22/2025 12:19 PM UTC
sha256:ad3256c78cf2d04e7286d51f12f956da2c71b2c57c48285ee0843e573d61a70dRUN
BUILD_CONTEXT=x86_64 CUDNN_VER=8.9.7.29 CUDA_VER=12.8 TRT_MAJOR_VER=10 TRT_VER=10.8.0.43 /bin/bash -c rm -rf /tmp/*
02/22/2025 12:13 PM UTC
sha256:07cf21985aa262e66f3a18de9b3970ac23c76fb1651c22598c84174084bc7d5bCOPY
NVIDIA_MLPerf_Evaluation_Licens[e] /
02/22/2025 12:13 PM UTC
sha256:5cca1d890169dbe22d1f8caead9edee88d03f08a84f23e368bc591462745d542RUN
BUILD_CONTEXT=x86_64 CUDNN_VER=8.9.7.29 CUDA_VER=12.8 TRT_MAJOR_VER=10 TRT_VER=10.8.0.43 /bin/bash -c rm -f /opt/nvidia/entrypoint.d/12-banner.sh /opt/nvidia/entrypoint.d/15-container-copyright.txt /opt/nvidia/entrypoint.d/30-container-license.txt /NGC-DL-CONTAINER-LICENSE
02/22/2025 12:13 PM UTC
sha256:72315e1de8ade220c12d23cdf2910f843c2d02efd37c359761bcf56cd3bfc0aaRUN
BUILD_CONTEXT=x86_64 CUDNN_VER=8.9.7.29 CUDA_VER=12.8 TRT_MAJOR_VER=10 TRT_VER=10.8.0.43 /bin/bash -c ln -sf /usr/bin/pip3 /usr/bin/pip
02/22/2025 12:13 PM UTC
sha256:082305f5aed49021cea972fe91244dd37cbe8df9879961c3ed41bd9c8f115f62RUN
BUILD_CONTEXT=x86_64 CUDNN_VER=8.9.7.29 CUDA_VER=12.8 TRT_MAJOR_VER=10 TRT_VER=10.8.0.43 /bin/bash -c ln -sf /usr/bin/python3 /usr/bin/python
02/22/2025 12:13 PM UTC
sha256:a0238769a05dbc487f814acd690d055eb72d0e0143748efbd364d8500bed7fb7RUN
BUILD_CONTEXT=x86_64 CUDNN_VER=8.9.7.29 CUDA_VER=12.8 TRT_MAJOR_VER=10 TRT_VER=10.8.0.43 /bin/bash -c ldconfig
02/22/2025 12:13 PM UTC
sha256:bba8bcfcf880f64c31b18652caa3d98bc983f92fdea0a079398dc7f97bf283d8COPY
wholegraph.tar.gz /opt/wholegraph.tar.gz
02/22/2025 12:13 PM UTC
sha256:99c7764056158efcceb9d8cc3e79e31ac23902c2dc2c6deca2ae815672f573f3RUN
BUILD_CONTEXT=x86_64 CUDNN_VER=8.9.7.29 CUDA_VER=12.8 TRT_MAJOR_VER=10 TRT_VER=10.8.0.43 /bin/bash -c if [ -f install_pip_deps.sh ]; then bash install_pip_deps.sh; fi
02/22/2025 12:13 PM UTC
sha256:cabc89366c4f1d6a85dc7ad0cf34a69c98701370141e6d5f5cd9b4a9e92c7ac9COPY
/install_pip_deps.sh .
02/22/2025 12:13 PM UTC
...

NVIDIA uses cookies to improve your experience on our web site. We and our third-party partners also use cookies and other tools to collect and record information you provide as well as information about your interactions with our websites for performance improvement, analytics, and to assist in marketing efforts. By clicking "Accept All", you consent to our use of cookies and other tools as described in our Cookie Policy. You can manage your cookie settings by clicking on "Manage Settings." By continuing to use this site or by clicking one of the buttons below, you agree to our Terms of Service (which contains important waivers). Please see our Privacy Policy for more information on our privacy practices.