NVIDIA
NVIDIA MLPerf Inference
Container
NVIDIA
NVIDIA MLPerf Inference

MLPerf Inference containers are base containers for people interested in NVIDIA's MLPerf Inference submission results

  • LayerLabelCreated
    sha256:68831ca362c01151e7985bf1dbac97b5b656e7c8b060677b209991a7c32a1c30COPY
    /mixtral-8x7b-instruct-v0.1-tp1pp1-fp4-e7.25.tar.gz /opt/fp4-quantized-modelopt/
    02/22/2025 12:19 PM UTC
    sha256:ad3256c78cf2d04e7286d51f12f956da2c71b2c57c48285ee0843e573d61a70dRUN
    BUILD_CONTEXT=x86_64 CUDNN_VER=8.9.7.29 CUDA_VER=12.8 TRT_MAJOR_VER=10 TRT_VER=10.8.0.43 /bin/bash -c rm -rf /tmp/*
    02/22/2025 12:13 PM UTC
    sha256:07cf21985aa262e66f3a18de9b3970ac23c76fb1651c22598c84174084bc7d5bCOPY
    NVIDIA_MLPerf_Evaluation_Licens[e] /
    02/22/2025 12:13 PM UTC
    sha256:5cca1d890169dbe22d1f8caead9edee88d03f08a84f23e368bc591462745d542RUN
    BUILD_CONTEXT=x86_64 CUDNN_VER=8.9.7.29 CUDA_VER=12.8 TRT_MAJOR_VER=10 TRT_VER=10.8.0.43 /bin/bash -c rm -f /opt/nvidia/entrypoint.d/12-banner.sh /opt/nvidia/entrypoint.d/15-container-copyright.txt /opt/nvidia/entrypoint.d/30-container-license.txt /NGC-DL-CONTAINER-LICENSE
    02/22/2025 12:13 PM UTC
    sha256:72315e1de8ade220c12d23cdf2910f843c2d02efd37c359761bcf56cd3bfc0aaRUN
    BUILD_CONTEXT=x86_64 CUDNN_VER=8.9.7.29 CUDA_VER=12.8 TRT_MAJOR_VER=10 TRT_VER=10.8.0.43 /bin/bash -c ln -sf /usr/bin/pip3 /usr/bin/pip
    02/22/2025 12:13 PM UTC
    sha256:082305f5aed49021cea972fe91244dd37cbe8df9879961c3ed41bd9c8f115f62RUN
    BUILD_CONTEXT=x86_64 CUDNN_VER=8.9.7.29 CUDA_VER=12.8 TRT_MAJOR_VER=10 TRT_VER=10.8.0.43 /bin/bash -c ln -sf /usr/bin/python3 /usr/bin/python
    02/22/2025 12:13 PM UTC
    sha256:a0238769a05dbc487f814acd690d055eb72d0e0143748efbd364d8500bed7fb7RUN
    BUILD_CONTEXT=x86_64 CUDNN_VER=8.9.7.29 CUDA_VER=12.8 TRT_MAJOR_VER=10 TRT_VER=10.8.0.43 /bin/bash -c ldconfig
    02/22/2025 12:13 PM UTC
    sha256:bba8bcfcf880f64c31b18652caa3d98bc983f92fdea0a079398dc7f97bf283d8COPY
    wholegraph.tar.gz /opt/wholegraph.tar.gz
    02/22/2025 12:13 PM UTC
    sha256:99c7764056158efcceb9d8cc3e79e31ac23902c2dc2c6deca2ae815672f573f3RUN
    BUILD_CONTEXT=x86_64 CUDNN_VER=8.9.7.29 CUDA_VER=12.8 TRT_MAJOR_VER=10 TRT_VER=10.8.0.43 /bin/bash -c if [ -f install_pip_deps.sh ]; then bash install_pip_deps.sh; fi
    02/22/2025 12:13 PM UTC
    sha256:cabc89366c4f1d6a85dc7ad0cf34a69c98701370141e6d5f5cd9b4a9e92c7ac9COPY
    /install_pip_deps.sh .
    02/22/2025 12:13 PM UTC
    ...

    NVIDIA uses cookies to improve your experience on our web site. We and our third-party partners also use cookies and other tools to collect and record information you provide as well as information about your interactions with our websites for performance improvement, analytics, and to assist in marketing efforts. By clicking "Accept All", you consent to our use of cookies and other tools as described in our Cookie Policy. You can manage your cookie settings by clicking on "Manage Settings." By continuing to use this site or by clicking one of the buttons below, you agree to our Terms of Service (which contains important waivers). Please see our Privacy Policy for more information on our privacy practices.