NVIDIA
NVIDIA MTBench
Container
NVIDIA
NVIDIA MTBench

NVIDIA NeMo Evaluator-compatible container with MTBench support. Based on FastChat available at: https://github.com/lm-sys/FastChat

  • LayerLabelCreated
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4LABEL
    org.opencontainers.image.licenses=3rd_party_licenses.txt
    03/12/2026 9:57 AM UTC
    sha256:612995d056b553417813e55d1faad757e6357cc9deac286e2acf7f7835ca5653COPY
    README.md README.md
    03/12/2026 9:57 AM UTC
    sha256:66b006d20c6d2b4e2cf68bd8dfaa6b913f757ef74ada74591a61799c94ad07f0COPY
    3rd_party_licenses.txt .
    03/12/2026 9:57 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
    README_FILE=README.md
    03/12/2026 9:57 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
    THIRD_PARTY_LICENSES_FILE=3rd_party_licenses.txt
    03/12/2026 9:57 AM UTC
    sha256:4fa504b3fb1297209cad5920681d75a432759d20cc2b504c55e3c6ebd365eef3RUN
    pip uninstall -y nemo-evaluator-internal
    03/12/2026 9:57 AM UTC
    sha256:8b88b80990970debde142e12bbe64d6a11fdf178b6c6576812947fafc85fb598COPY
    tests/* /workspace/tests/
    03/11/2026 2:16 PM UTC
    sha256:37122b11eaf40608951bbe8fa86b7489d8fab6bbf07be535d0687c223d48c4eaRUN
    CI_COMMIT_SHA=83a6bbd46e65be5bceb13b920aa2f90dd73ec155 EVAL_WHEEL_VERSION=26.03 PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple python -c "from nemo_evaluator.core.input import _copy_fdfs; _copy_fdfs('/opt/metadata/')"
    03/11/2026 2:16 PM UTC
    sha256:138fc4678989735d51cc8fdf19069bb7fe62da6c6bb402afa1b55cdff495f8f3RUN
    CI_COMMIT_SHA=83a6bbd46e65be5bceb13b920aa2f90dd73ec155 EVAL_WHEEL_VERSION=26.03 PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple pip install nvidia_mtbench_evaluator==${EVAL_WHEEL_VERSION} --no-cache-dir --index-url https://gitlab-ci-token:$(cat /run/secrets/ci_job_token)@${PKG_URL}
    03/11/2026 2:16 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    OPENAI_SCOPE=azureopenai-readwrite
    03/11/2026 2:16 PM UTC

    NVIDIA uses cookies to improve your experience on our web site. We and our third-party partners also use cookies and other tools to collect and record information you provide as well as information about your interactions with our websites for performance improvement, analytics, and to assist in marketing efforts. By clicking "Accept All", you consent to our use of cookies and other tools as described in our Cookie Policy. You can manage your cookie settings by clicking on "Manage Settings." By continuing to use this site or by clicking one of the buttons below, you agree to our Terms of Service (which contains important waivers). Please see our Privacy Policy for more information on our privacy practices.