NVIDIA
NVIDIA
NVIDIA MTBench
Container
NVIDIA
NVIDIA
NVIDIA MTBench

NVIDIA NeMo Evaluator-compatible container with MTBench support. Based on FastChat available at: https://github.com/lm-sys/FastChat

LayerLabelCreated
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4LABEL
org.opencontainers.image.licenses=3rd_party_licenses.txt
01/30/2026 2:35 PM UTC
sha256:3d322362a1a563a3e6b83ff1f079c54e9342e22294bb6de9dfe96a6609704b98COPY
README.md README.md
01/30/2026 2:35 PM UTC
sha256:b496200d3d9a4644d7465bddf891987d1fe92d631d5c2d0cbfdd934ae68901c7COPY
3rd_party_licenses.txt .
01/30/2026 2:35 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
README_FILE=README.md
01/30/2026 2:35 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
THIRD_PARTY_LICENSES_FILE=3rd_party_licenses.txt
01/30/2026 2:35 PM UTC
sha256:00f533c08662422c16aabd9ea23ba5e6081634e0234a91db0b36b684bcd503afRUN
pip uninstall -y nemo-evaluator-internal
01/30/2026 2:35 PM UTC
sha256:a88144db6a1c99d8f6f685b6b462ec261b082e9d2befd9a1ed7f90e35be4fedfCOPY
tests/* /workspace/tests/
01/30/2026 9:26 AM UTC
sha256:f6cc043fcc4de1ae159143c17c2d27d3618c6687c8a4803725a19531d4767e0bRUN
CI_COMMIT_SHA=b8adb3c3d0bcfec37f39346c4407363ef2dde954 EVAL_WHEEL_VERSION=26.01 PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple python -c "from nemo_evaluator.core.input import _copy_fdfs; _copy_fdfs('/opt/metadata/')"
01/30/2026 9:26 AM UTC
sha256:96dfd84e69638f8dc25c76e59c834ebbcaf42085f948cb86544c73fe7b584743RUN
CI_COMMIT_SHA=b8adb3c3d0bcfec37f39346c4407363ef2dde954 EVAL_WHEEL_VERSION=26.01 PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple pip install nvidia_mtbench_evaluator==${EVAL_WHEEL_VERSION} --no-cache-dir --index-url https://gitlab-ci-token:$(cat /run/secrets/ci_job_token)@${PKG_URL}
01/30/2026 9:26 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
OPENAI_SCOPE=azureopenai-readwrite
01/30/2026 9:26 AM UTC