NVIDIA
NVIDIA
NVIDIA MTBench
Container
NVIDIA
NVIDIA
NVIDIA MTBench

NVIDIA NeMo Evaluator-compatible container with MTBench support. Based on FastChat available at: https://github.com/lm-sys/FastChat

LayerLabelCreated
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4LABEL
org.opencontainers.image.licenses=3rd_party_licenses.txt
03/12/2026 9:57 AM UTC
sha256:612995d056b553417813e55d1faad757e6357cc9deac286e2acf7f7835ca5653COPY
README.md README.md
03/12/2026 9:57 AM UTC
sha256:66b006d20c6d2b4e2cf68bd8dfaa6b913f757ef74ada74591a61799c94ad07f0COPY
3rd_party_licenses.txt .
03/12/2026 9:57 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
README_FILE=README.md
03/12/2026 9:57 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
THIRD_PARTY_LICENSES_FILE=3rd_party_licenses.txt
03/12/2026 9:57 AM UTC
sha256:4fa504b3fb1297209cad5920681d75a432759d20cc2b504c55e3c6ebd365eef3RUN
pip uninstall -y nemo-evaluator-internal
03/12/2026 9:57 AM UTC
sha256:8b88b80990970debde142e12bbe64d6a11fdf178b6c6576812947fafc85fb598COPY
tests/* /workspace/tests/
03/11/2026 2:16 PM UTC
sha256:37122b11eaf40608951bbe8fa86b7489d8fab6bbf07be535d0687c223d48c4eaRUN
CI_COMMIT_SHA=83a6bbd46e65be5bceb13b920aa2f90dd73ec155 EVAL_WHEEL_VERSION=26.03 PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple python -c "from nemo_evaluator.core.input import _copy_fdfs; _copy_fdfs('/opt/metadata/')"
03/11/2026 2:16 PM UTC
sha256:138fc4678989735d51cc8fdf19069bb7fe62da6c6bb402afa1b55cdff495f8f3RUN
CI_COMMIT_SHA=83a6bbd46e65be5bceb13b920aa2f90dd73ec155 EVAL_WHEEL_VERSION=26.03 PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple pip install nvidia_mtbench_evaluator==${EVAL_WHEEL_VERSION} --no-cache-dir --index-url https://gitlab-ci-token:$(cat /run/secrets/ci_job_token)@${PKG_URL}
03/11/2026 2:16 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
OPENAI_SCOPE=azureopenai-readwrite
03/11/2026 2:16 PM UTC