NVIDIA MTBench | NVIDIA NGC

NVIDIA

NVIDIA MTBench

Container

NVIDIA

NVIDIA MTBench

NVIDIA NeMo Evaluator-compatible container with MTBench support. Based on FastChat available at: https://github.com/lm-sys/FastChat

Layer	Label		Created
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	LABEL	`org.opencontainers.image.licenses=3rd_party_licenses.txt`	10/22/2025 8:13 PM UTC
sha256:a1612326978a492c6d1d081e534749842230143849540e5567946d0cc6365a6d	COPY	`README.md README.md`	10/22/2025 8:13 PM UTC
sha256:76abf9382a0f1ed0d88a1d314ebf8d09dd3691d7acd9bffe8c4e7a251c1b64fe	COPY	`3rd_party_licenses.txt .`	10/22/2025 8:13 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ARG	`README_FILE=README.md`	10/22/2025 8:13 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ARG	`THIRD_PARTY_LICENSES_FILE=3rd_party_licenses.txt`	10/22/2025 8:13 PM UTC
sha256:067d6fab6a2f224cdf8c2171d98ed33c1d7b8295cc48319d576a52e0bddd1dc0	RUN	`pip uninstall -y nemo-evaluator-internal`	10/22/2025 8:13 PM UTC
sha256:240118ca05ddfb9b89bc6c6ffe3d642197eebedeab1b4d9713a4c33c40aef455	COPY	`tests/* /workspace/tests/`	10/21/2025 3:19 PM UTC
sha256:c05ea560ab5b2d4e5f2a50b2273b30dcd043e716e031f1d5c5177e5bd8023609	RUN	`CI_COMMIT_SHA=642726ffc068518ea874f9183393464458b3cdcb EVAL_WHEEL_VERSION=25.09.1 PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple pip install nvidia_mtbench_evaluator==${EVAL_WHEEL_VERSION} --no-cache-dir --index-url https://gitlab-ci-token:$(cat /run/secrets/ci_job_token)@${PKG_URL}`	10/21/2025 3:19 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`OPENAI_SCOPE=azureopenai-readwrite`	10/21/2025 3:19 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`OPENAI_MODEL_VERSION=2024-06-01`	10/21/2025 3:19 PM UTC