NVIDIA MTBench | NVIDIA NGC

NVIDIA

NVIDIA MTBench

Container

NVIDIA

NVIDIA MTBench

NVIDIA NeMo Evaluator-compatible container with MTBench support. Based on FastChat available at: https://github.com/lm-sys/FastChat

Layer	Label		Created
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	LABEL	`org.opencontainers.image.licenses=3rd_party_licenses.txt`	09/30/2025 9:52 AM UTC
sha256:f3325fcb0a72be44b058e2ac0005af90edc1a68388264c0df2057f1c04d0131c	COPY	`README.md README.md`	09/30/2025 9:52 AM UTC
sha256:fae22daed2aafa8206a624c1833d3eae2be4e072f804d58cc3859271d31a39f1	COPY	`3rd_party_licenses.txt .`	09/30/2025 9:52 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ARG	`README_FILE=README.md`	09/30/2025 9:52 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ARG	`THIRD_PARTY_LICENSES_FILE=3rd_party_licenses.txt`	09/30/2025 9:52 AM UTC
sha256:a0e14db82487862797376f09120b142c4c22f5980a1bcf26638f9c98e38aad46	RUN	`pip uninstall -y nemo-evaluator-internal`	09/30/2025 9:52 AM UTC
sha256:b41ed101f1d484d008dc99aea8fc38efd3a77544aef7d478547ee6cf259ca3b3	COPY	`tests/* /workspace/tests/`	09/29/2025 9:35 AM UTC
sha256:0eb298f6433a4aff8cbd91aec7ef638c67c5d01ee51d62272581b3f69381dc13	RUN	`CI_COMMIT_SHA=26bc7c0fca30c8fcc72e3f1fa7127f95824d2c6d EVAL_WHEEL_VERSION=25.09 PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple pip install nvidia_mtbench_evaluator==${EVAL_WHEEL_VERSION} --no-cache-dir --index-url https://gitlab-ci-token:$(cat /run/secrets/ci_job_token)@${PKG_URL}`	09/29/2025 9:35 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`OPENAI_SCOPE=azureopenai-readwrite`	09/29/2025 9:35 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`OPENAI_MODEL_VERSION=2024-06-01`	09/29/2025 9:35 AM UTC