NVIDIA
NVIDIA
NVIDIA MTBench
Container
NVIDIA
NVIDIA
NVIDIA MTBench

NVIDIA NeMo Evaluator-compatible container with MTBench support. Based on FastChat available at: https://github.com/lm-sys/FastChat

LayerLabelCreated
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4LABEL
org.opencontainers.image.licenses=3rd_party_licenses.txt
12/02/2025 3:53 PM UTC
sha256:ff3aed4c44486598e509d303196b7fbe42d9903e804c51791fda32fff9a69170COPY
README.md README.md
12/02/2025 3:53 PM UTC
sha256:b08891dcebd5143f206a4dd59f038f9ae88ff56d9bdc204b9b2130b679706ac4COPY
3rd_party_licenses.txt .
12/02/2025 3:53 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
README_FILE=README.md
12/02/2025 3:53 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
THIRD_PARTY_LICENSES_FILE=3rd_party_licenses.txt
12/02/2025 3:53 PM UTC
sha256:8ecf69f94f3c9fec54cda93d8ff3170bc6ed8184480fe634586acd81576a662bRUN
pip uninstall -y nemo-evaluator-internal
12/02/2025 3:53 PM UTC
sha256:7dcdc9cd8230f04a47148170e9184ae47ff28e7d5e0be788c9f57248c5dea5f5COPY
tests/* /workspace/tests/
12/01/2025 1:28 PM UTC
sha256:28c909987f366dc6e0e3b3620315a1ea41723d0d269aca660f81650728615a9bRUN
CI_COMMIT_SHA=1c7c8d973b2696c49382b89e5f56646c9c194f0a EVAL_WHEEL_VERSION=25.11 PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple python -c "from nemo_evaluator.core.input import _copy_fdfs; _copy_fdfs('/opt/metadata/')"
12/01/2025 1:28 PM UTC
sha256:8cd5e8506893f58743b33fbe71eb2f3313c333df3cd2a7a92d1b6d54dfaad4f9RUN
CI_COMMIT_SHA=1c7c8d973b2696c49382b89e5f56646c9c194f0a EVAL_WHEEL_VERSION=25.11 PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple pip install nvidia_mtbench_evaluator==${EVAL_WHEEL_VERSION} --no-cache-dir --index-url https://gitlab-ci-token:$(cat /run/secrets/ci_job_token)@${PKG_URL}
12/01/2025 1:28 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
OPENAI_SCOPE=azureopenai-readwrite
12/01/2025 1:28 PM UTC