NVIDIA LM-Evaluation-Harness

NVIDIA

Container

NVIDIA

NVIDIA LM-Evaluation-Harness

NVIDIA NeMo Evaluator-compatible container with LM-Evaluation-Harness support. Based on lm-evaluation-harness available at: https://github.com/EleutherAI/lm-evaluation-harness

Layer	Label		Created
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	LABEL	`org.opencontainers.image.licenses=3rd_party_licenses.txt`	10/30/2025 11:47 AM UTC
sha256:290bc0514646143616c6062959a4d93794bb0a1957246e67c8022afaf23bba32	COPY	`README.md README.md`	10/30/2025 11:47 AM UTC
sha256:99841edea09c2aa80ab497b4151baa77452d3670274e6d9ccf54fa7faf38f8fc	COPY	`3rd_party_licenses.txt .`	10/30/2025 11:47 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ARG	`README_FILE=README.md`	10/30/2025 11:47 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ARG	`THIRD_PARTY_LICENSES_FILE=3rd_party_licenses.txt`	10/30/2025 11:47 AM UTC
sha256:7b01a76a315fbb14cbde67f78f3dbd30e4ec7a877e9253db73c442bf94abc874	RUN	`pip uninstall -y nemo-evaluator-internal`	10/30/2025 11:47 AM UTC
sha256:007231a080dbc0507763c6e369413a74944f1cbbf7c94042a1e358681702064b	COPY	`--chown=1000:1000 --chmod=777 tests/* /workspace/tests/`	10/29/2025 8:20 PM UTC
sha256:d31569c9267d1d099e2f6f366f064350b551d530f28c27b490718b165b4cd4f6	RUN	`CI_COMMIT_SHA=fc8906b9f7ea5881368f032ca1cb4f119bd513a6 EVAL_WHEEL_VERSION=25.10 PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple pip install nvidia-lm-eval[math,evalplus]==${EVAL_WHEEL_VERSION} --no-cache-dir --index-url https://gitlab-ci-token:$(cat /run/secrets/ci_job_token)@${PKG_URL}`	10/29/2025 8:20 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ARG	`PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple`	10/29/2025 8:20 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ARG	`EVAL_WHEEL_VERSION=25.10`	10/29/2025 8:20 PM UTC