NVIDIA LM-Evaluation-Harness

NVIDIA

Container

NVIDIA

NVIDIA LM-Evaluation-Harness

NVIDIA NeMo Evaluator-compatible container with LM-Evaluation-Harness support. Based on lm-evaluation-harness available at: https://github.com/EleutherAI/lm-evaluation-harness

Layer	Label		Created
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	LABEL	`org.opencontainers.image.licenses=3rd_party_licenses.txt`	09/30/2025 10:04 AM UTC
sha256:35575a364f51f3ffea3fb5f21814f66ed66a432357beea5b92696ae4146a5336	COPY	`README.md README.md`	09/30/2025 10:04 AM UTC
sha256:5e77f1f4aa5d3b22614adeb9a9c4e4bc967359b39043d70a211708d1f8fde7e7	COPY	`3rd_party_licenses.txt .`	09/30/2025 10:04 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ARG	`README_FILE=README.md`	09/30/2025 10:04 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ARG	`THIRD_PARTY_LICENSES_FILE=3rd_party_licenses.txt`	09/30/2025 10:04 AM UTC
sha256:dc8f336aa99aaa8f3e3ed976a6c8c8295372eca93d6839eb2fb7259876db0c4c	RUN	`pip uninstall -y nemo-evaluator-internal`	09/30/2025 10:04 AM UTC
sha256:b892f6f0509e4a686a2f99ec2b26c71d8b228225e0be33f46bcf96d2d78eaac8	COPY	`--chown=1000:1000 --chmod=777 tests/* /workspace/tests/`	09/29/2025 9:33 AM UTC
sha256:b28710984d318e1c58244aaad517d2b26957deeb24af7dce8cae50413bd2a83d	RUN	`CI_COMMIT_SHA=26bc7c0fca30c8fcc72e3f1fa7127f95824d2c6d EVAL_WHEEL_VERSION=25.09 PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple pip install nvidia-lm-eval[math,evalplus]==${EVAL_WHEEL_VERSION} --no-cache-dir --index-url https://gitlab-ci-token:$(cat /run/secrets/ci_job_token)@${PKG_URL}`	09/29/2025 9:33 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ARG	`PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple`	09/29/2025 9:33 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ARG	`EVAL_WHEEL_VERSION=25.09`	09/29/2025 9:33 AM UTC