NVIDIA LM-Evaluation-Harness

NVIDIA

Container

NVIDIA

NVIDIA LM-Evaluation-Harness

NVIDIA NeMo Evaluator-compatible container with LM-Evaluation-Harness support. Based on lm-evaluation-harness available at: https://github.com/EleutherAI/lm-evaluation-harness

Layer	Label		Created
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	LABEL	`org.opencontainers.image.licenses=3rd_party_licenses.txt`	10/22/2025 8:10 PM UTC
sha256:9fedeb8629ec0e3166ea3185bcb9a7cbfe17f86f552125d6c19aca655d1b2737	COPY	`README.md README.md`	10/22/2025 8:10 PM UTC
sha256:5c61a734bf95eab834fe8d8aca662d6ad2bfc37b24e9c01f6aac970033f932ad	COPY	`3rd_party_licenses.txt .`	10/22/2025 8:10 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ARG	`README_FILE=README.md`	10/22/2025 8:10 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ARG	`THIRD_PARTY_LICENSES_FILE=3rd_party_licenses.txt`	10/22/2025 8:10 PM UTC
sha256:e348265fc44760586d0e61e7d0dc90eb7d95e0aec46fef58cce67f632042e9eb	RUN	`pip uninstall -y nemo-evaluator-internal`	10/22/2025 8:10 PM UTC
sha256:173acafd75f1cbb7d396955d7162243032d0248c2ae5cf2bf15e7f4d860515dd	COPY	`--chown=1000:1000 --chmod=777 tests/* /workspace/tests/`	10/21/2025 3:17 PM UTC
sha256:9e2c3e41a0b64a9479a5108e9e10eb03afb90742169f99aac55888bb0dd818f6	RUN	`CI_COMMIT_SHA=642726ffc068518ea874f9183393464458b3cdcb EVAL_WHEEL_VERSION=25.09.1 PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple pip install nvidia-lm-eval[math,evalplus]==${EVAL_WHEEL_VERSION} --no-cache-dir --index-url https://gitlab-ci-token:$(cat /run/secrets/ci_job_token)@${PKG_URL}`	10/21/2025 3:17 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ARG	`PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple`	10/21/2025 3:17 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ARG	`EVAL_WHEEL_VERSION=25.09.1`	10/21/2025 3:17 PM UTC