NVIDIA LM-Evaluation-Harness

NVIDIA

Container

NVIDIA

NVIDIA LM-Evaluation-Harness

NVIDIA NeMo Evaluator-compatible container with LM-Evaluation-Harness support. Based on lm-evaluation-harness available at: https://github.com/EleutherAI/lm-evaluation-harness

Layer	Label		Created
sha256:a11fed0272f7cb880c6e8af1dac9e14fce77eb43efacbb4d27486d5c5754a0fe	COPY	`--chown=1000:1000 /workspace/tests/ /workspace/tests/`	03/26/2025 11:05 AM UTC
sha256:b17a686321cde87cfcc19a82e567efdcd4992824b9bfffb7bfde9f1136f07586	COPY	`/usr/local/bin/core-evals-lm-eval /usr/local/bin/core-evals-lm-eval`	03/26/2025 11:05 AM UTC
sha256:ab9af346d39b2a6fb4d8bb8de09f6ac3bc1363aa1e73a2002998d607114d41d2	COPY	`/usr/bin/nv_eval /bin/nv_eval`	03/26/2025 11:05 AM UTC
sha256:df8bcb12ddf97495e914b47e5ea9ec444d8e6dc8a3b00c1b7d9ff33fea4f14f7	COPY	`/usr/local/bin/lm-eval /bin/lm-eval`	03/26/2025 11:05 AM UTC
sha256:be8c51053691a0b41e3b231751dc4fff17b9ecebccce75c9aff8b26ca85f7bba	COPY	`/usr/local/lib/python3.10/dist-packages /usr/local/lib/python3.10/dist-packages`	03/26/2025 11:05 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`HOME=/workspace`	03/26/2025 11:05 AM UTC
sha256:dc4989df9f494e79c320c7609c825a718b5683279468348e7c251d0a331702eb	COPY	`/usr/local/bin/pytest /bin/pytest`	03/25/2025 2:05 PM UTC
sha256:8c756e5d55cd6aeb6e8b54860bf53c8fe3e4a669aa4cc6d90ed1eeed20e77d91	COPY	`/usr/local/bin/jq /bin/jq`	03/25/2025 2:05 PM UTC
sha256:dbb262b2203bd5ff4bd6ecbf64a5928f5ae1bd79a2c524ab7a8e64834ab25c20	COPY	`/usr/local/bin/yq /bin/yq`	03/25/2025 2:05 PM UTC
sha256:7e022f5881685d06959e347dbcd7b32a2dc0e16ab1a96ceda438a71989730518	COPY	`/bin/touch /bin/touch`	03/25/2025 2:05 PM UTC