NVIDIA LM-Evaluation-Harness

NVIDIA

Container

NVIDIA

NVIDIA LM-Evaluation-Harness

NVIDIA NeMo Evaluator-compatible container with LM-Evaluation-Harness support. Based on lm-evaluation-harness available at: https://github.com/EleutherAI/lm-evaluation-harness

Layer	Label		Created
sha256:a9ab371e49e445c3ad157a3ef8af12a05cc4b5f4b49099f100ccf6e8c8a937dc	COPY	`--chown=1000:1000 /workspace/tests/ /workspace/tests/`	04/23/2025 11:17 AM UTC
sha256:81b1733e57b62e37e284ac07e93cf016ced78254979fd3cac8f00089e16e1fd0	COPY	`/usr/local/bin/core-evals-lm-eval /usr/local/bin/core-evals-lm-eval`	04/23/2025 11:17 AM UTC
sha256:579d2122d5c76be15d7513024af0feb060d4214ad53c81480ed44eb0219922cd	COPY	`/usr/bin/nv_eval /bin/nv_eval`	04/23/2025 11:17 AM UTC
sha256:944ab9816473ec83d1e1b1bca0b71e4498d7e9ba5b6f352644245c374ca5fc7c	COPY	`/usr/local/bin/lm-eval /bin/lm-eval`	04/23/2025 11:17 AM UTC
sha256:0db8d7f3440b422b2916aad8de5a005e62a93e3d96f150cb8f347bce1d910bfc	COPY	`/usr/local/lib/python3.10/dist-packages /usr/local/lib/python3.10/dist-packages`	04/23/2025 11:17 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`HOME=/workspace`	04/23/2025 11:17 AM UTC
sha256:dc0f62be71310877f896c12923a722ec2ef9c89bf284b2816b75b80ac5e16e1a	COPY	`/usr/local/bin/pytest /bin/pytest`	04/22/2025 5:12 AM UTC
sha256:0d5f2b57f89484109e0f48eb5cc8bce85ee06e61cb618f5608886afcd955c5a2	COPY	`/usr/local/bin/jq /bin/jq`	04/22/2025 5:12 AM UTC
sha256:834d08a79e68cc558f59fc818c874d2c04616f41086407a34c6e335bd88e37e1	COPY	`/usr/local/bin/yq /bin/yq`	04/22/2025 5:12 AM UTC
sha256:17c70452abac387cf1d085c3c35928bdaa724addf42d61450bd337d96a09d926	COPY	`/bin/mv /bin/mv`	04/22/2025 5:12 AM UTC