ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA
NVIDIA
NVIDIA LM-Evaluation-Harness
Container
NVIDIA
NVIDIA
NVIDIA LM-Evaluation-Harness

NVIDIA NeMo Evaluator-compatible container with LM-Evaluation-Harness support. Based on lm-evaluation-harness available at: https://github.com/EleutherAI/lm-evaluation-harness

LayerLabelCreated
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4LABEL
org.opencontainers.image.licenses=3rd_party_licenses.txt
09/16/2025 5:57 AM UTC
sha256:1689a4626465031e1da40919d0086a071b2661a3ceeafcc4ec0c216e7d700e06COPY
README.md README.md
09/16/2025 5:57 AM UTC
sha256:91f3fd5fc35513312120fe4d46196524a8f6a7cc5e50e17cee456e7a2d5434e1COPY
3rd_party_licenses.txt .
09/16/2025 5:57 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
README_FILE=README.md
09/16/2025 5:57 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
THIRD_PARTY_LICENSES_FILE=3rd_party_licenses.txt
09/16/2025 5:57 AM UTC
sha256:9d9c25aac77016159bc2220e48e78f8cd7aaf4487a1083dd2886dcbcb2be9bbcRUN
pip uninstall -y nvidia-eval-commons-internal
09/16/2025 5:57 AM UTC
sha256:5c22ee00cca01ff5cb4da0cf7c663faee0eb6abb25251539ddba4f2974337c43COPY
--chown=1000:1000 --chmod=777 tests/* /workspace/tests/
09/15/2025 4:28 PM UTC
sha256:d9f4238587060db8c4d2ef1968ab6230e491a05b374f56e88d1e7a20c3c61782RUN
CI_COMMIT_SHA=001b448ca8a445a7688a02ec1a7aa7424613e7b7 EVAL_WHEEL_VERSION=25.08.1 PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple printf '#!/bin/bash\ncore-evals-lm-eval "$@"' > /usr/bin/nv-eval &&
  chmod +x /usr/bin/nv-eval &&
  printf '#!/bin/bash\ncore-evals-lm-eval "$@"' > /usr/bin/nv_eval &&
  chmod +x /usr/bin/nv_eval
09/15/2025 4:28 PM UTC
sha256:3bd30044cfebebce7dbb903170b4bd6ecbd7f8833663154152f7e7e91d89d33bRUN
CI_COMMIT_SHA=001b448ca8a445a7688a02ec1a7aa7424613e7b7 EVAL_WHEEL_VERSION=25.08.1 PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple pip install nvidia-lm-eval[math,evalplus]==${EVAL_WHEEL_VERSION} --no-cache-dir --index-url https://gitlab-ci-token:$(cat /run/secrets/ci_job_token)@${PKG_URL}
09/15/2025 4:28 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple
09/15/2025 4:28 PM UTC