ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA
NVIDIA
NVIDIA LM-Evaluation-Harness
Container
NVIDIA
NVIDIA
NVIDIA LM-Evaluation-Harness

NVIDIA NeMo Evaluator-compatible container with LM-Evaluation-Harness support. Based on lm-evaluation-harness available at: https://github.com/EleutherAI/lm-evaluation-harness

LayerLabelCreated
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4LABEL
org.opencontainers.image.licenses=3rd_party_licenses.txt
12/02/2025 4:27 PM UTC
sha256:f6c833d97a73e40075a17ea399c583cca40f04b38de316700d8341881f1ba037COPY
README.md README.md
12/02/2025 4:27 PM UTC
sha256:099c1c2c823432156feafb980d0a23e30ac67078373f964b9267c0efe4f7c3b3COPY
3rd_party_licenses.txt .
12/02/2025 4:27 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
README_FILE=README.md
12/02/2025 4:27 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
THIRD_PARTY_LICENSES_FILE=3rd_party_licenses.txt
12/02/2025 4:27 PM UTC
sha256:6972c010222f8b396d4a9458d7ade81df11bbfb5a0b5558e757682dba8d61996RUN
pip uninstall -y nemo-evaluator-internal
12/02/2025 4:27 PM UTC
sha256:f00ba58678c495db4a205e82ddf11d2d29c8fd9b97bb988ee60502824309cb1bCOPY
--chown=1000:1000 --chmod=777 tests/* /workspace/tests/
12/02/2025 2:18 PM UTC
sha256:5a740dbb127cdca439f3fb6aa47442f758311fbf63e1e11ba0de51a0d1d8c8f2RUN
CI_COMMIT_SHA=e6333af3765b6d681aa1a064a3b97a583d48590b EVAL_WHEEL_VERSION=25.11 PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple python -c "from nemo_evaluator.core.input import _copy_fdfs; _copy_fdfs('/opt/metadata/')"
12/02/2025 2:18 PM UTC
sha256:b61877c2e01831ec4612c956a9a70607c31e3982726fc73f7b6c74f9e9ceaf4aRUN
CI_COMMIT_SHA=e6333af3765b6d681aa1a064a3b97a583d48590b EVAL_WHEEL_VERSION=25.11 PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple pip install nvidia-lm-eval[math,evalplus]==${EVAL_WHEEL_VERSION} --no-cache-dir --index-url https://gitlab-ci-token:$(cat /run/secrets/ci_job_token)@${PKG_URL}
12/02/2025 2:18 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple
12/02/2025 2:18 PM UTC