ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA
NVIDIA
NVIDIA LM-Evaluation-Harness
Container
NVIDIA
NVIDIA
NVIDIA LM-Evaluation-Harness

NVIDIA NeMo Evaluator-compatible container with LM-Evaluation-Harness support. Based on lm-evaluation-harness available at: https://github.com/EleutherAI/lm-evaluation-harness

LayerLabelCreated
a0098bfdd1ed8bdf86d68194eaa2f68cf8994bfc84386e1288a759ed9956d638CONFIG
WorkingDir /workspace
03/12/2026 9:49 AM UTC
c7d50938746aaab0713703aa422655e042c3133cb4b117a14a4e210fa0a24e24COPY
README.md README.md
03/12/2026 9:49 AM UTC
ab0fb8f2d6b78b9ccde50da2061bc9386cdfc594ad0cd294f11ca924c423a78aCOPY
3rd_party_licenses.txt .
03/12/2026 9:49 AM UTC
a4344c3e07b74a6a3c4e42988c82a93c5a66c808734c98bc9a1882704ef1fdc7ARG
README_FILE=README.md
03/12/2026 9:49 AM UTC
2b410ce8f5916cad483af0104f4b37d05a29a8a6d056090c7b6406f45d645680ARG
THIRD_PARTY_LICENSES_FILE=3rd_party_licenses.txt
03/12/2026 9:49 AM UTC
8695a8e364286abd95c68efe672debbe2bbaa8e95ce87f75e7db36a9b632885cRUN
pip uninstall -y nemo-evaluator-internal
03/12/2026 9:49 AM UTC
62d10b492cace0e32eec2f1fe4d8a91462ecee1cdafac13b15e80c16cd08d18bCOPY
--chown=1000:1000 --chmod=777 tests/* /workspace/tests/
03/11/2026 1:55 PM UTC
3426ea007eee30b4f61214a34fbad7ede83f73bcc505dd872d1238be0e5b82f2RUN
CI_COMMIT_SHA=83a6bbd46e65be5bceb13b920aa2f90dd73ec155 EVAL_WHEEL_VERSION=26.03 PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple python -c "from nemo_evaluator.core.input import _copy_fdfs; _copy_fdfs('/opt/metadata/')"
03/11/2026 1:55 PM UTC
3a698b6a218bf4acc977ef8250164e41e1d7696957d36e701b7abb1074ba92a5RUN
CI_COMMIT_SHA=83a6bbd46e65be5bceb13b920aa2f90dd73ec155 EVAL_WHEEL_VERSION=26.03 PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple pip install nvidia-lm-eval[math,evalplus]==${EVAL_WHEEL_VERSION} --no-cache-dir --index-url https://gitlab-ci-token:$(cat /run/secrets/ci_job_token)@${PKG_URL}
03/11/2026 1:55 PM UTC
07acfc238f50e5dab653f154f0594c78ae092fe67f2bd14f0729318b114f68e5ARG
PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple
03/11/2026 1:55 PM UTC

NVIDIA uses cookies to improve your experience on our web site. We and our third-party partners also use cookies and other tools to collect and record information you provide as well as information about your interactions with our websites for performance improvement, analytics, and to assist in marketing efforts. By clicking "Accept All", you consent to our use of cookies and other tools as described in our Cookie Policy. You can manage your cookie settings by clicking on "Manage Settings." By continuing to use this site or by clicking one of the buttons below, you agree to our Terms of Service (which contains important waivers). Please see our Privacy Policy for more information on our privacy practices.