ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA
NVIDIA
NVIDIA BigCode-Evaluation-Harness
Container
NVIDIA
NVIDIA
NVIDIA BigCode-Evaluation-Harness

NVIDIA NeMo Evaluator-compatible container with BigCode-Evaluation-Harness support. Based on BigCode available at: https://github.com/bigcode-project/bigcode-evaluation-harness

LayerLabelCreated
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4LABEL
org.opencontainers.image.licenses=3rd_party_licenses.txt
08/21/2025 11:50 AM UTC
sha256:ec6c7587b71cc2f7f8e812285e8669cf640a4c20c5d9669fee885a1d3a739704COPY
3rd_party_licenses.txt .
08/21/2025 11:50 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
THIRD_PARTY_LICENSES_FILE=3rd_party_licenses.txt
08/21/2025 11:50 AM UTC
sha256:aa6ea8711dc385524184dca58f07dcef99d51ac4ca3452af99f14ca5c5571b86RUN
pip uninstall -y nvidia-eval-commons-internal
08/21/2025 11:50 AM UTC
sha256:df8b611c921e59038b864b7620ff19e941749d11833ce6ee44e42abbfaf8274cCOPY
--chown=1000:1000 --chmod=777 tests/* /workspace/tests/
08/21/2025 11:01 AM UTC
sha256:899c38c09909ce04ad9c414715e5729abac6a97b5a866bb26d917b6d635ee32aCOPY
tests/* /workspace/tests/
08/21/2025 11:01 AM UTC
sha256:15753092ed41a5421b1fc424089be81c12e3a119f148278ee61abb1d20781918RUN
CI_COMMIT_SHA=2bf2f0a484028117e0bacee345d64a6d48e3155d EVAL_WHEEL_VERSION=25.07.3 PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple printf '#!/bin/bash\ncore-evals-bigcode "$@"' > /usr/bin/nv-eval &&
  chmod +x /usr/bin/nv-eval &&
  printf '#!/bin/bash\ncore-evals-bigcode "$@"' > /usr/bin/nv_eval &&
  chmod +x /usr/bin/nv_eval
08/21/2025 11:01 AM UTC
sha256:26252a3d835b601c32ec020f844ec274c791429bd8ea59109645e24fe4e5ef75RUN
CI_COMMIT_SHA=2bf2f0a484028117e0bacee345d64a6d48e3155d EVAL_WHEEL_VERSION=25.07.3 PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple pip install nvidia-bigcode-eval==${EVAL_WHEEL_VERSION} --no-cache-dir --index-url https://gitlab-ci-token:$(cat /run/secrets/ci_job_token)@${PKG_URL}
08/21/2025 11:01 AM UTC
sha256:da0297cdd6fcf7b878b956892397886f6851bdb6aeec7b747be4a23850a5aa4dADD
https://raw.githubusercontent.com/nuprl/MultiPL-E/refs/heads/main/src/luaunit.lua /usr/local/share/lua/5.1/luaunit.lua
08/21/2025 11:01 AM UTC
sha256:f00ab4834b44a53ff8a84d2ba7630140ca45b9083a15333512752e0837db9416RUN
CI_COMMIT_SHA=2bf2f0a484028117e0bacee345d64a6d48e3155d EVAL_WHEEL_VERSION=25.07.3 PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple ln -sv /usr/bin/mcs /usr/bin/csc
08/21/2025 11:01 AM UTC