NVIDIA
NVIDIA
NVIDIA BigCode-Evaluation-Harness
Container
NVIDIA
NVIDIA
NVIDIA BigCode-Evaluation-Harness

NVIDIA NeMo Evaluator-compatible container with BigCode-Evaluation-Harness support. Based on BigCode available at: https://github.com/bigcode-project/bigcode-evaluation-harness

LayerLabelCreated
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4LABEL
org.opencontainers.image.licenses=3rd_party_licenses.txt
01/30/2026 2:39 PM UTC
sha256:e1f4152eb978fec13e7c1397e755a40616066fc76545196549c7351c12e7063cCOPY
README.md README.md
01/30/2026 2:39 PM UTC
sha256:c2f3a36fd37e56dfb7b71769bde13ce56d9175bcf9bbb3258440c89b4fe45dafCOPY
3rd_party_licenses.txt .
01/30/2026 2:39 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
README_FILE=README.md
01/30/2026 2:39 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
THIRD_PARTY_LICENSES_FILE=3rd_party_licenses.txt
01/30/2026 2:39 PM UTC
sha256:4dfd03f65c48fe5aaaf74588507665b08435b75b44809592eb3b1a070e1c0d5bRUN
pip uninstall -y nemo-evaluator-internal
01/30/2026 2:39 PM UTC
sha256:335d86858fc07bdbdb1d506e5626152b981a341363df0a52a315f1e69368068cCOPY
--chmod=777 tests/* /workspace/tests/
01/30/2026 9:32 AM UTC
sha256:6af6bd0f107cab9c56c3f4280a7c5e439b632cbd6b88171ab4fd8bc7350d6194RUN
CI_COMMIT_SHA=b8adb3c3d0bcfec37f39346c4407363ef2dde954 EVAL_WHEEL_VERSION=26.01 PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple python -c "from nemo_evaluator.core.input import _copy_fdfs; _copy_fdfs('/opt/metadata/')"
01/30/2026 9:32 AM UTC
sha256:6a49c19cff3889613bec515fb2fb809ac1e607f0fc416fa300f9d7bf9f5f5e5bRUN
CI_COMMIT_SHA=b8adb3c3d0bcfec37f39346c4407363ef2dde954 EVAL_WHEEL_VERSION=26.01 PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple pip install nvidia-bigcode-eval==${EVAL_WHEEL_VERSION} --no-cache-dir --index-url https://gitlab-ci-token:$(cat /run/secrets/ci_job_token)@${PKG_URL}
01/30/2026 9:32 AM UTC
sha256:d68f243850138d84185336dfc5607dc84eb6459afe9fa82499e11fdd9c0db7fdADD
https://raw.githubusercontent.com/nuprl/MultiPL-E/refs/heads/main/src/luaunit.lua /usr/local/share/lua/5.1/luaunit.lua
01/30/2026 9:31 AM UTC