NVIDIA
NVIDIA
NVIDIA BigCode-Evaluation-Harness
Container
NVIDIA
NVIDIA
NVIDIA BigCode-Evaluation-Harness

NVIDIA NeMo Evaluator-compatible container with BigCode-Evaluation-Harness support. Based on BigCode available at: https://github.com/bigcode-project/bigcode-evaluation-harness

LayerLabelCreated
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4LABEL
org.opencontainers.image.licenses=3rd_party_licenses.txt
03/12/2026 9:48 AM UTC
sha256:b0a296dc993a16181140c96551306f37c29757b778c76ed568bcaeb9f53cd7d7COPY
README.md README.md
03/12/2026 9:48 AM UTC
sha256:c83e19a2bd78df23f51bfd195f3d4265731fe66d62eb8e6e5ea253caff35a602COPY
3rd_party_licenses.txt .
03/12/2026 9:48 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
README_FILE=README.md
03/12/2026 9:48 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
THIRD_PARTY_LICENSES_FILE=3rd_party_licenses.txt
03/12/2026 9:48 AM UTC
sha256:7aacb5fea4603c96890d9c64e0d227321ed27f3786a2a63b0ec027dcf2c163efRUN
pip uninstall -y nemo-evaluator-internal
03/12/2026 9:48 AM UTC
sha256:705c45f1dcb5d79938b4933cb7802c229bfda00e35042e44f364109efe284b50COPY
tests/* /workspace/tests/
03/11/2026 1:58 PM UTC
sha256:8b7fef05ace73077e497d027a78c8e9ee5b5d2e38c47cb8d9f0531a62c10aa62RUN
python -c "from nemo_evaluator.core.input import _copy_fdfs; _copy_fdfs('/opt/metadata/')"
03/11/2026 1:58 PM UTC
sha256:9a5561dcbc7b2f7d894aa5c943aab6b8f8e56f5607c52eb854d7cdb79de7580dRUN
pip install nvidia-bigcode-eval==${EVAL_WHEEL_VERSION} --no-cache-dir --index-url https://gitlab-ci-token:$(cat /run/secrets/ci_job_token)@${PKG_URL}
03/11/2026 1:57 PM UTC
sha256:aab089893611ae3b5f5757455ebc7f559989f5fc00136d82050a6b6b5ee1936aADD
https://raw.githubusercontent.com/nuprl/MultiPL-E/refs/heads/main/src/luaunit.lua /usr/local/share/lua/5.1/luaunit.lua
03/11/2026 1:57 PM UTC