NVIDIA
NVIDIA
NVIDIA BigCode-Evaluation-Harness
Container
NVIDIA
NVIDIA
NVIDIA BigCode-Evaluation-Harness

NVIDIA NeMo Evaluator-compatible container with BigCode-Evaluation-Harness support. Based on BigCode available at: https://github.com/bigcode-project/bigcode-evaluation-harness

LayerLabelCreated
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4LABEL
org.opencontainers.image.licenses=3rd_party_licenses.txt
09/16/2025 6:04 AM UTC
sha256:fb2dc3438b4854e9bb6a38244fdd9ed99d46b65c97d6a28d344e25473c159d69COPY
README.md README.md
09/16/2025 6:04 AM UTC
sha256:01553faa2ba022f2514c9a8b83e6e31b69e25db2218541aaed44922f7b957220COPY
3rd_party_licenses.txt .
09/16/2025 6:04 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
README_FILE=README.md
09/16/2025 6:04 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
THIRD_PARTY_LICENSES_FILE=3rd_party_licenses.txt
09/16/2025 6:04 AM UTC
sha256:96a027a892c7018a8df5df56ab7c332dc824d752259866e81b5eca955f35d050RUN
pip uninstall -y nvidia-eval-commons-internal
09/16/2025 6:04 AM UTC
sha256:52ac0fc532cf02f12366cc931b2639c96724c974ee2d292c24bacd948e2a358dCOPY
--chmod=777 tests/* /workspace/tests/
09/15/2025 4:29 PM UTC
sha256:1f7a6ff7a88ecae417ee40149fcfbd2920aa156d8f91583a53b9209528d50f4bRUN
CI_COMMIT_SHA=001b448ca8a445a7688a02ec1a7aa7424613e7b7 EVAL_WHEEL_VERSION=25.08.1 PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple printf '#!/bin/bash\ncore-evals-bigcode "$@"' > /usr/bin/nv-eval &&
  chmod +x /usr/bin/nv-eval &&
  printf '#!/bin/bash\ncore-evals-bigcode "$@"' > /usr/bin/nv_eval &&
  chmod +x /usr/bin/nv_eval &&
  mkdir -p /workspace/tests
09/15/2025 4:29 PM UTC
sha256:6292ef5c765b77b44d5c4b8b8f895f2612c27b45007d8c0b33f76900c27e741fRUN
CI_COMMIT_SHA=001b448ca8a445a7688a02ec1a7aa7424613e7b7 EVAL_WHEEL_VERSION=25.08.1 PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple pip install nvidia-bigcode-eval==${EVAL_WHEEL_VERSION} --no-cache-dir --index-url https://gitlab-ci-token:$(cat /run/secrets/ci_job_token)@${PKG_URL}
09/15/2025 4:29 PM UTC
sha256:4609ed40a955769c510b755015f731fbad5ed4814ef4e1d64a609e691657a90bADD
https://raw.githubusercontent.com/nuprl/MultiPL-E/refs/heads/main/src/luaunit.lua /usr/local/share/lua/5.1/luaunit.lua
09/15/2025 4:29 PM UTC