NVIDIA
NVIDIA
NVIDIA BigCode-Evaluation-Harness
Container
NVIDIA
NVIDIA
NVIDIA BigCode-Evaluation-Harness

NVIDIA NeMo Evaluator-compatible container with BigCode-Evaluation-Harness support. Based on BigCode available at: https://github.com/bigcode-project/bigcode-evaluation-harness

  • LayerLabelCreated
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4LABEL
    org.opencontainers.image.licenses=3rd_party_licenses.txt
    08/04/2025 3:00 PM UTC
    sha256:f3609ad88741753eb454e03caf5d077d8a09df589df6fbd507f8d314660d5743COPY
    3rd_party_licenses.txt .
    08/04/2025 3:00 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
    THIRD_PARTY_LICENSES_FILE=3rd_party_licenses.txt
    08/04/2025 3:00 PM UTC
    sha256:bc42987eb343bd0dbe9f4a206470091ae77d6abdbbc352567abbb110f6b2b9aeRUN
    pip uninstall -y nvidia-eval-commons-internal
    08/04/2025 3:00 PM UTC
    sha256:945f6b2bd16a8e0c3d12ecd77addc53cbac0b0bd5f022496eb26866043e40031COPY
    --chown=1000:1000 --chmod=777 tests/* /workspace/tests/
    08/04/2025 1:44 PM UTC
    sha256:59eedbd12e8efcd56897cdf21a28cd9f6900968ef6ae2c2e0ee38422ff79329bCOPY
    tests/* /workspace/tests/
    08/04/2025 1:44 PM UTC
    sha256:edae7c5774c93a0fcf45787ac82883ea8512b5461e94867e2d2dfa47a0a2558cRUN
    CI_COMMIT_SHA=360de12fe9a031dd0475ee807b1f04531e9917cb EVAL_WHEEL_VERSION=25.07.1 PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple printf '#!/bin/bash\ncore-evals-bigcode "$@"' > /usr/bin/nv-eval &&
      chmod +x /usr/bin/nv-eval &&
      printf '#!/bin/bash\ncore-evals-bigcode "$@"' > /usr/bin/nv_eval &&
      chmod +x /usr/bin/nv_eval
    08/04/2025 1:44 PM UTC
    sha256:17452f13777ae1e00f54bb90db6602f0248ec7ed24b78b22f470a66023ef4499RUN
    CI_COMMIT_SHA=360de12fe9a031dd0475ee807b1f04531e9917cb EVAL_WHEEL_VERSION=25.07.1 PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple pip install nvidia-bigcode-eval==${EVAL_WHEEL_VERSION} --no-cache-dir --index-url https://gitlab-ci-token:$(cat /run/secrets/ci_job_token)@${PKG_URL}
    08/04/2025 1:44 PM UTC
    sha256:77662f0960b03121f2116b3a9b9219494202fa0a35d51e731aaacde51606aaebADD
    https://raw.githubusercontent.com/nuprl/MultiPL-E/refs/heads/main/src/luaunit.lua /usr/local/share/lua/5.1/luaunit.lua
    08/04/2025 1:44 PM UTC
    sha256:fe0a033c9856cf332c3901e8901cc6f01cc78e9187d01748d14cf6b1455ed330RUN
    CI_COMMIT_SHA=360de12fe9a031dd0475ee807b1f04531e9917cb EVAL_WHEEL_VERSION=25.07.1 PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple ln -sv /usr/bin/mcs /usr/bin/csc
    08/04/2025 1:44 PM UTC