NVIDIA
NVIDIA
NVIDIA BigCode-Evaluation-Harness
Container
NVIDIA
NVIDIA
NVIDIA BigCode-Evaluation-Harness

NVIDIA NeMo Evaluator-compatible container with BigCode-Evaluation-Harness support. Based on BigCode available at: https://github.com/bigcode-project/bigcode-evaluation-harness

  • LayerLabelCreated
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4LABEL
    org.opencontainers.image.licenses=3rd_party_licenses.txt
    10/30/2025 11:48 AM UTC
    sha256:07e20c0e554acb2484ab81e699c8396e501a20c31bd1faa4979a99d6bf885fb8COPY
    README.md README.md
    10/30/2025 11:48 AM UTC
    sha256:7702f28b913e105c69c289773cb43d32075f4f94d017ec2fbd9038ec044d0415COPY
    3rd_party_licenses.txt .
    10/30/2025 11:48 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
    README_FILE=README.md
    10/30/2025 11:48 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
    THIRD_PARTY_LICENSES_FILE=3rd_party_licenses.txt
    10/30/2025 11:48 AM UTC
    sha256:24179c11716ba57e915f18396f73cc0facdfcd80894340fb8696397e4f67cc16RUN
    pip uninstall -y nemo-evaluator-internal
    10/30/2025 11:48 AM UTC
    sha256:3e278bc08a64b76f74f96283e507f230e85b40c41234d70df1e9516c55076d9fCOPY
    --chmod=777 tests/* /workspace/tests/
    10/29/2025 8:21 PM UTC
    sha256:a683048fa03a1c75842aeb9fc6c1cce0a85e3a92a948341742ddae1042566a0cRUN
    CI_COMMIT_SHA=fc8906b9f7ea5881368f032ca1cb4f119bd513a6 EVAL_WHEEL_VERSION=25.10 PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple pip install nvidia-bigcode-eval==${EVAL_WHEEL_VERSION} --no-cache-dir --index-url https://gitlab-ci-token:$(cat /run/secrets/ci_job_token)@${PKG_URL}
    10/29/2025 8:21 PM UTC
    sha256:69583c9bbcfc58a50f326ca2d152f798d0050f16a69917eba65d69afee31fe84ADD
    https://raw.githubusercontent.com/nuprl/MultiPL-E/refs/heads/main/src/luaunit.lua /usr/local/share/lua/5.1/luaunit.lua
    10/29/2025 8:20 PM UTC
    sha256:ef5a9f38e4fc4e941accd1a1738cdbe779c36fe2c56bf97136c6de79248ddd4bRUN
    CI_COMMIT_SHA=fc8906b9f7ea5881368f032ca1cb4f119bd513a6 EVAL_WHEEL_VERSION=25.10 PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple ARCH=$(uname -m) &&
      case $ARCH in "aarch64") DMD_URL="https://downloads.dlang.org/releases/2.x/2.111.0/dmd_2.111.0-0_arm64.deb" &&
      JULIA_URL="https://julialang-s3.julialang.org/bin/linux/aarch64/1.6/julia-1.6.7-linux-aarch64.tar.gz" &&
      SWIFT_URL="https://download.swift.org/swift-6.1.2-release/ubuntu2404-aarch64/swift-6.1.2-RELEASE/swift-6.1.2-RELEASE-ubuntu24.04-aarch64.tar.gz" ;; *) DMD_URL="https://downloads.dlang.org/releases/2.x/2.111.0/dmd_2.111.0-0_amd64.deb" &&
      JULIA_URL="https://julialang-s3.julialang.org/bin/linux/x64/1.6/julia-1.6.7-linux-x86_64.tar.gz" &&
      SWIFT_URL="https://download.swift.org/swift-6.1.2-release/ubuntu2404/swift-6.1.2-RELEASE/swift-6.1.2-RELEASE-ubuntu24.04.tar.gz" ;; esac &&
      (wget -q "$DMD_URL" &&
      dpkg -i "$(basename "$DMD_URL")" &&
      rm "$(basename "$DMD_URL")") & (wget -q "$JULIA_URL" &&
      tar -xf "$(basename "$JULIA_URL")" -C /opt &&
      mv /opt/julia-* /opt/julia &&
      rm "$(basename "$JULIA_URL")" &&
      ln -sf /opt/julia/bin/julia /usr/bin/julia) & (wget -q "$SWIFT_URL" &&
      tar -xzf "$(basename "$SWIFT_URL")" -C /opt &&
      mv /opt/swift-* /opt/swift &&
      rm "$(basename "$SWIFT_URL")" &&
      ln -sf /opt/swift/usr/bin/swift /usr/bin/swift) & wait &&
      wget -q https://deb.nodesource.com/setup_18.x &&
      bash setup_18.x &&
      rm setup_18.x &&
      mkdir -p /usr/local/share/lua/5.1 &&
      ln -sv /usr/bin/mcs /usr/bin/csc
    10/29/2025 8:20 PM UTC