NVIDIA
NVIDIA
NVIDIA BigCode-Evaluation-Harness
Container
NVIDIA
NVIDIA
NVIDIA BigCode-Evaluation-Harness

NVIDIA NeMo Evaluator-compatible container with BigCode-Evaluation-Harness support. Based on BigCode available at: https://github.com/bigcode-project/bigcode-evaluation-harness

LayerLabelCreated
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4LABEL
org.opencontainers.image.licenses=3rd_party_licenses.txt
03/12/2026 9:48 AM UTC
sha256:b0a296dc993a16181140c96551306f37c29757b778c76ed568bcaeb9f53cd7d7COPY
README.md README.md
03/12/2026 9:48 AM UTC
sha256:c83e19a2bd78df23f51bfd195f3d4265731fe66d62eb8e6e5ea253caff35a602COPY
3rd_party_licenses.txt .
03/12/2026 9:48 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
README_FILE=README.md
03/12/2026 9:48 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
THIRD_PARTY_LICENSES_FILE=3rd_party_licenses.txt
03/12/2026 9:48 AM UTC
sha256:7aacb5fea4603c96890d9c64e0d227321ed27f3786a2a63b0ec027dcf2c163efRUN
pip uninstall -y nemo-evaluator-internal
03/12/2026 9:48 AM UTC
sha256:705c45f1dcb5d79938b4933cb7802c229bfda00e35042e44f364109efe284b50COPY
tests/* /workspace/tests/
03/11/2026 1:58 PM UTC
sha256:8b7fef05ace73077e497d027a78c8e9ee5b5d2e38c47cb8d9f0531a62c10aa62RUN
python -c "from nemo_evaluator.core.input import _copy_fdfs; _copy_fdfs('/opt/metadata/')"
03/11/2026 1:58 PM UTC
sha256:9a5561dcbc7b2f7d894aa5c943aab6b8f8e56f5607c52eb854d7cdb79de7580dRUN
pip install nvidia-bigcode-eval==${EVAL_WHEEL_VERSION} --no-cache-dir --index-url https://gitlab-ci-token:$(cat /run/secrets/ci_job_token)@${PKG_URL}
03/11/2026 1:57 PM UTC
sha256:aab089893611ae3b5f5757455ebc7f559989f5fc00136d82050a6b6b5ee1936aADD
https://raw.githubusercontent.com/nuprl/MultiPL-E/refs/heads/main/src/luaunit.lua /usr/local/share/lua/5.1/luaunit.lua
03/11/2026 1:57 PM UTC

NVIDIA uses cookies to improve your experience on our web site. We and our third-party partners also use cookies and other tools to collect and record information you provide as well as information about your interactions with our websites for performance improvement, analytics, and to assist in marketing efforts. By clicking "Accept All", you consent to our use of cookies and other tools as described in our Cookie Policy. You can manage your cookie settings by clicking on "Manage Settings." By continuing to use this site or by clicking one of the buttons below, you agree to our Terms of Service (which contains important waivers). Please see our Privacy Policy for more information on our privacy practices.