NVIDIA
NVIDIA
NVIDIA compute-eval
Container
NVIDIA
NVIDIA
NVIDIA compute-eval

NVIDIA NeMo Evaluator-compatible container with compute-eval support. Based on compute-eval available at: https://github.com/NVIDIA/compute-eval

LayerLabelCreated
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4LABEL
org.opencontainers.image.licenses=3rd_party_licenses.txt
01/30/2026 2:48 PM UTC
sha256:c8e2aa05a3dd9753e30d2093c06ac6184f954fe619af9d48ab7162b83fcdda19COPY
README.md README.md
01/30/2026 2:48 PM UTC
sha256:b693cd2f32953b5abeb164c826dcdeee80401c08c85aba9aa4b60b79323311d9COPY
3rd_party_licenses.txt .
01/30/2026 2:48 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
README_FILE=README.md
01/30/2026 2:48 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
THIRD_PARTY_LICENSES_FILE=3rd_party_licenses.txt
01/30/2026 2:48 PM UTC
sha256:ced97d1ea61b4b1ce85934013a042fced1536f07d373ff02a2eac3d285a94d5bRUN
pip uninstall -y nemo-evaluator-internal
01/30/2026 2:48 PM UTC
sha256:61b9fa2962c84c2628486d2430a88f83830bba7465e397af4dacb177f5785fd4COPY
tests/* /workspace/tests/
01/30/2026 9:24 AM UTC
sha256:7e40217632e54386517c6d74241a428a1dec56f5f4d74eb8919efa3dd6049777RUN
CI_COMMIT_SHA=b8adb3c3d0bcfec37f39346c4407363ef2dde954 EVAL_WHEEL_VERSION=26.01 PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple NEMO_EVALUATOR_VERSION=latest NEMO_EVALUATOR_INTERNAL_VERSION=latest python -c "from nemo_evaluator.core.input import _copy_fdfs; _copy_fdfs('/opt/metadata/')"
01/30/2026 9:24 AM UTC
sha256:22827d06e88cc212223007464cf20e9b46fc3f1161a219e8ad8cf4ca904edcc2RUN
CI_COMMIT_SHA=b8adb3c3d0bcfec37f39346c4407363ef2dde954 EVAL_WHEEL_VERSION=26.01 PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple NEMO_EVALUATOR_VERSION=latest NEMO_EVALUATOR_INTERNAL_VERSION=latest pip install nvidia-compute-eval==${EVAL_WHEEL_VERSION} --no-cache-dir --index-url https://gitlab-ci-token:$(cat /run/secrets/ci_job_token)@${PKG_URL}
01/30/2026 9:24 AM UTC
sha256:85578667c4168886757f168f1dd6a88c3beadd2217bdeb7b48bdf06f6f30ea5fRUN
CI_COMMIT_SHA=b8adb3c3d0bcfec37f39346c4407363ef2dde954 EVAL_WHEEL_VERSION=26.01 PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple NEMO_EVALUATOR_VERSION=latest NEMO_EVALUATOR_INTERNAL_VERSION=latest if [ "$NEMO_EVALUATOR_INTERNAL_VERSION" = "latest" ]; then pip install "nemo-evaluator-internal" --no-cache-dir --extra-index-url https://urm.nvidia.com/artifactory/api/pypi/nv-shared-pypi-local/simple --extra-index-url https://gitlab-ci-token:$(cat /run/secrets/ci_job_token)@gitlab-master.nvidia.com/api/v4/projects/187766/packages/pypi/simple --extra-index-url https://gitlab-ci-token:$(cat /run/secrets/ci_job_token)@gitlab-master.nvidia.com/api/v4/projects/170048/packages/pypi/simple; else pip install "nemo-evaluator-internal==$NEMO_EVALUATOR_INTERNAL_VERSION" --no-cache-dir --extra-index-url https://urm.nvidia.com/artifactory/api/pypi/nv-shared-pypi-local/simple --extra-index-url https://gitlab-ci-token:$(cat /run/secrets/ci_job_token)@gitlab-master.nvidia.com/api/v4/projects/187766/packages/pypi/simple --extra-index-url https://gitlab-ci-token:$(cat /run/secrets/ci_job_token)@gitlab-master.nvidia.com/api/v4/projects/170048/packages/pypi/simple; fi
01/30/2026 9:24 AM UTC
...