NVIDIA
NVIDIA
NVIDIA compute-eval
Container
NVIDIA
NVIDIA
NVIDIA compute-eval

NVIDIA NeMo Evaluator-compatible container with compute-eval support. Based on compute-eval available at: https://github.com/NVIDIA/compute-eval

LayerLabelCreated
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4LABEL
org.opencontainers.image.licenses=3rd_party_licenses.txt
03/12/2026 10:25 AM UTC
sha256:c39e52eb681be94555c36df48faf3fdc363d2d6501f8a9150fd9f2d7f17c3accCOPY
README.md README.md
03/12/2026 10:25 AM UTC
sha256:467bca5eb0f02f049eba7eb618df599942b0f242276b47782055d18c3cea61deCOPY
3rd_party_licenses.txt .
03/12/2026 10:25 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
README_FILE=README.md
03/12/2026 10:25 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
THIRD_PARTY_LICENSES_FILE=3rd_party_licenses.txt
03/12/2026 10:25 AM UTC
sha256:5b36491e0577bdbb3838ab051e7b40cd4045896f8eabff395b3be57d6573f545RUN
pip uninstall -y nemo-evaluator-internal
03/12/2026 10:25 AM UTC
sha256:9e5eee96d5df07159227f64f6c73078b2ec4148ac3fefd15ef9f7d89bd1f63d2COPY
tests/* /workspace/tests/
03/11/2026 1:57 PM UTC
sha256:4c73d7f32a80c5be43dcaf3cc30380b7c4fdd15d2262583ae0ceb4729ad8c2e9RUN
CI_COMMIT_SHA=83a6bbd46e65be5bceb13b920aa2f90dd73ec155 EVAL_WHEEL_VERSION=26.03 PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple NEMO_EVALUATOR_VERSION=latest NEMO_EVALUATOR_INTERNAL_VERSION=latest python -c "from nemo_evaluator.core.input import _copy_fdfs; _copy_fdfs('/opt/metadata/')"
03/11/2026 1:57 PM UTC
sha256:7277281071e51261a332927f4eed9a14d799300c67dede93d347800a10f47d0dRUN
CI_COMMIT_SHA=83a6bbd46e65be5bceb13b920aa2f90dd73ec155 EVAL_WHEEL_VERSION=26.03 PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple NEMO_EVALUATOR_VERSION=latest NEMO_EVALUATOR_INTERNAL_VERSION=latest pip install nvidia-compute-eval==${EVAL_WHEEL_VERSION} --no-cache-dir --index-url https://gitlab-ci-token:$(cat /run/secrets/ci_job_token)@${PKG_URL}
03/11/2026 1:57 PM UTC
sha256:cc97cad50ea47112f2f382c85d339f7479b7492e42cae5b6887031e3b3ac6a46RUN
CI_COMMIT_SHA=83a6bbd46e65be5bceb13b920aa2f90dd73ec155 EVAL_WHEEL_VERSION=26.03 PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple NEMO_EVALUATOR_VERSION=latest NEMO_EVALUATOR_INTERNAL_VERSION=latest if [ "$NEMO_EVALUATOR_INTERNAL_VERSION" = "latest" ]; then pip install "nemo-evaluator-internal" --no-cache-dir --extra-index-url https://urm.nvidia.com/artifactory/api/pypi/nv-shared-pypi-local/simple --extra-index-url https://gitlab-ci-token:$(cat /run/secrets/ci_job_token)@gitlab-master.nvidia.com/api/v4/projects/187766/packages/pypi/simple --extra-index-url https://gitlab-ci-token:$(cat /run/secrets/ci_job_token)@gitlab-master.nvidia.com/api/v4/projects/170048/packages/pypi/simple; else pip install "nemo-evaluator-internal==$NEMO_EVALUATOR_INTERNAL_VERSION" --no-cache-dir --extra-index-url https://urm.nvidia.com/artifactory/api/pypi/nv-shared-pypi-local/simple --extra-index-url https://gitlab-ci-token:$(cat /run/secrets/ci_job_token)@gitlab-master.nvidia.com/api/v4/projects/187766/packages/pypi/simple --extra-index-url https://gitlab-ci-token:$(cat /run/secrets/ci_job_token)@gitlab-master.nvidia.com/api/v4/projects/170048/packages/pypi/simple; fi
03/11/2026 1:57 PM UTC
...