NVIDIA
NVIDIA
NVIDIA compute-eval
Container
NVIDIA
NVIDIA
NVIDIA compute-eval

NVIDIA NeMo Evaluator-compatible container with compute-eval support. Based on compute-eval available at: https://github.com/NVIDIA/compute-eval

LayerLabelCreated
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4LABEL
org.opencontainers.image.licenses=3rd_party_licenses.txt
10/30/2025 11:57 AM UTC
sha256:0f70bd57d69bc7e66a13f820f9a4c3b254f4de314e69d614de60892556e66d7bCOPY
README.md README.md
10/30/2025 11:57 AM UTC
sha256:36f9e98d909bd83dd20156c0eb10bd9bb5c96b2e5a96ec63149d712cc35f7f57COPY
3rd_party_licenses.txt .
10/30/2025 11:57 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
README_FILE=README.md
10/30/2025 11:57 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
THIRD_PARTY_LICENSES_FILE=3rd_party_licenses.txt
10/30/2025 11:57 AM UTC
sha256:2ddf17ce3af6560e12b0c10f82788e31b4134d2a509c561d82187e97ea3bcfbeRUN
pip uninstall -y nemo-evaluator-internal
10/30/2025 11:57 AM UTC
sha256:057589919b38c1965b6195a6e834d516f00909144ef497c1411ae74002774dd0COPY
tests/* /workspace/tests/
10/29/2025 8:21 PM UTC
sha256:f465d917ebcce2854d2ece695d341331a29dcef3d75a8ce55cba3015533568abRUN
CI_COMMIT_SHA=fc8906b9f7ea5881368f032ca1cb4f119bd513a6 EVAL_WHEEL_VERSION=25.10 PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple NEMO_EVALUATOR_VERSION=latest NEMO_EVALUATOR_INTERNAL_VERSION=latest pip install nvidia-compute-eval==${EVAL_WHEEL_VERSION} --no-cache-dir --index-url https://gitlab-ci-token:$(cat /run/secrets/ci_job_token)@${PKG_URL}
10/29/2025 8:21 PM UTC
sha256:b50e27a785aac8988461d3bc755511cfee6649f9eba31bae1d97aa777100926cRUN
CI_COMMIT_SHA=fc8906b9f7ea5881368f032ca1cb4f119bd513a6 EVAL_WHEEL_VERSION=25.10 PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple NEMO_EVALUATOR_VERSION=latest NEMO_EVALUATOR_INTERNAL_VERSION=latest if [ "$NEMO_EVALUATOR_INTERNAL_VERSION" = "latest" ]; then pip install "nemo-evaluator-internal" --no-cache-dir --extra-index-url https://urm.nvidia.com/artifactory/api/pypi/nv-shared-pypi-local/simple --extra-index-url https://gitlab-ci-token:$(cat /run/secrets/ci_job_token)@gitlab-master.nvidia.com/api/v4/projects/187766/packages/pypi/simple --extra-index-url https://gitlab-ci-token:$(cat /run/secrets/ci_job_token)@gitlab-master.nvidia.com/api/v4/projects/170048/packages/pypi/simple; else pip install "nemo-evaluator-internal==$NEMO_EVALUATOR_INTERNAL_VERSION" --no-cache-dir --extra-index-url https://urm.nvidia.com/artifactory/api/pypi/nv-shared-pypi-local/simple --extra-index-url https://gitlab-ci-token:$(cat /run/secrets/ci_job_token)@gitlab-master.nvidia.com/api/v4/projects/187766/packages/pypi/simple --extra-index-url https://gitlab-ci-token:$(cat /run/secrets/ci_job_token)@gitlab-master.nvidia.com/api/v4/projects/170048/packages/pypi/simple; fi
10/29/2025 8:21 PM UTC
sha256:c039a0544369a37e0246c48d3ee93d7dd5298cf4c0d653b6bd378c2a611cfe90RUN
CI_COMMIT_SHA=fc8906b9f7ea5881368f032ca1cb4f119bd513a6 EVAL_WHEEL_VERSION=25.10 PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple NEMO_EVALUATOR_VERSION=latest NEMO_EVALUATOR_INTERNAL_VERSION=latest if [ "$NEMO_EVALUATOR_VERSION" = "latest" ]; then pip install "nemo-evaluator" --no-cache-dir --extra-index-url https://urm.nvidia.com/artifactory/api/pypi/nv-shared-pypi-local/simple --extra-index-url https://gitlab-ci-token:$(cat /run/secrets/ci_job_token)@gitlab-master.nvidia.com/api/v4/projects/187766/packages/pypi/simple --extra-index-url https://gitlab-ci-token:$(cat /run/secrets/ci_job_token)@gitlab-master.nvidia.com/api/v4/projects/170048/packages/pypi/simple; else pip install "nemo-evaluator==$NEMO_EVALUATOR_VERSION" --no-cache-dir --extra-index-url https://urm.nvidia.com/artifactory/api/pypi/nv-shared-pypi-local/simple --extra-index-url https://gitlab-ci-token:$(cat /run/secrets/ci_job_token)@gitlab-master.nvidia.com/api/v4/projects/187766/packages/pypi/simple --extra-index-url https://gitlab-ci-token:$(cat /run/secrets/ci_job_token)@gitlab-master.nvidia.com/api/v4/projects/170048/packages/pypi/simple; fi
10/29/2025 8:21 PM UTC
...