NVIDIA
NVIDIA
NVIDIA compute-eval
Container
NVIDIA
NVIDIA
NVIDIA compute-eval

NVIDIA NeMo Evaluator-compatible container with compute-eval support. Based on compute-eval available at: https://github.com/NVIDIA/compute-eval

LayerLabelCreated
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4LABEL
org.opencontainers.image.licenses=3rd_party_licenses.txt
09/30/2025 9:51 AM UTC
sha256:7b170c352bc39ca0bbc155c4fa5cbe5534fa99f91d7a1053b2692ef445594d83COPY
README.md README.md
09/30/2025 9:51 AM UTC
sha256:d6553851ddc96edc99f2d100554f11e74da438903e8dd760c7fc61263b8f16dfCOPY
3rd_party_licenses.txt .
09/30/2025 9:51 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
README_FILE=README.md
09/30/2025 9:51 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
THIRD_PARTY_LICENSES_FILE=3rd_party_licenses.txt
09/30/2025 9:51 AM UTC
sha256:b453df9039f35369206440f51a82f48df1fe778375e1b0ab1157238164c2999dRUN
pip uninstall -y nemo-evaluator-internal
09/30/2025 9:51 AM UTC
sha256:021b910a54a860645b96d1d09d7d2ccf6ec551f5bb599cdf2f4fbed886d24655COPY
tests/* /workspace/tests/
09/29/2025 9:28 AM UTC
sha256:9f70c41f93811e1fd098fd48cb556a063812a492d1dbe48302810530a9912ffdRUN
CI_COMMIT_SHA=26bc7c0fca30c8fcc72e3f1fa7127f95824d2c6d EVAL_WHEEL_VERSION=25.09 PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple NEMO_EVALUATOR_VERSION=latest NEMO_EVALUATOR_INTERNAL_VERSION=latest pip install nvidia-compute-eval==${EVAL_WHEEL_VERSION} --no-cache-dir --index-url https://gitlab-ci-token:$(cat /run/secrets/ci_job_token)@${PKG_URL}
09/29/2025 9:28 AM UTC
sha256:3e527c2526a0832ae83fca63af9e332c453cfca6b2510b8265c585f06fc8b4bcRUN
CI_COMMIT_SHA=26bc7c0fca30c8fcc72e3f1fa7127f95824d2c6d EVAL_WHEEL_VERSION=25.09 PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple NEMO_EVALUATOR_VERSION=latest NEMO_EVALUATOR_INTERNAL_VERSION=latest if [ "$NEMO_EVALUATOR_INTERNAL_VERSION" = "latest" ]; then pip install "nemo-evaluator-internal" --no-cache-dir --extra-index-url https://urm.nvidia.com/artifactory/api/pypi/nv-shared-pypi-local/simple --extra-index-url https://gitlab-ci-token:$(cat /run/secrets/ci_job_token)@gitlab-master.nvidia.com/api/v4/projects/187766/packages/pypi/simple --extra-index-url https://gitlab-ci-token:$(cat /run/secrets/ci_job_token)@gitlab-master.nvidia.com/api/v4/projects/170048/packages/pypi/simple; else pip install "nemo-evaluator-internal==$NEMO_EVALUATOR_INTERNAL_VERSION" --no-cache-dir --extra-index-url https://urm.nvidia.com/artifactory/api/pypi/nv-shared-pypi-local/simple --extra-index-url https://gitlab-ci-token:$(cat /run/secrets/ci_job_token)@gitlab-master.nvidia.com/api/v4/projects/187766/packages/pypi/simple --extra-index-url https://gitlab-ci-token:$(cat /run/secrets/ci_job_token)@gitlab-master.nvidia.com/api/v4/projects/170048/packages/pypi/simple; fi
09/29/2025 9:28 AM UTC
sha256:32c5caeb4d23e7898f4f18346c6acc73e12754f4df6fcc4270ee073e32971554RUN
CI_COMMIT_SHA=26bc7c0fca30c8fcc72e3f1fa7127f95824d2c6d EVAL_WHEEL_VERSION=25.09 PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple NEMO_EVALUATOR_VERSION=latest NEMO_EVALUATOR_INTERNAL_VERSION=latest if [ "$NEMO_EVALUATOR_VERSION" = "latest" ]; then pip install "nemo-evaluator" --no-cache-dir --extra-index-url https://urm.nvidia.com/artifactory/api/pypi/nv-shared-pypi-local/simple --extra-index-url https://gitlab-ci-token:$(cat /run/secrets/ci_job_token)@gitlab-master.nvidia.com/api/v4/projects/187766/packages/pypi/simple --extra-index-url https://gitlab-ci-token:$(cat /run/secrets/ci_job_token)@gitlab-master.nvidia.com/api/v4/projects/170048/packages/pypi/simple; else pip install "nemo-evaluator==$NEMO_EVALUATOR_VERSION" --no-cache-dir --extra-index-url https://urm.nvidia.com/artifactory/api/pypi/nv-shared-pypi-local/simple --extra-index-url https://gitlab-ci-token:$(cat /run/secrets/ci_job_token)@gitlab-master.nvidia.com/api/v4/projects/187766/packages/pypi/simple --extra-index-url https://gitlab-ci-token:$(cat /run/secrets/ci_job_token)@gitlab-master.nvidia.com/api/v4/projects/170048/packages/pypi/simple; fi
09/29/2025 9:28 AM UTC
...