NVIDIA
NVIDIA
NVIDIA compute-eval
Container
NVIDIA
NVIDIA
NVIDIA compute-eval

NVIDIA NeMo Evaluator-compatible container with compute-eval support. Based on compute-eval available at: https://github.com/NVIDIA/compute-eval

LayerLabelCreated
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4LABEL
org.opencontainers.image.licenses=3rd_party_licenses.txt
12/02/2025 3:52 PM UTC
sha256:b09b35d9575a3940a0d1edea6b859dff7dffe298a8abbbbdf0d1ee2ef99867e4COPY
README.md README.md
12/02/2025 3:52 PM UTC
sha256:4cda52e675218a551c10dcae43db60640aec342af7dda2899ebdc5b35b79d940COPY
3rd_party_licenses.txt .
12/02/2025 3:52 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
README_FILE=README.md
12/02/2025 3:52 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
THIRD_PARTY_LICENSES_FILE=3rd_party_licenses.txt
12/02/2025 3:52 PM UTC
sha256:21fdfdccef96f666dab231b06da20b0f53eb39ec8897b714bdf22a7a53a940dfRUN
pip uninstall -y nemo-evaluator-internal
12/02/2025 3:52 PM UTC
sha256:0ea8f097936cdc58f8634f29f3907e10395928604b13a54fbac42833a2519167COPY
tests/* /workspace/tests/
12/01/2025 1:26 PM UTC
sha256:9f0e01787214503b39a5ce0ec5260ae85346fa956ce783dedbb2d55a62fdc153RUN
CI_COMMIT_SHA=1c7c8d973b2696c49382b89e5f56646c9c194f0a EVAL_WHEEL_VERSION=25.11 PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple NEMO_EVALUATOR_VERSION=latest NEMO_EVALUATOR_INTERNAL_VERSION=latest python -c "from nemo_evaluator.core.input import _copy_fdfs; _copy_fdfs('/opt/metadata/')"
12/01/2025 1:26 PM UTC
sha256:807038417214e3f8120d68dd15a74e48686b8f1911294ccb591501ea7a7da17fRUN
CI_COMMIT_SHA=1c7c8d973b2696c49382b89e5f56646c9c194f0a EVAL_WHEEL_VERSION=25.11 PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple NEMO_EVALUATOR_VERSION=latest NEMO_EVALUATOR_INTERNAL_VERSION=latest pip install nvidia-compute-eval==${EVAL_WHEEL_VERSION} --no-cache-dir --index-url https://gitlab-ci-token:$(cat /run/secrets/ci_job_token)@${PKG_URL}
12/01/2025 1:26 PM UTC
sha256:4d6edd6e0424891e012f967af5f039d9b749c4eee9ffc471b6af1e27f436ac78RUN
CI_COMMIT_SHA=1c7c8d973b2696c49382b89e5f56646c9c194f0a EVAL_WHEEL_VERSION=25.11 PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple NEMO_EVALUATOR_VERSION=latest NEMO_EVALUATOR_INTERNAL_VERSION=latest if [ "$NEMO_EVALUATOR_INTERNAL_VERSION" = "latest" ]; then pip install "nemo-evaluator-internal" --no-cache-dir --extra-index-url https://urm.nvidia.com/artifactory/api/pypi/nv-shared-pypi-local/simple --extra-index-url https://gitlab-ci-token:$(cat /run/secrets/ci_job_token)@gitlab-master.nvidia.com/api/v4/projects/187766/packages/pypi/simple --extra-index-url https://gitlab-ci-token:$(cat /run/secrets/ci_job_token)@gitlab-master.nvidia.com/api/v4/projects/170048/packages/pypi/simple; else pip install "nemo-evaluator-internal==$NEMO_EVALUATOR_INTERNAL_VERSION" --no-cache-dir --extra-index-url https://urm.nvidia.com/artifactory/api/pypi/nv-shared-pypi-local/simple --extra-index-url https://gitlab-ci-token:$(cat /run/secrets/ci_job_token)@gitlab-master.nvidia.com/api/v4/projects/187766/packages/pypi/simple --extra-index-url https://gitlab-ci-token:$(cat /run/secrets/ci_job_token)@gitlab-master.nvidia.com/api/v4/projects/170048/packages/pypi/simple; fi
12/01/2025 1:25 PM UTC
...