NVIDIA
NVIDIA
NVIDIA helm
Container
NVIDIA
NVIDIA
NVIDIA helm

NVIDIA NeMo Evaluator-compatible container with CRFM Helm support. Based on the Stanford CRFM HELM available at: https://github.com/stanford-crfm/helm

  • LayerLabelCreated
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4LABEL
    org.opencontainers.image.licenses=3rd_party_licenses.txt
    12/02/2025 3:54 PM UTC
    sha256:8ba578b32927f3f15ce0ea34391299e1f7b08365df035a48952c21ebf7dbef10COPY
    README.md README.md
    12/02/2025 3:54 PM UTC
    sha256:907c4548f154259b105aa451eb4d178eac99fad0fb817c2ca28a2a56de728078COPY
    3rd_party_licenses.txt .
    12/02/2025 3:54 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
    README_FILE=README.md
    12/02/2025 3:54 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
    THIRD_PARTY_LICENSES_FILE=3rd_party_licenses.txt
    12/02/2025 3:54 PM UTC
    sha256:7f242399576e55cf51162a7316a668cd446ca8caeb804d8736b3d43c2ad1fa0bRUN
    pip uninstall -y nemo-evaluator-internal
    12/02/2025 3:54 PM UTC
    sha256:88d15f59f63c7bb89147ccb3d86ff12926a10890606a095c9155b9e9ec67869fCOPY
    tests/* /workspace/tests/
    12/01/2025 1:30 PM UTC
    sha256:33c73992e342afac58be18eaa45673a11e7e9ebec25b88a071c6ba0d103d81b5RUN
    CI_COMMIT_SHA=1c7c8d973b2696c49382b89e5f56646c9c194f0a EVAL_WHEEL_VERSION=25.11 PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple python -c "from nemo_evaluator.core.input import _copy_fdfs; _copy_fdfs('/opt/metadata/')"
    12/01/2025 1:30 PM UTC
    sha256:36cb0cf98cabe84681087e4d85d4acf5673a3c9718c64a9929ab4f4307252ab4RUN
    CI_COMMIT_SHA=1c7c8d973b2696c49382b89e5f56646c9c194f0a EVAL_WHEEL_VERSION=25.11 PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple pip install "nvidia-crfm-helm[openai,medhelm]==${EVAL_WHEEL_VERSION}" --no-cache-dir --index-url https://gitlab-ci-token:$(cat /run/secrets/ci_job_token)@${PKG_URL} --extra-index-url https://pypi.org/simple &&
      pip install summ-eval --no-deps --no-cache-dir
    12/01/2025 1:30 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
    PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple
    12/01/2025 1:30 PM UTC