NVIDIA
NVIDIA
NVIDIA helm
Container
NVIDIA
NVIDIA
NVIDIA helm

NVIDIA NeMo Evaluator-compatible container with CRFM Helm support. Based on the Stanford CRFM HELM available at: https://github.com/stanford-crfm/helm

  • LayerLabelCreated
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4LABEL
    org.opencontainers.image.licenses=3rd_party_licenses.txt
    01/30/2026 2:50 PM UTC
    sha256:bdf9cfec627f6b542eb195d39d4b0308b564d940ab21ec4d52413c64c92bf4eeCOPY
    README.md README.md
    01/30/2026 2:50 PM UTC
    sha256:9efeb6752ffe97844e4eb9f9067c4192d0d13d2f532b20c6eae7f0c156f5ab46COPY
    3rd_party_licenses.txt .
    01/30/2026 2:50 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
    README_FILE=README.md
    01/30/2026 2:50 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
    THIRD_PARTY_LICENSES_FILE=3rd_party_licenses.txt
    01/30/2026 2:50 PM UTC
    sha256:b53260095432338367c11d7f03310e0f2ed73b014b48194c5d206ef7f780b3fbRUN
    pip uninstall -y nemo-evaluator-internal
    01/30/2026 2:50 PM UTC
    sha256:cd6b157cbc3e6c9104454e1680d05391796bbcb0fbd89fa9bb7bebbd4e2ae418COPY
    tests/* /workspace/tests/
    01/30/2026 9:25 AM UTC
    sha256:d9b01c04a3d42b9b580d5decc09637710727034a78728d9452526fa0e3ef74cfRUN
    CI_COMMIT_SHA=b8adb3c3d0bcfec37f39346c4407363ef2dde954 EVAL_WHEEL_VERSION=26.01 PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple python -c "from nemo_evaluator.core.input import _copy_fdfs; _copy_fdfs('/opt/metadata/')"
    01/30/2026 9:25 AM UTC
    sha256:87de16fbcf241c11318cd4ac551fa205104661a542fc7ab75fd93f3af78db58dRUN
    CI_COMMIT_SHA=b8adb3c3d0bcfec37f39346c4407363ef2dde954 EVAL_WHEEL_VERSION=26.01 PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple pip install "nvidia-crfm-helm[openai,medhelm]==${EVAL_WHEEL_VERSION}" --no-cache-dir --index-url https://gitlab-ci-token:$(cat /run/secrets/ci_job_token)@${PKG_URL} --extra-index-url https://pypi.org/simple &&
      pip install summ-eval --no-deps --no-cache-dir
    01/30/2026 9:25 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
    PKG_URL
    01/30/2026 9:25 AM UTC