NVIDIA
NVIDIA
NVIDIA helm
Container
NVIDIA
NVIDIA
NVIDIA helm

NVIDIA NeMo Evaluator-compatible container with CRFM Helm support. Based on the Stanford CRFM HELM available at: https://github.com/stanford-crfm/helm

LayerLabelCreated
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4LABEL
org.opencontainers.image.licenses=3rd_party_licenses.txt
10/22/2025 8:13 PM UTC
sha256:e80333662765bd5afc4c7449ec80d82b1353e2fe498d0a166450a537b83b3d45COPY
README.md README.md
10/22/2025 8:13 PM UTC
sha256:7b62a70a268e4da97f15de38b2c100b46f8ebe88e2f22692687e2a9697b7957aCOPY
3rd_party_licenses.txt .
10/22/2025 8:13 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
README_FILE=README.md
10/22/2025 8:13 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
THIRD_PARTY_LICENSES_FILE=3rd_party_licenses.txt
10/22/2025 8:13 PM UTC
sha256:9be57abbf2a119d3c6df257af5355602cef1b428c3680297bd06c2c49d88f990RUN
pip uninstall -y nemo-evaluator-internal
10/22/2025 8:12 PM UTC
sha256:1fc070747b0c06a190d50beee31b7ac49798201b62f47dc394fe4a2bf616292cCOPY
tests/* /workspace/tests/
10/21/2025 3:19 PM UTC
sha256:dc515f002f2aa69228f88e846fca51f0a61edd43cd79b692f33415971d93d853RUN
CI_COMMIT_SHA=642726ffc068518ea874f9183393464458b3cdcb EVAL_WHEEL_VERSION=25.09.1 PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple pip install "nvidia-crfm-helm[openai,medhelm]==${EVAL_WHEEL_VERSION}" --no-cache-dir --index-url https://gitlab-ci-token:$(cat /run/secrets/ci_job_token)@${PKG_URL} --extra-index-url https://pypi.org/simple &&
  pip install summ-eval --no-deps --no-cache-dir
10/21/2025 3:19 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple
10/21/2025 3:19 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
EVAL_WHEEL_VERSION=25.09.1
10/21/2025 3:19 PM UTC