NVIDIA
NVIDIA
NVIDIA helm
Container
NVIDIA
NVIDIA
NVIDIA helm

NVIDIA NeMo Evaluator-compatible container with CRFM Helm support. Based on the Stanford CRFM HELM available at: https://github.com/stanford-crfm/helm

LayerLabelCreated
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4LABEL
org.opencontainers.image.licenses=3rd_party_licenses.txt
09/30/2025 10:05 AM UTC
sha256:3969a3ca858928164e454a3868400fb60e683366f4db03e6b80b7fc6fae192f2COPY
README.md README.md
09/30/2025 10:05 AM UTC
sha256:4a7f1e61f6b6a09aa69e3ad2bec8c12a9f21dd738d29961b5310b654ceeca2f3COPY
3rd_party_licenses.txt .
09/30/2025 10:05 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
README_FILE=README.md
09/30/2025 10:05 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
THIRD_PARTY_LICENSES_FILE=3rd_party_licenses.txt
09/30/2025 10:05 AM UTC
sha256:6a58ffd247e7661e5fe4a1812224882dcd8da491c8fafa5bb09ff0ccdcd4f47eRUN
pip uninstall -y nemo-evaluator-internal
09/30/2025 10:05 AM UTC
sha256:93ed805448cbd0d98ad03c0138841a78d93a591f492f1957f7d15406153c870cCOPY
tests/* /workspace/tests/
09/29/2025 9:33 AM UTC
sha256:f6165f854f84e61b3443956aebdef4a54c88282beeea8e2ce45c233b62733e37RUN
CI_COMMIT_SHA=26bc7c0fca30c8fcc72e3f1fa7127f95824d2c6d EVAL_WHEEL_VERSION=25.09 PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple pip install "nvidia-crfm-helm[openai,medhelm]==${EVAL_WHEEL_VERSION}" --no-cache-dir --index-url https://gitlab-ci-token:$(cat /run/secrets/ci_job_token)@${PKG_URL} --extra-index-url https://pypi.org/simple &&
  pip install summ-eval --no-deps --no-cache-dir
09/29/2025 9:33 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple
09/29/2025 9:33 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
EVAL_WHEEL_VERSION=25.09
09/29/2025 9:33 AM UTC