NVIDIA
NVIDIA IFBench
Container
NVIDIA
NVIDIA IFBench

NVIDIA NeMo Evaluator-compatible container with IFBench support. Based on the IFBench available at: https://github.com/allenai/IFBench

  • LayerLabelCreated
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4LABEL
    org.opencontainers.image.licenses=3rd_party_licenses.txt
    09/16/2025 5:59 AM UTC
    sha256:bce221556de1dedee3fb3d684387d122fca631f2ad0862434af4e48765765c99COPY
    README.md README.md
    09/16/2025 5:59 AM UTC
    sha256:353755ba0e58aec9a09d52cde098a24f31195ced519ffe8c001832e04068ef15COPY
    3rd_party_licenses.txt .
    09/16/2025 5:59 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
    README_FILE=README.md
    09/16/2025 5:59 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
    THIRD_PARTY_LICENSES_FILE=3rd_party_licenses.txt
    09/16/2025 5:59 AM UTC
    sha256:ab106ed8cb92603d29223d418c26d3b406ea4adb6599c5c3053443ce14df3d95RUN
    pip uninstall -y nvidia-eval-commons-internal
    09/16/2025 5:59 AM UTC
    sha256:4a00a5b40a55df72d72c7e5f4cb3af77c2fd5ab91cf491d8c38640099da10ec1COPY
    --chown=1000:1000 --chmod=777 tests/* /workspace/tests/
    09/15/2025 4:27 PM UTC
    sha256:14234d06db711ab577a0e89bc56a271f0ca4535cf0342486212f3ebdd2317329RUN
    CI_COMMIT_SHA=001b448ca8a445a7688a02ec1a7aa7424613e7b7 EVAL_WHEEL_VERSION=25.08.1 PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple printf '#!/bin/bash\ncore-evals-ifbench "$@"' > /usr/bin/nv-eval &&
      chmod +x /usr/bin/nv-eval &&
      printf '#!/bin/bash\ncore-evals-ifbench "$@"' > /usr/bin/nv_eval &&
      chmod +x /usr/bin/nv_eval
    09/15/2025 4:27 PM UTC
    sha256:638ea7d6d5badeae759d65efcff35f0b12e3b828670c1113afa91c9fa40a211fRUN
    CI_COMMIT_SHA=001b448ca8a445a7688a02ec1a7aa7424613e7b7 EVAL_WHEEL_VERSION=25.08.1 PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple pip install nvidia-ifbench==${EVAL_WHEEL_VERSION} --no-cache-dir --index-url https://gitlab-ci-token:$(cat /run/secrets/ci_job_token)@${PKG_URL}
    09/15/2025 4:27 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
    PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple
    09/15/2025 4:27 PM UTC