NVIDIA
NVIDIA IFBench
Container
NVIDIA
NVIDIA IFBench

NVIDIA NeMo Evaluator-compatible container with IFBench support. Based on the IFBench available at: https://github.com/allenai/IFBench

  • LayerLabelCreated
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4LABEL
    org.opencontainers.image.licenses=3rd_party_licenses.txt
    09/30/2025 9:49 AM UTC
    sha256:b02f4d13a7d0b1997a97d54d0563e82efab322f97f6a555fb00c83a3e581a464COPY
    README.md README.md
    09/30/2025 9:49 AM UTC
    sha256:e735605ef936a55af9e7e7fa313c16c36e9e1ea6ed03003e853023021c7873f5COPY
    3rd_party_licenses.txt .
    09/30/2025 9:49 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
    README_FILE=README.md
    09/30/2025 9:49 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
    THIRD_PARTY_LICENSES_FILE=3rd_party_licenses.txt
    09/30/2025 9:49 AM UTC
    sha256:73125e604bf930f9a246a0251e77556fe06515dc8c3962bee2c72e25e9c681ddRUN
    pip uninstall -y nemo-evaluator-internal
    09/30/2025 9:49 AM UTC
    sha256:6a17cbd1e3ea5c3956640e7824bfcb7b72885ea80113380c79517e15494e6476COPY
    --chown=1000:1000 --chmod=777 tests/* /workspace/tests/
    09/29/2025 9:31 AM UTC
    sha256:b7d62b8ce8b6a44b3c726921e61c450dde0390e09eff5d0d7e74632353e303c0RUN
    CI_COMMIT_SHA=26bc7c0fca30c8fcc72e3f1fa7127f95824d2c6d EVAL_WHEEL_VERSION=25.09 PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple pip install nvidia-ifbench==${EVAL_WHEEL_VERSION} --no-cache-dir --index-url https://gitlab-ci-token:$(cat /run/secrets/ci_job_token)@${PKG_URL}
    09/29/2025 9:31 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
    PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple
    09/29/2025 9:31 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
    EVAL_WHEEL_VERSION=25.09
    09/29/2025 9:31 AM UTC