NVIDIA
NVIDIA IFBench
Container
NVIDIA
NVIDIA IFBench

NVIDIA NeMo Evaluator-compatible container with IFBench support. Based on the IFBench available at: https://github.com/allenai/IFBench

  • LayerLabelCreated
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4LABEL
    org.opencontainers.image.licenses=3rd_party_licenses.txt
    12/02/2025 6:41 PM UTC
    sha256:2d55338eb53da1f5a1e25b52c61ece5248f245f1d0bba5fb44f8d90b562e66abCOPY
    README.md README.md
    12/02/2025 6:41 PM UTC
    sha256:aca2dd35e0dbe8250670c3307103cc2201b37bea1470123a390fd525039ce233COPY
    3rd_party_licenses.txt .
    12/02/2025 6:41 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
    README_FILE=README.md
    12/02/2025 6:41 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
    THIRD_PARTY_LICENSES_FILE=3rd_party_licenses.txt
    12/02/2025 6:41 PM UTC
    sha256:5ea2501e4a28d6279064793ffd80195d106d7f0bff77fdb44111b36965ed2af0RUN
    pip uninstall -y nemo-evaluator-internal
    12/02/2025 6:41 PM UTC
    sha256:99e1fa5b187991849d333b7998af2a85b7f1db3e249ac704b1fa04894893bad5COPY
    --chown=1000:1000 --chmod=777 tests/* /workspace/tests/
    12/01/2025 1:25 PM UTC
    sha256:e59c6b79caae8823fbd7ee9baae83eeb2de85330cd1e0bf7791275f292dd4b70RUN
    CI_COMMIT_SHA=1c7c8d973b2696c49382b89e5f56646c9c194f0a EVAL_WHEEL_VERSION=25.11 PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple python -c "from nemo_evaluator.core.input import _copy_fdfs; _copy_fdfs('/opt/metadata/')"
    12/01/2025 1:25 PM UTC
    sha256:92971871a1df961ce0eba3209bfc7c1e94169b96d4f183089746363f08d80a3dRUN
    CI_COMMIT_SHA=1c7c8d973b2696c49382b89e5f56646c9c194f0a EVAL_WHEEL_VERSION=25.11 PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple pip install nvidia-ifbench==${EVAL_WHEEL_VERSION} --no-cache-dir --index-url https://gitlab-ci-token:$(cat /run/secrets/ci_job_token)@${PKG_URL}
    12/01/2025 1:25 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
    PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple
    12/01/2025 1:25 PM UTC