NVIDIA
NVIDIA
NVIDIA IFBench
Container
NVIDIA
NVIDIA
NVIDIA IFBench

NVIDIA NeMo Evaluator-compatible container with IFBench support. Based on the IFBench available at: https://github.com/allenai/IFBench

LayerLabelCreated
5d422fb2990982ef8d83f7bebdd503dd6d5d8e1b123b1e591ee6be0aa2b6d9b1CONFIG
WorkingDir /workspace
10/22/2025 8:09 PM UTC
86d6d26122e58c89b4168cc52343aa5772797789c85d292e9d88573aa537b352COPY
README.md README.md
10/22/2025 8:09 PM UTC
e1563c41d045dce3114255527662bc4e78b98855a5f40cd2fc2a13ebb2545444COPY
3rd_party_licenses.txt .
10/22/2025 8:09 PM UTC
1ebe8f73d04bc5a4e6644cc0267b5b97288cebae1cd5cc91eeb8768b7810cccdARG
README_FILE=README.md
10/22/2025 8:09 PM UTC
9c839990fcc1129e68634e8b075d1becb9698ba6a531ff3e8bfc58733cc07296ARG
THIRD_PARTY_LICENSES_FILE=3rd_party_licenses.txt
10/22/2025 8:09 PM UTC
5d6cfa9e90c97453ad9c7fbf1346765c8b4ebe93d9e828bff4dbc9c38c318b90RUN
pip uninstall -y nemo-evaluator-internal
10/22/2025 8:09 PM UTC
920f62c02126f42f51b0d8d77b9a196aae6f6e2539ca7a65c4c3bbaf5b14503cCOPY
--chown=1000:1000 --chmod=777 tests/* /workspace/tests/
10/21/2025 3:15 PM UTC
deddee81d45b5bd3aa689c3c2dfa0e41b794cf58a57dba62b463976af424b1b1RUN
CI_COMMIT_SHA=642726ffc068518ea874f9183393464458b3cdcb EVAL_WHEEL_VERSION=25.09.1 PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple pip install nvidia-ifbench==${EVAL_WHEEL_VERSION} --no-cache-dir --index-url https://gitlab-ci-token:$(cat /run/secrets/ci_job_token)@${PKG_URL}
10/21/2025 3:15 PM UTC
5741de5d61a08d530eca189a23414315db06eb47f654ef54b5b4f6a3446445a6ARG
PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple
10/21/2025 3:15 PM UTC
c42042856a0b32e99a1a8d754c82bcb9bb4851f4711e3af08f5420081fc1bd31ARG
EVAL_WHEEL_VERSION=25.09.1
10/21/2025 3:15 PM UTC