NVIDIA
NVIDIA
NVIDIA IFBench
Container
NVIDIA
NVIDIA
NVIDIA IFBench

NVIDIA NeMo Evaluator-compatible container with IFBench support. Based on the IFBench available at: https://github.com/allenai/IFBench

LayerLabelCreated
48263a07e4eb295a26f92b9c317191df155991e2fbae6badc0e98849a3749f6eCONFIG
WorkingDir /workspace
09/16/2025 5:59 AM UTC
817670f9c98ac45f502c34739bdff133ea4516e677f5326115fd89d85c77fc30COPY
README.md README.md
09/16/2025 5:59 AM UTC
2645a8c1a162a8057b4597b788980b552347e3948120383722bcf9f29526eb2fCOPY
3rd_party_licenses.txt .
09/16/2025 5:59 AM UTC
63da610a5c7169f7248031680794eb8b23c2de5f76e9a74642d928cb89ed28aeARG
README_FILE=README.md
09/16/2025 5:59 AM UTC
1ac90e79b8ad75622e0fcd129c1c73d91c69eaf19d256a2bd17c2815a8c46c26ARG
THIRD_PARTY_LICENSES_FILE=3rd_party_licenses.txt
09/16/2025 5:59 AM UTC
753b622277203deb2fc0a0d7b1d187cbcea6b3abb837aafe3295d7cbdf5bc062RUN
pip uninstall -y nvidia-eval-commons-internal
09/16/2025 5:59 AM UTC
81d787001a339a2d048a325215e58f15c56ef58aa0154007dd6e1b6971428715COPY
--chown=1000:1000 --chmod=777 tests/* /workspace/tests/
09/15/2025 4:27 PM UTC
c3732f960db135837e6b43ca2207c95a042ebe66a8a19a9171d2f8c6c649a6fdRUN
CI_COMMIT_SHA=001b448ca8a445a7688a02ec1a7aa7424613e7b7 EVAL_WHEEL_VERSION=25.08.1 PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple printf '#!/bin/bash\ncore-evals-ifbench "$@"' > /usr/bin/nv-eval &&
  chmod +x /usr/bin/nv-eval &&
  printf '#!/bin/bash\ncore-evals-ifbench "$@"' > /usr/bin/nv_eval &&
  chmod +x /usr/bin/nv_eval
09/15/2025 4:27 PM UTC
fdb0ba004c7883c18165b98f7ba5aed8835dd36eb8d389c4b01bed06c91e4f3bRUN
CI_COMMIT_SHA=001b448ca8a445a7688a02ec1a7aa7424613e7b7 EVAL_WHEEL_VERSION=25.08.1 PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple pip install nvidia-ifbench==${EVAL_WHEEL_VERSION} --no-cache-dir --index-url https://gitlab-ci-token:$(cat /run/secrets/ci_job_token)@${PKG_URL}
09/15/2025 4:27 PM UTC
be3ac13e58e12449a483e49a0933ecf5bc688062e204f66f8872ac890dba35c7ARG
PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple
09/15/2025 4:27 PM UTC