NVIDIA
NVIDIA
NVIDIA IFBench
Container
NVIDIA
NVIDIA
NVIDIA IFBench

NVIDIA NeMo Evaluator-compatible container with IFBench support. Based on the IFBench available at: https://github.com/allenai/IFBench

LayerLabelCreated
022949762cf28f8f367d395dc2516a6a34341ba036a2c236135f4a76126f847fCONFIG
WorkingDir /workspace
03/12/2026 9:48 AM UTC
d897ec9bb7005e614892fc896146c3e7a6ed9a8e8f9295ad8706cf6395384dcfCOPY
README.md README.md
03/12/2026 9:48 AM UTC
4c9b288ec26fd49b472305f162c052736188ae6be083e30579878e096b6aef45COPY
3rd_party_licenses.txt .
03/12/2026 9:48 AM UTC
31965cacc1a1b12c95b4740878a0de8c18b10d2fa035b698569a12e30084bccaARG
README_FILE=README.md
03/12/2026 9:48 AM UTC
0de6ba95edbc0885050b28b0a2e4d078b02cdecce81d6c321193975c6ee85433ARG
THIRD_PARTY_LICENSES_FILE=3rd_party_licenses.txt
03/12/2026 9:48 AM UTC
ad808e20c034bcd533543e8b70efa79ee08b38f72a7f8e07b8fc98b7e39a689dRUN
pip uninstall -y nemo-evaluator-internal
03/12/2026 9:48 AM UTC
332a946f5a6b0722b3ba8fed8aaf9bf3c435c04d01326b94da7f906e4b1cb60bCOPY
tests/* /workspace/tests/
03/11/2026 1:58 PM UTC
812a80e54ba74bcf12c05992733efcbc18aef766b66888409a77d60ee30dbf91RUN
CI_COMMIT_SHA=83a6bbd46e65be5bceb13b920aa2f90dd73ec155 EVAL_WHEEL_VERSION=26.03 PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple python -c "from nemo_evaluator.core.input import _copy_fdfs; _copy_fdfs('/opt/metadata/')"
03/11/2026 1:58 PM UTC
274dca2705b113e646a395101d4b6cd18c6d3ddc5c5b0c37790006773338b20eRUN
CI_COMMIT_SHA=83a6bbd46e65be5bceb13b920aa2f90dd73ec155 EVAL_WHEEL_VERSION=26.03 PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple pip install nvidia-ifbench==${EVAL_WHEEL_VERSION} --no-cache-dir --index-url https://gitlab-ci-token:$(cat /run/secrets/ci_job_token)@${PKG_URL}
03/11/2026 1:56 PM UTC
a2512a26dc97a56f82dac512216c26471f48493ad8b2a4dd70cf894d6f29dc1aARG
PKG_URL
03/11/2026 1:56 PM UTC