NVIDIA
NVIDIA
NVIDIA IFBench
Container
NVIDIA
NVIDIA
NVIDIA IFBench

NVIDIA NeMo Evaluator-compatible container with IFBench support. Based on the IFBench available at: https://github.com/allenai/IFBench

LayerLabelCreated
022949762cf28f8f367d395dc2516a6a34341ba036a2c236135f4a76126f847fCONFIG
WorkingDir /workspace
03/12/2026 9:48 AM UTC
d897ec9bb7005e614892fc896146c3e7a6ed9a8e8f9295ad8706cf6395384dcfCOPY
README.md README.md
03/12/2026 9:48 AM UTC
4c9b288ec26fd49b472305f162c052736188ae6be083e30579878e096b6aef45COPY
3rd_party_licenses.txt .
03/12/2026 9:48 AM UTC
31965cacc1a1b12c95b4740878a0de8c18b10d2fa035b698569a12e30084bccaARG
README_FILE=README.md
03/12/2026 9:48 AM UTC
0de6ba95edbc0885050b28b0a2e4d078b02cdecce81d6c321193975c6ee85433ARG
THIRD_PARTY_LICENSES_FILE=3rd_party_licenses.txt
03/12/2026 9:48 AM UTC
ad808e20c034bcd533543e8b70efa79ee08b38f72a7f8e07b8fc98b7e39a689dRUN
pip uninstall -y nemo-evaluator-internal
03/12/2026 9:48 AM UTC
332a946f5a6b0722b3ba8fed8aaf9bf3c435c04d01326b94da7f906e4b1cb60bCOPY
tests/* /workspace/tests/
03/11/2026 1:58 PM UTC
812a80e54ba74bcf12c05992733efcbc18aef766b66888409a77d60ee30dbf91RUN
CI_COMMIT_SHA=83a6bbd46e65be5bceb13b920aa2f90dd73ec155 EVAL_WHEEL_VERSION=26.03 PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple python -c "from nemo_evaluator.core.input import _copy_fdfs; _copy_fdfs('/opt/metadata/')"
03/11/2026 1:58 PM UTC
274dca2705b113e646a395101d4b6cd18c6d3ddc5c5b0c37790006773338b20eRUN
CI_COMMIT_SHA=83a6bbd46e65be5bceb13b920aa2f90dd73ec155 EVAL_WHEEL_VERSION=26.03 PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple pip install nvidia-ifbench==${EVAL_WHEEL_VERSION} --no-cache-dir --index-url https://gitlab-ci-token:$(cat /run/secrets/ci_job_token)@${PKG_URL}
03/11/2026 1:56 PM UTC
a2512a26dc97a56f82dac512216c26471f48493ad8b2a4dd70cf894d6f29dc1aARG
PKG_URL
03/11/2026 1:56 PM UTC

NVIDIA uses cookies to improve your experience on our web site. We and our third-party partners also use cookies and other tools to collect and record information you provide as well as information about your interactions with our websites for performance improvement, analytics, and to assist in marketing efforts. By clicking "Accept All", you consent to our use of cookies and other tools as described in our Cookie Policy. You can manage your cookie settings by clicking on "Manage Settings." By continuing to use this site or by clicking one of the buttons below, you agree to our Terms of Service (which contains important waivers). Please see our Privacy Policy for more information on our privacy practices.