NVIDIA
NVIDIA
NVIDIA IFBench
Container
NVIDIA
NVIDIA
NVIDIA IFBench

NVIDIA NeMo Evaluator-compatible container with IFBench support. Based on the IFBench available at: https://github.com/allenai/IFBench

LayerLabelCreated
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4LABEL
org.opencontainers.image.licenses=3rd_party_licenses.txt
03/12/2026 9:48 AM UTC
sha256:ccc49603e21a1581f4debf08cb7bd7cf8049407f19a3e396a8d9b6269c92c85cCOPY
README.md README.md
03/12/2026 9:48 AM UTC
sha256:032643ae8c8da7df8a5142c03c6b939ea11c37decc0f6f4ebf2a7f7377a34657COPY
3rd_party_licenses.txt .
03/12/2026 9:48 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
README_FILE=README.md
03/12/2026 9:48 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
THIRD_PARTY_LICENSES_FILE=3rd_party_licenses.txt
03/12/2026 9:48 AM UTC
sha256:5523f20490391ce69565b39f1166c99f501eb2ecf9056ff336bd65926eb388f6RUN
pip uninstall -y nemo-evaluator-internal
03/12/2026 9:48 AM UTC
sha256:4ca1c5b5f1e2b2a05769a650878ddd21cb773a0acfde1c1a2f012d2517722d90COPY
tests/* /workspace/tests/
03/11/2026 1:58 PM UTC
sha256:22e29e512888f5355613450139b729cde02e5d9d9a776c742f7fbcb4bb21864bRUN
CI_COMMIT_SHA=83a6bbd46e65be5bceb13b920aa2f90dd73ec155 EVAL_WHEEL_VERSION=26.03 PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple python -c "from nemo_evaluator.core.input import _copy_fdfs; _copy_fdfs('/opt/metadata/')"
03/11/2026 1:58 PM UTC
sha256:02a5f8277336d76960b32f9d8d615a58a9c5dd47330150f5b5e645ac81c2bc33RUN
CI_COMMIT_SHA=83a6bbd46e65be5bceb13b920aa2f90dd73ec155 EVAL_WHEEL_VERSION=26.03 PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple pip install nvidia-ifbench==${EVAL_WHEEL_VERSION} --no-cache-dir --index-url https://gitlab-ci-token:$(cat /run/secrets/ci_job_token)@${PKG_URL}
03/11/2026 1:56 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
PKG_URL
03/11/2026 1:56 PM UTC

NVIDIA uses cookies to improve your experience on our web site. We and our third-party partners also use cookies and other tools to collect and record information you provide as well as information about your interactions with our websites for performance improvement, analytics, and to assist in marketing efforts. By clicking "Accept All", you consent to our use of cookies and other tools as described in our Cookie Policy. You can manage your cookie settings by clicking on "Manage Settings." By continuing to use this site or by clicking one of the buttons below, you agree to our Terms of Service (which contains important waivers). Please see our Privacy Policy for more information on our privacy practices.