NVIDIA
NVIDIA
NVIDIA IFBench
Container
NVIDIA
NVIDIA
NVIDIA IFBench

NVIDIA NeMo Evaluator-compatible container with IFBench support. Based on the IFBench available at: https://github.com/allenai/IFBench

LayerLabelCreated
8ece31346b18e1236f2a4d9883bbd554de124f00549acb41a1d8484d58c87b3fCONFIG
WorkingDir /workspace
01/30/2026 2:08 PM UTC
e05becc4264843d0668e92fb31b34ca268074b10d8c08914b701038a9d9c1451COPY
README.md README.md
01/30/2026 2:08 PM UTC
f88511ab336eab01c4c0ea63b4a34b095930859383df438b49a1040a96a47e35COPY
3rd_party_licenses.txt .
01/30/2026 2:08 PM UTC
68c8fd88533e613e27e50abbbf69217605839702334ff0dbb25dca6d22d87b22ARG
README_FILE=README.md
01/30/2026 2:08 PM UTC
bf824a9af0ab6994ce4d1d24ceb6779f33a0842d7b62ae1b3484aa8c584c31f8ARG
THIRD_PARTY_LICENSES_FILE=3rd_party_licenses.txt
01/30/2026 2:08 PM UTC
a2c27800b1c7b1adce2eb8c6d28b87de76d04e7a860624fa6f9af2259fdde324RUN
pip uninstall -y nemo-evaluator-internal
01/30/2026 2:08 PM UTC
57e87630fe42acdf9c12acf94350bd2525fad1fcf758ff0e5b78bad04662e0afCOPY
tests/* /workspace/tests/
01/30/2026 9:22 AM UTC
0b3615243ae58ed6b28964a1267cc25b08e7440f15c6b2ade9f4d58114bf2de0RUN
CI_COMMIT_SHA=b8adb3c3d0bcfec37f39346c4407363ef2dde954 EVAL_WHEEL_VERSION=26.01 PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple python -c "from nemo_evaluator.core.input import _copy_fdfs; _copy_fdfs('/opt/metadata/')"
01/30/2026 9:22 AM UTC
0c12fd732830259b14e04716921f8c716dc38b2419ecea2ddf93747b79e30e4aRUN
CI_COMMIT_SHA=b8adb3c3d0bcfec37f39346c4407363ef2dde954 EVAL_WHEEL_VERSION=26.01 PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple pip install nvidia-ifbench==${EVAL_WHEEL_VERSION} --no-cache-dir --index-url https://gitlab-ci-token:$(cat /run/secrets/ci_job_token)@${PKG_URL}
01/30/2026 9:22 AM UTC
e04e30f30cd7855d52f9dcb26cdff6d0d23288d4f9675376634051ffcc85e381ARG
PKG_URL
01/30/2026 9:22 AM UTC