NVIDIA
NVIDIA
NVIDIA IFBench
Container
NVIDIA
NVIDIA
NVIDIA IFBench

NVIDIA NeMo Evaluator-compatible container with IFBench support. Based on the IFBench available at: https://github.com/allenai/IFBench

LayerLabelCreated
ffd7ce16c46491364678bd8bae4a5f34cfbdd5ac1e18ae7c71722ac281adb416CONFIG
WorkingDir /workspace
12/02/2025 6:41 PM UTC
495e2f4fc63ad16e8ac49961acc00ee7ee05c5b6b02a5a5fbdfb30c1de8c87c7COPY
README.md README.md
12/02/2025 6:41 PM UTC
37aed68c1c54422525402353b283a1788d83127a5c2916ab7119e639361c3054COPY
3rd_party_licenses.txt .
12/02/2025 6:41 PM UTC
18378d6e5b0aae5ac88866acd862212b54903c8a67585db771088024be361776ARG
README_FILE=README.md
12/02/2025 6:41 PM UTC
505c681c7abe93717c7c1395ebb5ecd881d1c23bba88ba5cdffb15ed2ca787c0ARG
THIRD_PARTY_LICENSES_FILE=3rd_party_licenses.txt
12/02/2025 6:41 PM UTC
9031b8e781a130162ad063a2952d008f97a555fc2290c97700bf4f414ee99cdcRUN
pip uninstall -y nemo-evaluator-internal
12/02/2025 6:41 PM UTC
def3474b6ef484070592543fdd926bd3033a7cdbb8e9ee61e77c0122d8c36c00COPY
--chown=1000:1000 --chmod=777 tests/* /workspace/tests/
12/01/2025 1:25 PM UTC
e911187b37dd76ffafdc37eae691775d5f17d162cecdcd227df25d9c77d78593RUN
CI_COMMIT_SHA=1c7c8d973b2696c49382b89e5f56646c9c194f0a EVAL_WHEEL_VERSION=25.11 PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple python -c "from nemo_evaluator.core.input import _copy_fdfs; _copy_fdfs('/opt/metadata/')"
12/01/2025 1:25 PM UTC
c02438f3e047eeb18f81ae60ab6ca5410578a3eca05e04cca598d26ef648948aRUN
CI_COMMIT_SHA=1c7c8d973b2696c49382b89e5f56646c9c194f0a EVAL_WHEEL_VERSION=25.11 PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple pip install nvidia-ifbench==${EVAL_WHEEL_VERSION} --no-cache-dir --index-url https://gitlab-ci-token:$(cat /run/secrets/ci_job_token)@${PKG_URL}
12/01/2025 1:25 PM UTC
949f1c89cf40172dcd8520032eec65736010ebdf1c9e60b7ea415b975f4234d1ARG
PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple
12/01/2025 1:25 PM UTC