NVIDIA
NVIDIA
NVIDIA VLMEvalKit
Container
NVIDIA
NVIDIA
NVIDIA VLMEvalKit

NVIDIA NeMo Evaluator-compatible container with VLMEvalKit support. Based on VLMEvalKit available at: https://github.com/open-compass/VLMEvalKit

LayerLabelCreated
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4LABEL
org.opencontainers.image.licenses=3rd_party_licenses.txt
01/30/2026 2:40 PM UTC
sha256:1c97a85647b8d1b6962d581db13012b66bc28c8398c51e689fe784b5a0e5f942COPY
README.md README.md
01/30/2026 2:40 PM UTC
sha256:6eab4cc0e0137b952f4b73fa512e8a0c20216e3440030f7953660763ed844eceCOPY
3rd_party_licenses.txt .
01/30/2026 2:40 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
README_FILE=README.md
01/30/2026 2:40 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
THIRD_PARTY_LICENSES_FILE=3rd_party_licenses.txt
01/30/2026 2:40 PM UTC
sha256:be6e8e580cb0e2176f5bc460c1074e12955e5b73b85f75ba78d072ea224f6d04RUN
pip uninstall -y nemo-evaluator-internal
01/30/2026 2:40 PM UTC
sha256:10668fe641a856bef46f6b3c64f5f9ec3d26f19ee615e932164ef1fcc5969c9cCOPY
tests/* /workspace/tests/
01/30/2026 9:24 AM UTC
sha256:c83fd6aa4319bf046d53246641a44d3fa97e4bcab5e196e76bc113601affb697RUN
CI_COMMIT_SHA=b8adb3c3d0bcfec37f39346c4407363ef2dde954 EVAL_WHEEL_VERSION=26.01 PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple python -c "from nemo_evaluator.core.input import _copy_fdfs; _copy_fdfs('/opt/metadata/')"
01/30/2026 9:24 AM UTC
sha256:831f03d2b66a51d219e24d4208056b8cff71b006cb6508877023105dcafcdb5dRUN
CI_COMMIT_SHA=b8adb3c3d0bcfec37f39346c4407363ef2dde954 EVAL_WHEEL_VERSION=26.01 PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple pip install nvidia-vlmeval==${EVAL_WHEEL_VERSION} --no-cache-dir --index-url https://gitlab-ci-token:$(cat /run/secrets/ci_job_token)@${PKG_URL}
01/30/2026 9:24 AM UTC
sha256:4d9ad86c3882253015e17d84bc8568e69922be157f35f96896f44f84dc3453e7RUN
CI_COMMIT_SHA=b8adb3c3d0bcfec37f39346c4407363ef2dde954 EVAL_WHEEL_VERSION=26.01 PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple apt-get update &&
  apt-get install -y --no-install-recommends libgl1-mesa-dri libglib2.0-0 &&
  rm -rf /var/lib/apt/lists/*
01/30/2026 9:22 AM UTC