NVIDIA
NVIDIA
NVIDIA VLMEvalKit
Container
NVIDIA
NVIDIA
NVIDIA VLMEvalKit

NVIDIA NeMo Evaluator-compatible container with VLMEvalKit support. Based on VLMEvalKit available at: https://github.com/open-compass/VLMEvalKit

LayerLabelCreated
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4LABEL
org.opencontainers.image.licenses=3rd_party_licenses.txt
09/30/2025 9:49 AM UTC
sha256:c43f1da5429579847e384162905111c577a6788dfd951d8ef49f81a0411e5de1COPY
README.md README.md
09/30/2025 9:49 AM UTC
sha256:51bcb48d4d97808bcafcb398992ce5e33f587241cccbfe440e939cc2b9405ad9COPY
3rd_party_licenses.txt .
09/30/2025 9:49 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
README_FILE=README.md
09/30/2025 9:49 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
THIRD_PARTY_LICENSES_FILE=3rd_party_licenses.txt
09/30/2025 9:49 AM UTC
sha256:f7d80b77ab53af775f39adcad9b84496f9cf16828b4ed0941cfe7d634da0204dRUN
pip uninstall -y nemo-evaluator-internal
09/30/2025 9:49 AM UTC
sha256:d237768899b4a13e9e8f32fb5e000af32f087da098ce7681d4c16a5bd309ed2dCOPY
tests/* /workspace/tests/
09/29/2025 9:51 AM UTC
sha256:7a35ddd8b18b54dcdf65216a4b3718fcaa14bbc71187fc3b52679d5e7000491eRUN
CI_COMMIT_SHA=26bc7c0fca30c8fcc72e3f1fa7127f95824d2c6d EVAL_WHEEL_VERSION=25.09 PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple pip install nvidia-vlmeval==${EVAL_WHEEL_VERSION} --no-cache-dir --index-url https://gitlab-ci-token:$(cat /run/secrets/ci_job_token)@${PKG_URL}
09/29/2025 9:51 AM UTC
sha256:a5d4c4d07220f3d9281fe6b0a62907fb09e11fef8b5cb8001d9426cfe73c2d85RUN
CI_COMMIT_SHA=26bc7c0fca30c8fcc72e3f1fa7127f95824d2c6d EVAL_WHEEL_VERSION=25.09 PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple apt-get update &&
  apt-get install -y --no-install-recommends libgl1-mesa-dri libglib2.0-0 &&
  rm -rf /var/lib/apt/lists/*
09/29/2025 9:48 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
OPENAI_API_VERSION=2024-10-21
09/29/2025 9:48 AM UTC