NVIDIA
NVIDIA
NVIDIA VLMEvalKit
Container
NVIDIA
NVIDIA
NVIDIA VLMEvalKit

NVIDIA NeMo Evaluator-compatible container with VLMEvalKit support. Based on VLMEvalKit available at: https://github.com/open-compass/VLMEvalKit

LayerLabelCreated
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4LABEL
org.opencontainers.image.licenses=3rd_party_licenses.txt
09/16/2025 6:10 AM UTC
sha256:f8b52c111b4f21e7cb2f8ea36897e679d4dd2ba0ef5f2df57677d5086e94535fCOPY
README.md README.md
09/16/2025 6:10 AM UTC
sha256:a6af1118928a3c500ed78c54044b0532839a3d41a6dcdcbd4944fbbf9d8df06dCOPY
3rd_party_licenses.txt .
09/16/2025 6:10 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
README_FILE=README.md
09/16/2025 6:10 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
THIRD_PARTY_LICENSES_FILE=3rd_party_licenses.txt
09/16/2025 6:10 AM UTC
sha256:9728cb5e6f121bd2883b7d1700d7fbeda58c24366318e3f8271c35cbcba834c1RUN
pip uninstall -y nvidia-eval-commons-internal
09/16/2025 6:10 AM UTC
sha256:c73a87222f9727e32a741b3f06c152f1138a4c3044cc9fe5679468eb3a469632COPY
tests/* /workspace/tests/
09/15/2025 4:32 PM UTC
sha256:b8fc34f7f8fc2a4edc83541e207f19fcbec2df25269588a9cbe8ec4082c3050dRUN
CI_COMMIT_SHA=001b448ca8a445a7688a02ec1a7aa7424613e7b7 EVAL_WHEEL_VERSION=25.08.1 PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple printf '#!/bin/bash\ncore-evals-vlmevalkit "$@"' > /usr/bin/nv-eval &&
  chmod +x /usr/bin/nv-eval &&
  printf '#!/bin/bash\ncore-evals-vlmevalkit "$@"' > /usr/bin/nv_eval &&
  chmod +x /usr/bin/nv_eval
09/15/2025 4:32 PM UTC
sha256:768fbf75b5a62a47aed2af9b5f882a94f1cf72d95e4731ce39498cbdf0668423RUN
CI_COMMIT_SHA=001b448ca8a445a7688a02ec1a7aa7424613e7b7 EVAL_WHEEL_VERSION=25.08.1 PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple pip install nvidia-vlmeval==${EVAL_WHEEL_VERSION} --no-cache-dir --index-url https://gitlab-ci-token:$(cat /run/secrets/ci_job_token)@${PKG_URL}
09/15/2025 4:32 PM UTC
sha256:7458571fb65049bef7196ee680a1014c1931ea4e2554e45d2cbb80bb2a1a5c66RUN
CI_COMMIT_SHA=001b448ca8a445a7688a02ec1a7aa7424613e7b7 EVAL_WHEEL_VERSION=25.08.1 PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple apt-get update &&
  apt-get install -y --no-install-recommends libgl1-mesa-dri libglib2.0-0 &&
  rm -rf /var/lib/apt/lists/*
09/15/2025 4:31 PM UTC