NVIDIA
NVIDIA
NVIDIA VLMEvalKit
Container
NVIDIA
NVIDIA
NVIDIA VLMEvalKit

NVIDIA NeMo Evaluator-compatible container with VLMEvalKit support. Based on VLMEvalKit available at: https://github.com/open-compass/VLMEvalKit

LayerLabelCreated
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4LABEL
org.opencontainers.image.licenses=3rd_party_licenses.txt
12/02/2025 6:20 PM UTC
sha256:8db2a8617fa8ec21e82812a464c60d48e48eea4182006f47222a6474ca80974dCOPY
README.md README.md
12/02/2025 6:20 PM UTC
sha256:ea9b4c31eaf74664607d7541c271cf3c0ad150fbb62c557d768b9dadd871509eCOPY
3rd_party_licenses.txt .
12/02/2025 6:20 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
README_FILE=README.md
12/02/2025 6:20 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
THIRD_PARTY_LICENSES_FILE=3rd_party_licenses.txt
12/02/2025 6:20 PM UTC
sha256:e7ceee5f177e10b92e06be963d7780b5f0186360c4ec5839b42b8ef4a5334a86RUN
pip uninstall -y nemo-evaluator-internal
12/02/2025 6:20 PM UTC
sha256:2243c4391a173b1cd6c21bf2f06bd86d9a19b95af6152c84614a4ebb5427a2d1COPY
tests/* /workspace/tests/
12/01/2025 1:31 PM UTC
sha256:85076c85a63d5cd73d3f676ed97015511d2bec00e052c84283edb71b1df1a768RUN
CI_COMMIT_SHA=1c7c8d973b2696c49382b89e5f56646c9c194f0a EVAL_WHEEL_VERSION=25.11 PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple python -c "from nemo_evaluator.core.input import _copy_fdfs; _copy_fdfs('/opt/metadata/')"
12/01/2025 1:31 PM UTC
sha256:e5c8d30695e29ff3e9c0e5e7142540b5df158902c166d9476f950601ab0d2183RUN
CI_COMMIT_SHA=1c7c8d973b2696c49382b89e5f56646c9c194f0a EVAL_WHEEL_VERSION=25.11 PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple pip install nvidia-vlmeval==${EVAL_WHEEL_VERSION} --no-cache-dir --index-url https://gitlab-ci-token:$(cat /run/secrets/ci_job_token)@${PKG_URL}
12/01/2025 1:31 PM UTC
sha256:29708dce8583430519cc74d64765aea4cb485101d8e9506aa8c5c30966822a6fRUN
CI_COMMIT_SHA=1c7c8d973b2696c49382b89e5f56646c9c194f0a EVAL_WHEEL_VERSION=25.11 PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple apt-get update &&
  apt-get install -y --no-install-recommends libgl1-mesa-dri libglib2.0-0 &&
  rm -rf /var/lib/apt/lists/*
12/01/2025 1:30 PM UTC