NVIDIA
NVIDIA
NVIDIA VLMEvalKit
Container
NVIDIA
NVIDIA
NVIDIA VLMEvalKit

NVIDIA NeMo Evaluator-compatible container with VLMEvalKit support. Based on VLMEvalKit available at: https://github.com/open-compass/VLMEvalKit

LayerLabelCreated
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4LABEL
org.opencontainers.image.licenses=3rd_party_licenses.txt
03/12/2026 10:26 AM UTC
sha256:ede8cb409339bc6200e75f0ecf7983fe08b6cb069f5c90b0bec4e3ec6eb70ac9COPY
README.md README.md
03/12/2026 10:26 AM UTC
sha256:edc473709110a0fa947e5c54d88f9d731daf26068b5e991418b3324873871670COPY
3rd_party_licenses.txt .
03/12/2026 10:26 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
README_FILE=README.md
03/12/2026 10:26 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
THIRD_PARTY_LICENSES_FILE=3rd_party_licenses.txt
03/12/2026 10:26 AM UTC
sha256:01e7d87c2b738892a8a3bd6ff738ca9930509909b672dc485683ed46c450b22dRUN
pip uninstall -y nemo-evaluator-internal
03/12/2026 10:26 AM UTC
sha256:41123bbb0975d834d51dab3dae8778ff7dbd4f677fce695ece4ed2e7d49f346cCOPY
tests/* /workspace/tests/
03/11/2026 2:15 PM UTC
sha256:34c0004fd4aec2e2e8012d204b0cf5e0c2b94f1877a3fcd3ddd13ed9f88a5a2fRUN
CI_COMMIT_SHA=83a6bbd46e65be5bceb13b920aa2f90dd73ec155 EVAL_WHEEL_VERSION=26.03 PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple ARCH= python -c "from nemo_evaluator.core.input import _copy_fdfs; _copy_fdfs('/opt/metadata/')"
03/11/2026 2:15 PM UTC
sha256:793c8cbefebab12a2777e41a2249ba948b9861ccb3ccba7e3f77b354c46e081aRUN
CI_COMMIT_SHA=83a6bbd46e65be5bceb13b920aa2f90dd73ec155 EVAL_WHEEL_VERSION=26.03 PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple ARCH= pip install nvidia-vlmeval==${EVAL_WHEEL_VERSION} --no-cache-dir --index-url https://gitlab-ci-token:$(cat /run/secrets/ci_job_token)@${PKG_URL}
03/11/2026 2:15 PM UTC
sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1RUN
CI_COMMIT_SHA=83a6bbd46e65be5bceb13b920aa2f90dd73ec155 EVAL_WHEEL_VERSION=26.03 PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple ARCH= if [ "$ARCH" = "arm64" ]; then add-apt-repository ppa:jonathonf/ffmpeg-4; apt-get update; apt-get install -y build-essential python3-dev python3-setuptools make; apt-get install -y ffmpeg libavcodec-dev libavfilter-dev libavformat-dev libavutil-dev; git clone --recursive https://github.com/dmlc/decord; cd decord; git checkout d2e56190286ae394032a8141885f76d5372bd44b; git apply /workspace/ffmpeg.patch; mkdir build &&
  cd build; cmake .. -DCMAKE_BUILD_TYPE=Release; make; cd ../python; pip install .; fi
03/11/2026 2:13 PM UTC