NVIDIA
NVIDIA
NVIDIA VLMEvalKit
Container
NVIDIA
NVIDIA
NVIDIA VLMEvalKit

NVIDIA NeMo Evaluator-compatible container with VLMEvalKit support. Based on VLMEvalKit available at: https://github.com/open-compass/VLMEvalKit

LayerLabelCreated
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4LABEL
org.opencontainers.image.licenses=3rd_party_licenses.txt
03/12/2026 10:26 AM UTC
sha256:ede8cb409339bc6200e75f0ecf7983fe08b6cb069f5c90b0bec4e3ec6eb70ac9COPY
README.md README.md
03/12/2026 10:26 AM UTC
sha256:edc473709110a0fa947e5c54d88f9d731daf26068b5e991418b3324873871670COPY
3rd_party_licenses.txt .
03/12/2026 10:26 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
README_FILE=README.md
03/12/2026 10:26 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
THIRD_PARTY_LICENSES_FILE=3rd_party_licenses.txt
03/12/2026 10:26 AM UTC
sha256:01e7d87c2b738892a8a3bd6ff738ca9930509909b672dc485683ed46c450b22dRUN
pip uninstall -y nemo-evaluator-internal
03/12/2026 10:26 AM UTC
sha256:41123bbb0975d834d51dab3dae8778ff7dbd4f677fce695ece4ed2e7d49f346cCOPY
tests/* /workspace/tests/
03/11/2026 2:15 PM UTC
sha256:34c0004fd4aec2e2e8012d204b0cf5e0c2b94f1877a3fcd3ddd13ed9f88a5a2fRUN
CI_COMMIT_SHA=83a6bbd46e65be5bceb13b920aa2f90dd73ec155 EVAL_WHEEL_VERSION=26.03 PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple ARCH= python -c "from nemo_evaluator.core.input import _copy_fdfs; _copy_fdfs('/opt/metadata/')"
03/11/2026 2:15 PM UTC
sha256:793c8cbefebab12a2777e41a2249ba948b9861ccb3ccba7e3f77b354c46e081aRUN
CI_COMMIT_SHA=83a6bbd46e65be5bceb13b920aa2f90dd73ec155 EVAL_WHEEL_VERSION=26.03 PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple ARCH= pip install nvidia-vlmeval==${EVAL_WHEEL_VERSION} --no-cache-dir --index-url https://gitlab-ci-token:$(cat /run/secrets/ci_job_token)@${PKG_URL}
03/11/2026 2:15 PM UTC
sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1RUN
CI_COMMIT_SHA=83a6bbd46e65be5bceb13b920aa2f90dd73ec155 EVAL_WHEEL_VERSION=26.03 PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple ARCH= if [ "$ARCH" = "arm64" ]; then add-apt-repository ppa:jonathonf/ffmpeg-4; apt-get update; apt-get install -y build-essential python3-dev python3-setuptools make; apt-get install -y ffmpeg libavcodec-dev libavfilter-dev libavformat-dev libavutil-dev; git clone --recursive https://github.com/dmlc/decord; cd decord; git checkout d2e56190286ae394032a8141885f76d5372bd44b; git apply /workspace/ffmpeg.patch; mkdir build &&
  cd build; cmake .. -DCMAKE_BUILD_TYPE=Release; make; cd ../python; pip install .; fi
03/11/2026 2:13 PM UTC

NVIDIA uses cookies to improve your experience on our web site. We and our third-party partners also use cookies and other tools to collect and record information you provide as well as information about your interactions with our websites for performance improvement, analytics, and to assist in marketing efforts. By clicking "Accept All", you consent to our use of cookies and other tools as described in our Cookie Policy. You can manage your cookie settings by clicking on "Manage Settings." By continuing to use this site or by clicking one of the buttons below, you agree to our Terms of Service (which contains important waivers). Please see our Privacy Policy for more information on our privacy practices.