NVIDIA
NVIDIA
NVIDIA VLMEvalKit
Container
NVIDIA
NVIDIA
NVIDIA VLMEvalKit

NVIDIA NeMo Evaluator-compatible container with VLMEvalKit support. Based on VLMEvalKit available at: https://github.com/open-compass/VLMEvalKit

LayerLabelCreated
c35c796150c5550395eaa95f2ad772502f86729517197d5ec782a76fe9527676CONFIG
WorkingDir /workspace
03/12/2026 10:26 AM UTC
be7751770c2b139af4b8db42a874d0209744644d51a49ffb0c0de28dc5a2eabbCOPY
README.md README.md
03/12/2026 10:26 AM UTC
8e1dd3f9fdf70b02ae71e5377c6593e0f8853cc79559ae29908d911b6754863dCOPY
3rd_party_licenses.txt .
03/12/2026 10:26 AM UTC
d678ae7c6af2f75e4df95466d44efc16e48089ce6b51a353605689f0a85636faARG
README_FILE=README.md
03/12/2026 10:26 AM UTC
bfc35c5d99083f547a77817c807135b16c6dc3930590385d69d7b6e2af477b53ARG
THIRD_PARTY_LICENSES_FILE=3rd_party_licenses.txt
03/12/2026 10:26 AM UTC
7377705470361264068a1f3951869c8bbef93be9b4eacac1d1d7f321d26a734cRUN
pip uninstall -y nemo-evaluator-internal
03/12/2026 10:26 AM UTC
d7893cc048a5d55831129b0de9cea90ab3992ad0a20dd5bb52c118ddd17641b3COPY
tests/* /workspace/tests/
03/11/2026 2:15 PM UTC
edcdc7a4b2bbe0d12b2287cd998d22549ba4de8fcc0138a9d7fcc95c1951e62fRUN
CI_COMMIT_SHA=83a6bbd46e65be5bceb13b920aa2f90dd73ec155 EVAL_WHEEL_VERSION=26.03 PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple ARCH= python -c "from nemo_evaluator.core.input import _copy_fdfs; _copy_fdfs('/opt/metadata/')"
03/11/2026 2:15 PM UTC
f5d4fa90b6976a8bc8e98a4fe6b1786fee6e5dc20ecdfb6ddcf045b20b05edf1RUN
CI_COMMIT_SHA=83a6bbd46e65be5bceb13b920aa2f90dd73ec155 EVAL_WHEEL_VERSION=26.03 PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple ARCH= pip install nvidia-vlmeval==${EVAL_WHEEL_VERSION} --no-cache-dir --index-url https://gitlab-ci-token:$(cat /run/secrets/ci_job_token)@${PKG_URL}
03/11/2026 2:15 PM UTC
7d8f0a037cbaa0013f432529724dfa7875872ee148be75f9395f0c43e72c7755RUN
CI_COMMIT_SHA=83a6bbd46e65be5bceb13b920aa2f90dd73ec155 EVAL_WHEEL_VERSION=26.03 PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple ARCH= if [ "$ARCH" = "arm64" ]; then add-apt-repository ppa:jonathonf/ffmpeg-4; apt-get update; apt-get install -y build-essential python3-dev python3-setuptools make; apt-get install -y ffmpeg libavcodec-dev libavfilter-dev libavformat-dev libavutil-dev; git clone --recursive https://github.com/dmlc/decord; cd decord; git checkout d2e56190286ae394032a8141885f76d5372bd44b; git apply /workspace/ffmpeg.patch; mkdir build &&
  cd build; cmake .. -DCMAKE_BUILD_TYPE=Release; make; cd ../python; pip install .; fi
03/11/2026 2:13 PM UTC

NVIDIA uses cookies to improve your experience on our web site. We and our third-party partners also use cookies and other tools to collect and record information you provide as well as information about your interactions with our websites for performance improvement, analytics, and to assist in marketing efforts. By clicking "Accept All", you consent to our use of cookies and other tools as described in our Cookie Policy. You can manage your cookie settings by clicking on "Manage Settings." By continuing to use this site or by clicking one of the buttons below, you agree to our Terms of Service (which contains important waivers). Please see our Privacy Policy for more information on our privacy practices.