Skip to main content
NVIDIA
NVIDIA MTEB
Container
NVIDIA
NVIDIA MTEB

NVIDIA NeMo Evaluator-compatible container with MTEB support. Based on Massive Text Embedding Benchmark available at: https://github.com/embeddings-benchmark/mteb

LayerLabelCreated
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4LABEL
org.opencontainers.image.licenses=3rd_party_licenses.txt
03/12/2026 10:25 AM UTC
sha256:9b4108900521c814e71092aea74125a3f864f0704d4f7f9551068efb13d8c8d8COPY
README.md README.md
03/12/2026 10:25 AM UTC
sha256:b293b1c3fef0041d53ffa4c191385e73b46d47d94a7021aa6e55a6457fef850bCOPY
3rd_party_licenses.txt .
03/12/2026 10:25 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
README_FILE=README.md
03/12/2026 10:25 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
THIRD_PARTY_LICENSES_FILE=3rd_party_licenses.txt
03/12/2026 10:25 AM UTC
sha256:9cbe331e82f1ed77f5ddfa16adacfc29b93f581f77540ecbcbab0dd8ef030d81RUN
pip uninstall -y nemo-evaluator-internal
03/12/2026 10:25 AM UTC
sha256:faa32946bf5553539bfd825ec57bddb1cd400c5626e917c7e558fe8004b71a73COPY
tests/* /workspace/tests/
03/11/2026 1:54 PM UTC
sha256:40be5d5c7db7d09bdba96501e97e2568f2259a7bc1c8d60398394f4fef8cc66eRUN
CI_COMMIT_SHA=83a6bbd46e65be5bceb13b920aa2f90dd73ec155 EVAL_WHEEL_VERSION=26.03 PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple python -c "from nemo_evaluator.core.input import _copy_fdfs; _copy_fdfs('/opt/metadata/')"
03/11/2026 1:54 PM UTC
sha256:0b8673977b487b527bae1e74a69ff178aad716cd80278927dcbeb8e744eba292RUN
CI_COMMIT_SHA=83a6bbd46e65be5bceb13b920aa2f90dd73ec155 EVAL_WHEEL_VERSION=26.03 PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple pip install mteb==${EVAL_WHEEL_VERSION} --no-cache-dir --index-url https://gitlab-ci-token:$(cat /run/secrets/ci_job_token)@${PKG_URL}
03/11/2026 1:54 PM UTC
sha256:27675398553dd72c32c263785ba80e53a274fbcc1f587707bb8a8ea3a672f622RUN
CI_COMMIT_SHA=83a6bbd46e65be5bceb13b920aa2f90dd73ec155 EVAL_WHEEL_VERSION=26.03 PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple pip install torch torchvision torchaudio --index-url https://download.pytorch.org/whl/cpu
03/11/2026 1:54 PM UTC