NVIDIA
NVIDIA
NVIDIA MTEB
Container
NVIDIA
NVIDIA
NVIDIA MTEB

NVIDIA NeMo Evaluator-compatible container with MTEB support. Based on Massive Text Embedding Benchmark available at: https://github.com/embeddings-benchmark/mteb

LayerLabelCreated
974cfc7b79f0210f582aa54c4595b6cf0ad1faf3541b6a16a564b47fd9aaec3aCONFIG
WorkingDir /workspace
02/02/2026 9:09 AM UTC
b1cbf6718dac88a842a4896b52ce7c7ab92557963d49372e8fd6f37fe2fc6e9aCOPY
README.md README.md
02/02/2026 9:09 AM UTC
7e236f154e78e088115b3ec33ce05969873e98a1a7751d00c6a6b29c45094416COPY
3rd_party_licenses.txt .
02/02/2026 9:09 AM UTC
6d0fb1f22ff581d6458e99f735ee5051b1dd86173c4729f6ec2cb5a0f331ef97ARG
README_FILE=README.md
02/02/2026 9:09 AM UTC
762129069b015fbaac0e548469e97faac16022108b58ef9642b079d3374fd87aARG
THIRD_PARTY_LICENSES_FILE=3rd_party_licenses.txt
02/02/2026 9:09 AM UTC
afb1fc3ccbc7e2212edfe2619b4ba732b6355604ba704bd18b28d4e5be6f407aRUN
pip uninstall -y nemo-evaluator-internal
02/02/2026 9:09 AM UTC
a512e4af9c9dad2ef8cdc4a7c6d6918f4d40b215fa3fd5d9fcaf2399592480e5COPY
tests/* /workspace/tests/
01/30/2026 9:24 AM UTC
525cf0d9f514fed38a8aa5a768d980f9c503ea1489d425425ec7f24d32e0f1eeRUN
CI_COMMIT_SHA=b8adb3c3d0bcfec37f39346c4407363ef2dde954 EVAL_WHEEL_VERSION=26.01 PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple python -c "from nemo_evaluator.core.input import _copy_fdfs; _copy_fdfs('/opt/metadata/')"
01/30/2026 9:24 AM UTC
fdf9ea9352c57f44241dcb940976ecb3aac96aac7aec545927ae5dd8cd7a8dc4RUN
CI_COMMIT_SHA=b8adb3c3d0bcfec37f39346c4407363ef2dde954 EVAL_WHEEL_VERSION=26.01 PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple pip install mteb==${EVAL_WHEEL_VERSION} --no-cache-dir --index-url https://gitlab-ci-token:$(cat /run/secrets/ci_job_token)@${PKG_URL}
01/30/2026 9:24 AM UTC
3d60ef6b87dabf66ad7e97c2bd56d552663cb206d9ec500a8a4d5e7227a03457RUN
CI_COMMIT_SHA=b8adb3c3d0bcfec37f39346c4407363ef2dde954 EVAL_WHEEL_VERSION=26.01 PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple pip install torch torchvision torchaudio --index-url https://download.pytorch.org/whl/cpu
01/30/2026 9:24 AM UTC

NVIDIA uses cookies to improve your experience on our web site. We and our third-party partners also use cookies and other tools to collect and record information you provide as well as information about your interactions with our websites for performance improvement, analytics, and to assist in marketing efforts. By clicking "Accept All", you consent to our use of cookies and other tools as described in our Cookie Policy. You can manage your cookie settings by clicking on "Manage Settings." By continuing to use this site or by clicking one of the buttons below, you agree to our Terms of Service (which contains important waivers). Please see our Privacy Policy for more information on our privacy practices.