NVIDIA
NVIDIA
NVIDIA Simple Evals
Container
NVIDIA
NVIDIA
NVIDIA Simple Evals

NVIDIA NeMo Evaluator-compatible container with Simple-Evals support. Based on simple-evals available at: https://github.com/openai/simple-evals

LayerLabelCreated
f0488bfb187206cf9cec13c255b101d80232fbcd48c823060428b7b1252cafc2CONFIG
Entrypoint /usr/bin/shelless_ulimit; WorkingDir /workspace
06/09/2025 5:10 PM UTC
21c2953795ce38ff60b48333585be9369313204e776bb4e827ecced083dd0c7bCOPY
3rd_party_licenses.txt .
06/09/2025 5:10 PM UTC
535d4e3baafde44fa2451331359d1ae80a9521435fcf33f98b862a676722a015ARG
THIRD_PARTY_LICENSES_FILE=3rd_party_licenses.txt
06/09/2025 5:10 PM UTC
b7cedf5ce54d64f3a6178477a5d7cf9130cd6b64d91ac62e4083d6d1b5f36a7cCOPY
--chown=1000:1000 --chmod=777 tests/* /workspace/tests/
06/09/2025 2:22 PM UTC
6502f0f75a6ccd9ed335d70902f0dfafbc5515cf5f2f2a4004c07a47daf47f78ENV
OPENAI_SCOPE=azureopenai-readwrite
06/09/2025 2:22 PM UTC
48b25653d6f64f7d8e436a96e455f3ae7f3abbc656ea48155c8255929df9ad4fENV
OPENAI_MODEL_VERSION=2024-06-01
06/09/2025 2:22 PM UTC
0589260a64c3bf960fefd151b85c918d5539f4c94d7c744ea5617bda13bd4b50ENV
OPENAI_MODEL_URL=https://prod.api.nvidia.com/llm/v1/azure/
06/09/2025 2:22 PM UTC
693cbc11b78367a33dafb078c26bcfd0a738f54ec1b1b90417848cfeebdfcc26ENV
OPENAI_TOKEN_URL=https://prod.api.nvidia.com/oauth/api/v1/ssa/default/token
06/09/2025 2:22 PM UTC
e85fba6471189c18b5936444ddc7620098b85779aea7f36df804b8188b3a25f6RUN
CI_COMMIT_SHA=b91dde956bae7ebeb09ad203d534ce4d54b51b29 EVAL_WHEEL_VERSION=25.05.1 PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple printf '#!/bin/bash\ncore-evals-simple-evals "$@"' > /usr/bin/nv-eval &&
  chmod +x /usr/bin/nv-eval &&
  printf '#!/bin/bash\ncore-evals-simple-evals "$@"' > /usr/bin/nv_eval &&
  chmod +x /usr/bin/nv_eval
06/09/2025 2:22 PM UTC
7c877e802663f579dbe1d1cd01ff498668f1f742ea214a43c640cad928cb8023RUN
CI_COMMIT_SHA=b91dde956bae7ebeb09ad203d534ce4d54b51b29 EVAL_WHEEL_VERSION=25.05.1 PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple pip install nvidia_simple_evals==${EVAL_WHEEL_VERSION} --no-cache-dir --index-url https://gitlab-ci-token:$(cat /run/secrets/ci_job_token)@${PKG_URL}
06/09/2025 2:22 PM UTC
...

NVIDIA uses cookies to improve your experience on our web site. We and our third-party partners also use cookies and other tools to collect and record information you provide as well as information about your interactions with our websites for performance improvement, analytics, and to assist in marketing efforts. By clicking "Accept All", you consent to our use of cookies and other tools as described in our Cookie Policy. You can manage your cookie settings by clicking on "Manage Settings." By continuing to use this site or by clicking one of the buttons below, you agree to our Terms of Service (which contains important waivers). Please see our Privacy Policy for more information on our privacy practices.