NVIDIA
NVIDIA
NVIDIA Simple Evals
Container
NVIDIA
NVIDIA
NVIDIA Simple Evals

NVIDIA NeMo Evaluator-compatible container with Simple-Evals support. Based on simple-evals available at: https://github.com/openai/simple-evals

LayerLabelCreated
b4f5eb6ccbce815acde7d015a1a9423880e8a05ecd1d90932fc46b3c8163d896CONFIG
WorkingDir /workspace
08/04/2025 2:59 PM UTC
b7bcac91536df894e9c622e27bdf5b9256fb9becd758060359ee4dfd850a0185COPY
3rd_party_licenses.txt .
08/04/2025 2:59 PM UTC
9755dc552ace1bf3b83b54f92239889ac7339264fc112a97898079b34869a62eARG
THIRD_PARTY_LICENSES_FILE=3rd_party_licenses.txt
08/04/2025 2:59 PM UTC
d82ec8bc10b99a2dbbbc5aa4f43a134128af76b87278b9ee64362d7cea87327eRUN
pip uninstall -y nvidia-eval-commons-internal
08/04/2025 2:59 PM UTC
9ca33b8ed4d735b92565b82d38084a6885571a8919e41bd3485e306c1c29cd5cCOPY
--chown=1000:1000 --chmod=777 tests/* /workspace/tests/
08/04/2025 1:42 PM UTC
8c1675dba68cd0e255d736841ccf61f08b45846781ab3ba2ad3dcea95daed0f0ENV
OPENAI_SCOPE=azureopenai-readwrite
08/04/2025 1:42 PM UTC
50ce081103718a792d7c68305acfd9a4650b280e19042f7df43148a2221887d1ENV
OPENAI_MODEL_VERSION=2024-06-01
08/04/2025 1:42 PM UTC
37d43d464f87ac7240498344ab27e48d64d5e34f89f0a2e58afd202e54cc4f14ENV
OPENAI_MODEL_URL=https://prod.api.nvidia.com/llm/v1/azure/
08/04/2025 1:42 PM UTC
2e09a8c425dd2491e0e74cd098d522b1c19b0f43d3c3c78238bb97de75583e7bENV
OPENAI_TOKEN_URL=https://prod.api.nvidia.com/oauth/api/v1/ssa/default/token
08/04/2025 1:42 PM UTC
b47c67a0360b6d47a48097ed62c34cb672e671b10174030edc4ba35b9ce2bf9eRUN
CI_COMMIT_SHA=360de12fe9a031dd0475ee807b1f04531e9917cb EVAL_WHEEL_VERSION=25.07.1 PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple printf '#!/bin/bash\ncore-evals-simple-evals "$@"' > /usr/bin/nv-eval &&
  chmod +x /usr/bin/nv-eval &&
  printf '#!/bin/bash\ncore-evals-simple-evals "$@"' > /usr/bin/nv_eval &&
  chmod +x /usr/bin/nv_eval
08/04/2025 1:42 PM UTC

NVIDIA uses cookies to improve your experience on our web site. We and our third-party partners also use cookies and other tools to collect and record information you provide as well as information about your interactions with our websites for performance improvement, analytics, and to assist in marketing efforts. By clicking "Accept All", you consent to our use of cookies and other tools as described in our Cookie Policy. You can manage your cookie settings by clicking on "Manage Settings." By continuing to use this site or by clicking one of the buttons below, you agree to our Terms of Service (which contains important waivers). Please see our Privacy Policy for more information on our privacy practices.