NVIDIA
NVIDIA
NVIDIA Simple Evals
Container
NVIDIA
NVIDIA
NVIDIA Simple Evals

NVIDIA NeMo Evaluator-compatible container with Simple-Evals support. Based on simple-evals available at: https://github.com/openai/simple-evals

  • LayerLabelCreated
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4LABEL
    org.opencontainers.image.licenses=3rd_party_licenses.txt
    07/07/2025 3:13 PM UTC
    sha256:f0bcb74a9dcf2aacecae176d34ce233f8c215204520b25e7df915c6c5bc3e978COPY
    3rd_party_licenses.txt .
    07/07/2025 3:13 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
    THIRD_PARTY_LICENSES_FILE=3rd_party_licenses.txt
    07/07/2025 3:13 PM UTC
    sha256:f03955a31906ff916b06dccb36841bed1e7861b0a3514cda145fe9ce9b066730COPY
    --chown=1000:1000 --chmod=777 tests/* /workspace/tests/
    07/07/2025 1:07 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    OPENAI_SCOPE=azureopenai-readwrite
    07/07/2025 1:07 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    OPENAI_MODEL_VERSION=2024-06-01
    07/07/2025 1:07 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    OPENAI_MODEL_URL=https://prod.api.nvidia.com/llm/v1/azure/
    07/07/2025 1:07 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    OPENAI_TOKEN_URL=https://prod.api.nvidia.com/oauth/api/v1/ssa/default/token
    07/07/2025 1:07 PM UTC
    sha256:313d3f3b05239b429bd1489e28e85f682d00d17c44f843800a9ef42b8f06b88bRUN
    CI_COMMIT_SHA=767a37675d0de203289a89792b9cc13f9ec06c8f EVAL_WHEEL_VERSION=25.06.1 PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple printf '#!/bin/bash\ncore-evals-simple-evals "$@"' > /usr/bin/nv-eval &&
      chmod +x /usr/bin/nv-eval &&
      printf '#!/bin/bash\ncore-evals-simple-evals "$@"' > /usr/bin/nv_eval &&
      chmod +x /usr/bin/nv_eval
    07/07/2025 1:07 PM UTC
    sha256:9ae1db02bf305a209f13b1fdf75a61255c0750763eb81ef389d49c988ee0eca7RUN
    CI_COMMIT_SHA=767a37675d0de203289a89792b9cc13f9ec06c8f EVAL_WHEEL_VERSION=25.06.1 PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple pip install nvidia_simple_evals==${EVAL_WHEEL_VERSION} --no-cache-dir --index-url https://gitlab-ci-token:$(cat /run/secrets/ci_job_token)@${PKG_URL}
    07/07/2025 1:07 PM UTC
    ...