NVIDIA
NVIDIA
NVIDIA LiveCodeBench
Container
NVIDIA
NVIDIA
NVIDIA LiveCodeBench

NVIDIA NeMo Evaluator-compatible container with LiveCodeBench support. Based on the LiveCodeBench available at: https://github.com/LiveCodeBench/LiveCodeBench

  • LayerLabelCreated
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4LABEL
    org.opencontainers.image.licenses=3rd_party_licenses.txt
    09/16/2025 6:02 AM UTC
    sha256:d2aeadd1a920ade7aca144172cc478b3b304ef639e45ba7750900161bd425724COPY
    README.md README.md
    09/16/2025 6:02 AM UTC
    sha256:de8376ce3d5237c456b4753e81615e5ac775b67c9572f360cfc3e99cf9d89a8fCOPY
    3rd_party_licenses.txt .
    09/16/2025 6:02 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
    README_FILE=README.md
    09/16/2025 6:02 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
    THIRD_PARTY_LICENSES_FILE=3rd_party_licenses.txt
    09/16/2025 6:02 AM UTC
    sha256:37f57f5352a1258c122065d247ef062e12ff24233adcadea00cf5a860b7b3b7eRUN
    pip uninstall -y nvidia-eval-commons-internal
    09/16/2025 6:02 AM UTC
    sha256:e67fac89f462db50a656222ff7d7b38f956295f413f2ec8a0341dfe4d13a33d9COPY
    tests/* /workspace/tests/
    09/15/2025 4:27 PM UTC
    sha256:a0f6e92655710c41a7bcfc5f91ac468db07555b4c4470f65c3565228fa201a43RUN
    CI_COMMIT_SHA=001b448ca8a445a7688a02ec1a7aa7424613e7b7 EVAL_WHEEL_VERSION=25.08.1 PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple printf '#!/bin/bash\ncore_evals_live_code_bench "$@"' > /usr/bin/nv-eval &&
      chmod +x /usr/bin/nv-eval &&
      printf '#!/bin/bash\ncore_evals_live_code_bench "$@"' > /usr/bin/nv_eval &&
      chmod +x /usr/bin/nv_eval
    09/15/2025 4:27 PM UTC
    sha256:229936757be11011df846bc6029325a4953cc7740056d54a4ee7a3b3c2194578RUN
    CI_COMMIT_SHA=001b448ca8a445a7688a02ec1a7aa7424613e7b7 EVAL_WHEEL_VERSION=25.08.1 PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple pip install nvidia-livecodebench==${EVAL_WHEEL_VERSION} --no-cache-dir --index-url https://gitlab-ci-token:$(cat /run/secrets/ci_job_token)@${PKG_URL}
    09/15/2025 4:27 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
    PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple
    09/15/2025 4:27 PM UTC