NVIDIA
NVIDIA
NVIDIA LiveCodeBench
Container
NVIDIA
NVIDIA
NVIDIA LiveCodeBench

NVIDIA NeMo Evaluator-compatible container with LiveCodeBench support. Based on the LiveCodeBench available at: https://github.com/LiveCodeBench/LiveCodeBench

LayerLabelCreated
5275905a8fb9d01b196478b7886c53a9b24a3ea71ef36ea22aedbcd7a253746cCONFIG
WorkingDir /workspace
09/16/2025 6:02 AM UTC
9e3f2c9b2425eb90183527b25c75ab215fca3af417d43021b0ea9ac14a638149COPY
README.md README.md
09/16/2025 6:02 AM UTC
0bbbad58c1f37b57dcf2bae541733e314dde67712f31a2f0b29449faa5cc2ef5COPY
3rd_party_licenses.txt .
09/16/2025 6:02 AM UTC
39023caef2e1adf645af59c16641b161e561952e76c22506c451c55c55c8d2daARG
README_FILE=README.md
09/16/2025 6:02 AM UTC
e1837a8d1ac516642bd732793b584bf01cd01dfa9446926fc46844d46182b295ARG
THIRD_PARTY_LICENSES_FILE=3rd_party_licenses.txt
09/16/2025 6:02 AM UTC
60f45a67a0528d2bc8e5c9a16e1ee6bfbcbf14ef85d2fdcb4ef87bcf2e7560eeRUN
pip uninstall -y nvidia-eval-commons-internal
09/16/2025 6:02 AM UTC
8f69501ee78e12cbd98225bdafb1690c94fd163388f9e75a03eacae9dd212b45COPY
tests/* /workspace/tests/
09/15/2025 4:27 PM UTC
8e1f53e08d95c73022d7f91f2e1f990818143e6bcf3db8db9dfa8595b5010ea1RUN
CI_COMMIT_SHA=001b448ca8a445a7688a02ec1a7aa7424613e7b7 EVAL_WHEEL_VERSION=25.08.1 PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple printf '#!/bin/bash\ncore_evals_live_code_bench "$@"' > /usr/bin/nv-eval &&
  chmod +x /usr/bin/nv-eval &&
  printf '#!/bin/bash\ncore_evals_live_code_bench "$@"' > /usr/bin/nv_eval &&
  chmod +x /usr/bin/nv_eval
09/15/2025 4:27 PM UTC
96b428880a277a0f4019530ef1e073228b68d6930a72b483adb34f2dad28b9e9RUN
CI_COMMIT_SHA=001b448ca8a445a7688a02ec1a7aa7424613e7b7 EVAL_WHEEL_VERSION=25.08.1 PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple pip install nvidia-livecodebench==${EVAL_WHEEL_VERSION} --no-cache-dir --index-url https://gitlab-ci-token:$(cat /run/secrets/ci_job_token)@${PKG_URL}
09/15/2025 4:27 PM UTC
788b1cc6401af8e8cb47468ab36caee1bea94e3a19d29b67adb68e4eeb61bf84ARG
PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple
09/15/2025 4:27 PM UTC

NVIDIA uses cookies to improve your experience on our web site. We and our third-party partners also use cookies and other tools to collect and record information you provide as well as information about your interactions with our websites for performance improvement, analytics, and to assist in marketing efforts. By clicking "Accept All", you consent to our use of cookies and other tools as described in our Cookie Policy. You can manage your cookie settings by clicking on "Manage Settings." By continuing to use this site or by clicking one of the buttons below, you agree to our Terms of Service (which contains important waivers). Please see our Privacy Policy for more information on our privacy practices.