NVIDIA
NVIDIA
NVIDIA LiveCodeBench
Container
NVIDIA
NVIDIA
NVIDIA LiveCodeBench

NVIDIA NeMo Evaluator-compatible container with LiveCodeBench support. Based on the LiveCodeBench available at: https://github.com/LiveCodeBench/LiveCodeBench

LayerLabelCreated
f0f60f4be3c883431fc5b455d4e5766a8dcf07aeae6367e2f9e700b269d3abacCONFIG
WorkingDir /workspace
03/12/2026 10:25 AM UTC
e7aac03706c39aff884f7c056a0c869b98b2c14f3d0f14e1eaa378e3c89eac56COPY
README.md README.md
03/12/2026 10:25 AM UTC
f0bb6223c35bf9ec5fe941a2f4328aea17c9e5362179b40cd12132353b07cc42COPY
3rd_party_licenses.txt .
03/12/2026 10:25 AM UTC
764418b9d411fe8f25a5350ea3f54b0bb30c95850b0a12efb675e47483bd1b67ARG
README_FILE=README.md
03/12/2026 10:25 AM UTC
1f4d63a7e4f7ba7346a08fcd00804ff701921a63ae9a2a7f3615bc0f169eda48ARG
THIRD_PARTY_LICENSES_FILE=3rd_party_licenses.txt
03/12/2026 10:25 AM UTC
f3be2942d970a5ea655056207269d874dc54c5eb0dfa707c3ebbc42953620058RUN
pip uninstall -y nemo-evaluator-internal
03/12/2026 10:25 AM UTC
c51d3856e71462b845245f7eaa8a46b8d26c73f9f17668dd06605c5e8c6a00beCOPY
tests/* /workspace/tests/
03/11/2026 1:54 PM UTC
91385d7e717b1faf56915f2ac328b165b8235ef41159df57bbfcb023eb769e8eRUN
CI_COMMIT_SHA=83a6bbd46e65be5bceb13b920aa2f90dd73ec155 EVAL_WHEEL_VERSION=26.03 PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple python -c "from nemo_evaluator.core.input import _copy_fdfs; _copy_fdfs('/opt/metadata/')"
03/11/2026 1:54 PM UTC
068e462ff865684c2b87f7c5108538beac573f6f7fb2f7259855492178fd3f96RUN
CI_COMMIT_SHA=83a6bbd46e65be5bceb13b920aa2f90dd73ec155 EVAL_WHEEL_VERSION=26.03 PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple pip install nvidia-livecodebench==${EVAL_WHEEL_VERSION} --no-cache-dir --index-url https://gitlab-ci-token:$(cat /run/secrets/ci_job_token)@${PKG_URL}
03/11/2026 1:54 PM UTC
d93bb3c3a297e2c8f9e0dc330f8fc27e1e97cfc77b0b3353a6d6f92a9bd89e94ARG
PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple
03/11/2026 1:54 PM UTC