NVIDIA
NVIDIA
NVIDIA LiveCodeBench
Container
NVIDIA
NVIDIA
NVIDIA LiveCodeBench

NVIDIA NeMo Evaluator-compatible container with LiveCodeBench support. Based on the LiveCodeBench available at: https://github.com/LiveCodeBench/LiveCodeBench

LayerLabelCreated
f0f60f4be3c883431fc5b455d4e5766a8dcf07aeae6367e2f9e700b269d3abacCONFIG
WorkingDir /workspace
03/12/2026 10:25 AM UTC
e7aac03706c39aff884f7c056a0c869b98b2c14f3d0f14e1eaa378e3c89eac56COPY
README.md README.md
03/12/2026 10:25 AM UTC
f0bb6223c35bf9ec5fe941a2f4328aea17c9e5362179b40cd12132353b07cc42COPY
3rd_party_licenses.txt .
03/12/2026 10:25 AM UTC
764418b9d411fe8f25a5350ea3f54b0bb30c95850b0a12efb675e47483bd1b67ARG
README_FILE=README.md
03/12/2026 10:25 AM UTC
1f4d63a7e4f7ba7346a08fcd00804ff701921a63ae9a2a7f3615bc0f169eda48ARG
THIRD_PARTY_LICENSES_FILE=3rd_party_licenses.txt
03/12/2026 10:25 AM UTC
f3be2942d970a5ea655056207269d874dc54c5eb0dfa707c3ebbc42953620058RUN
pip uninstall -y nemo-evaluator-internal
03/12/2026 10:25 AM UTC
c51d3856e71462b845245f7eaa8a46b8d26c73f9f17668dd06605c5e8c6a00beCOPY
tests/* /workspace/tests/
03/11/2026 1:54 PM UTC
91385d7e717b1faf56915f2ac328b165b8235ef41159df57bbfcb023eb769e8eRUN
CI_COMMIT_SHA=83a6bbd46e65be5bceb13b920aa2f90dd73ec155 EVAL_WHEEL_VERSION=26.03 PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple python -c "from nemo_evaluator.core.input import _copy_fdfs; _copy_fdfs('/opt/metadata/')"
03/11/2026 1:54 PM UTC
068e462ff865684c2b87f7c5108538beac573f6f7fb2f7259855492178fd3f96RUN
CI_COMMIT_SHA=83a6bbd46e65be5bceb13b920aa2f90dd73ec155 EVAL_WHEEL_VERSION=26.03 PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple pip install nvidia-livecodebench==${EVAL_WHEEL_VERSION} --no-cache-dir --index-url https://gitlab-ci-token:$(cat /run/secrets/ci_job_token)@${PKG_URL}
03/11/2026 1:54 PM UTC
d93bb3c3a297e2c8f9e0dc330f8fc27e1e97cfc77b0b3353a6d6f92a9bd89e94ARG
PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple
03/11/2026 1:54 PM UTC

NVIDIA uses cookies to improve your experience on our web site. We and our third-party partners also use cookies and other tools to collect and record information you provide as well as information about your interactions with our websites for performance improvement, analytics, and to assist in marketing efforts. By clicking "Accept All", you consent to our use of cookies and other tools as described in our Cookie Policy. You can manage your cookie settings by clicking on "Manage Settings." By continuing to use this site or by clicking one of the buttons below, you agree to our Terms of Service (which contains important waivers). Please see our Privacy Policy for more information on our privacy practices.