NVIDIA
NVIDIA
NVIDIA LiveCodeBench
Container
NVIDIA
NVIDIA
NVIDIA LiveCodeBench

NVIDIA NeMo Evaluator-compatible container with LiveCodeBench support. Based on the LiveCodeBench available at: https://github.com/LiveCodeBench/LiveCodeBench

LayerLabelCreated
966e5ddf66559d17549b12c74b5edd8898f59f2eac807f9ce1a1915ab665bb3eCONFIG
WorkingDir /workspace
01/30/2026 2:09 PM UTC
ca588416851403a6cea8c042e8381b595c88942023ede8059598aac181ef7adbCOPY
README.md README.md
01/30/2026 2:09 PM UTC
00cfacd2a68699ed89fe97442dfa91ec6a9ac14624b43ebc115ae35ac3520737COPY
3rd_party_licenses.txt .
01/30/2026 2:09 PM UTC
9daddf84017d7d8764c5dedc19f8568eda975c12d9d7423a7944e20a1f003d40ARG
README_FILE=README.md
01/30/2026 2:09 PM UTC
6a2564c7713b005633779b2dbe9fa198388ebd861d9e2f17436a8a17248183c7ARG
THIRD_PARTY_LICENSES_FILE=3rd_party_licenses.txt
01/30/2026 2:09 PM UTC
77aa1fe09d1707733318e13c2592b4cd133836883c89e9e7cdf393e75d77cfacRUN
pip uninstall -y nemo-evaluator-internal
01/30/2026 2:09 PM UTC
1ad241f2d78c36dde7193fc0c93bad763bee33d03439f239316386629435432aCOPY
tests/* /workspace/tests/
01/30/2026 9:25 AM UTC
300f843157718a368bd40166ecdd8ae572c1e08233f6ce8782833a94d616919cRUN
CI_COMMIT_SHA=b8adb3c3d0bcfec37f39346c4407363ef2dde954 EVAL_WHEEL_VERSION=26.01 PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple python -c "from nemo_evaluator.core.input import _copy_fdfs; _copy_fdfs('/opt/metadata/')"
01/30/2026 9:25 AM UTC
66e9953860439dc596cb867055caa48e9212f0bebe2984dfe6825213a8378b07RUN
CI_COMMIT_SHA=b8adb3c3d0bcfec37f39346c4407363ef2dde954 EVAL_WHEEL_VERSION=26.01 PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple pip install nvidia-livecodebench==${EVAL_WHEEL_VERSION} --no-cache-dir --index-url https://gitlab-ci-token:$(cat /run/secrets/ci_job_token)@${PKG_URL}
01/30/2026 9:25 AM UTC
5a1f12f95091c4e2c2d6ca5ae193e84f732dfeebc4fc2f280c4b2da984175ef2ARG
PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple
01/30/2026 9:25 AM UTC

NVIDIA uses cookies to improve your experience on our web site. We and our third-party partners also use cookies and other tools to collect and record information you provide as well as information about your interactions with our websites for performance improvement, analytics, and to assist in marketing efforts. By clicking "Accept All", you consent to our use of cookies and other tools as described in our Cookie Policy. You can manage your cookie settings by clicking on "Manage Settings." By continuing to use this site or by clicking one of the buttons below, you agree to our Terms of Service (which contains important waivers). Please see our Privacy Policy for more information on our privacy practices.