NVIDIA
NVIDIA
NVIDIA ProfBench
Container
NVIDIA
NVIDIA
NVIDIA ProfBench

NVIDIA NeMo Evaluator-compatible container with ProfBench support

LayerLabelCreated
8fb038cf9df244fa310375258f5b937d08ae22119c81f406c960c543c51dc507CONFIG
WorkingDir /workspace
12/02/2025 6:41 PM UTC
544632c916313c70ee0cc05105e989d4ff627f25d450b76c50ed20af8c8d57eeCOPY
README.md README.md
12/02/2025 6:41 PM UTC
6e9b6f6c2eb98dedbbb1b36d2061fdd234981f1a276425eafbfeba352784f530COPY
3rd_party_licenses.txt .
12/02/2025 6:41 PM UTC
9732abf8955a63c7eb1db1365fe55568b0dcd5a2b4fd588a92a47da27f897b01ARG
README_FILE=README.md
12/02/2025 6:41 PM UTC
ba4dacf5526a977253b353b739cbe3b04f05c13563517280dc04a45b035da944ARG
THIRD_PARTY_LICENSES_FILE=3rd_party_licenses.txt
12/02/2025 6:41 PM UTC
6f430aa52cd5ada69c2ee42ee5edb1d1682d9048ba78a7d02124581803b14d3dRUN
pip uninstall -y nemo-evaluator-internal
12/02/2025 6:41 PM UTC
5a6bdfbc8a1ac7f637d95edcfd458bcfb65996ad2c40c186e25c772044c218c9COPY
tests/* /workspace/tests/
12/01/2025 1:27 PM UTC
af04f6ef21695bb4e093116e9e3f9237fd4426bb6bd87d8f5ffecb18387a5c7eRUN
CI_COMMIT_SHA=1c7c8d973b2696c49382b89e5f56646c9c194f0a EVAL_WHEEL_VERSION=25.11 PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple python -c "from nemo_evaluator.core.input import _copy_fdfs; _copy_fdfs('/opt/metadata/')"
12/01/2025 1:27 PM UTC
3fc19ca7f3a805e01ecf876fac39b69126265eec0c5db0059d977f86db22b887RUN
CI_COMMIT_SHA=1c7c8d973b2696c49382b89e5f56646c9c194f0a EVAL_WHEEL_VERSION=25.11 PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple pip install nvidia-profbench==${EVAL_WHEEL_VERSION} --no-cache-dir --index-url https://gitlab-ci-token:$(cat /run/secrets/ci_job_token)@${PKG_URL}
12/01/2025 1:27 PM UTC
35adb355ee7eefc42c71d6bf1dff18e4e6872be295120e8579d0854466ee3245ARG
PKG_URL=gitlab-master.nvidia.com/api/v4/projects/153108/packages/pypi/simple
12/01/2025 1:27 PM UTC

NVIDIA uses cookies to improve your experience on our web site. We and our third-party partners also use cookies and other tools to collect and record information you provide as well as information about your interactions with our websites for performance improvement, analytics, and to assist in marketing efforts. By clicking "Accept All", you consent to our use of cookies and other tools as described in our Cookie Policy. You can manage your cookie settings by clicking on "Manage Settings." By continuing to use this site or by clicking one of the buttons below, you agree to our Terms of Service (which contains important waivers). Please see our Privacy Policy for more information on our privacy practices.