NVIDIA
NVIDIA
JAX
Container
NVIDIA
NVIDIA
JAX

JAX is a framework for high-performance numerical computing and machine learning research. It includes Numpy-like APIs, automatic differentiation, XLA acceleration and simple primitives for scaling across GPUs and supports an ecosystem of libraries.

LayerLabelCreated
f44a9ffd7a7c6c4ab9989d3edc4d07dcb3eb1d1b576537f2483652750a2b3530CONFIG
Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /opt/rosetta
05/08/2024 5:03 AM UTC
a6c45d26be208b9da7e613a7735926896b1cbfa49ee14fdb4c888a132f9473e0WORKDIR
/opt/rosetta
05/08/2024 4:59 AM UTC
eb559d555c12d3c4e564aaa4a7185345c0cd8045e8c70582879251772978f8c1RUN
RUN |5 NVIDIA_BUILD_ID=92034664 GIT_USER_EMAIL=jax@nvidia.com GIT_USER_NAME=NVIDIA UPDATE_PATCHES=false UPDATED_TE_REF= /bin/sh -c <<"EOF" bash -exu MANIFEST_DIR=$(dirname ${MANIFEST_FILE}) if [[ "${UPDATE_PATCHES}" != "true" && "${UPDATE_PATCHES}" != "false" ]]; then echo "UPDATE_PATCHES can only be true or false" exit 1 fi if [[ "${UPDATE_PATCHES}" == "true" ]]; then cp -r /mnt/jax-toolbox/.github/container/patches ${MANIFEST_DIR}/ cp /mnt/jax-toolbox/.github/container/manifest.yaml ${MANIFEST_DIR}/manifest.yaml cp /mnt/jax-toolbox/.github/container/create-distribution.sh ${MANIFEST_DIR}/create-distribution.sh # TODO: remove cp /mnt/jax-toolbox/.github/container/pip-finalize.sh /usr/local/bin/ fi cp -r /mnt/jax-toolbox/rosetta /opt/rosetta if [[ -n "${UPDATED_TE_REF}" ]]; then TE_INSTALL_DIR=/opt/transformer-engine yq e ".transformer-engine.latest_verified_commit = \"${UPDATED_TE_REF}\"" -i $MANIFEST_FILE # Install from source instead of pre-built wheel sed -i -E 's@( file:///opt/transformer-engine)/dist/[^ ]*@\1@' /opt/pip-tools.d/requirements-te.in git -C $TE_INSTALL_DIR fetch -a if [[ "${UPDATED_TE_REF}" =~ ^pull/ ]]; then PR_ID=$(cut -d/ -f2 <<<"${UPDATED_TE_REF}") git -C $TE_INSTALL_DIR fetch origin ${UPDATED_TE_REF}:PR-${PR_ID} git -C $TE_INSTALL_DIR checkout PR-${PR_ID} else git -C $TE_INSTALL_DIR checkout ${UPDATED_TE_REF} fi fi # Setting the username/email is required to author commits from patches git config --global user.email "${GIT_USER_EMAIL}" git config --global user.name "${GIT_USER_NAME}" bash ${MANIFEST_DIR}/create-distribution.sh \
--manifest ${MANIFEST_FILE} \
--package paxml bash ${MANIFEST_DIR}/create-distribution.sh \
--manifest ${MANIFEST_FILE} \
--package praxis # Remove .gitconfig to avoid end-user authoring commits as the "build user" rm -f ~/.gitconfig EOF # buildkit
05/08/2024 4:59 AM UTC
729ce43f4724e414e0e0d7a9215bc7a29e651e7558f503beb7eea2ccf90c7456ENV
NVTE_FUSED_ATTN=1
05/08/2024 4:59 AM UTC
3b9787bf476836fd2de3e2bf1372be88a5c0b63286ff383e4d1609070a193a5fENV
ENABLE_TE=1
05/08/2024 4:59 AM UTC
6cce19e3d86fb676a974a218ace17129826695a30acd5f7a82bef9ce3f74786cARG
UPDATED_TE_REF
05/08/2024 4:59 AM UTC
a9f9c86a3a89add1c0c6db2a03aca1873dbfa7b4cf18a3e9e28f353aed4f29afARG
UPDATE_PATCHES
05/08/2024 4:59 AM UTC
fb02f1db09572a9c734ee7d587d1869ba55cb5d99aebec987ebf3bcca5703940ARG
GIT_USER_NAME
05/08/2024 4:59 AM UTC
3ae2635882269bd115f02dd09a666766f33c033393c809791267b7bc65bfeaf6ARG
GIT_USER_EMAIL
05/08/2024 4:59 AM UTC
4cf2a51998ed09db42e0401c1fb75f2516ccf66a07ee9c88078cb6d3faa2a85dENV
NVIDIA_BUILD_ID=92034664
05/08/2024 4:59 AM UTC
...

NVIDIA uses cookies to improve your experience on our web site. We and our third-party partners also use cookies and other tools to collect and record information you provide as well as information about your interactions with our websites for performance improvement, analytics, and to assist in marketing efforts. By clicking "Accept All", you consent to our use of cookies and other tools as described in our Cookie Policy. You can manage your cookie settings by clicking on "Manage Settings." By continuing to use this site or by clicking one of the buttons below, you agree to our Terms of Service (which contains important waivers). Please see our Privacy Policy for more information on our privacy practices.