NVIDIA
NVIDIA
NeMo Framework Megatron Backend
Container
NVIDIA
NVIDIA
NeMo Framework Megatron Backend

NVIDIA NeMo™ framework Megatron backend supports pre-training, post-training, and reinforcement learning of LLMs and multi-modal generative AI models with state-of-the-art data processing, model training techniques, and flexible deployment options.

LayerLabelCreated
sha256:395fe519a03236bd16c4e58aa496538004ae43df28727872f1cdf9a1972d02e4RUN
NEMO_VERSION=1.12.0 printf "#!/bin/bash\njupyter lab --no-browser --allow-root --ip=0.0.0.0" >> start-jupyter.sh &&
  chmod +x start-jupyter.sh
10/11/2022 9:07 PM UTC
sha256:9c103c7a65221e2c11ef9819145f93a7cab5a4c822e43550fc01988f5af17df1COPY
tutorials /workspace/nemo/tutorials
10/11/2022 9:07 PM UTC
sha256:20217d84dbbd0117a44e431212fe1b35a682b31dabe605db48032fc4b54747f5COPY
tests /workspace/nemo/tests
10/11/2022 9:07 PM UTC
sha256:5491bc83528b95a6f90fc448b85e72b5253082160641c6826e4bd26ab538d4c0COPY
examples /workspace/nemo/examples
10/11/2022 9:07 PM UTC
sha256:6a560a160a222d3323ff79995c0168b9a77c5067488c526324dbbf62242ed5daCOPY
scripts /workspace/nemo/scripts
10/11/2022 9:07 PM UTC
sha256:2714bbd103a2c23c68052d670f61a1d5181c59063dfd52acc1affa7f6f9a9456WORKDIR
/workspace/nemo
10/11/2022 9:07 PM UTC
sha256:f3066de8676087e106a388438b4590606d4a69bfecd25cdada337d2b1dab92f2RUN
NEMO_VERSION=1.12.0 cd /tmp/nemo &&
  pip install ".[all]" &&
  sed -i "s/_module_available(\"torchtext\")/False/g" /opt/conda/lib/python3.8/site-packages/pytorch_lightning/utilities/imports.py &&
  python -c "import nemo.collections.asr as nemo_asr" &&
  python -c "import nemo.collections.nlp as nemo_nlp" &&
  python -c "import nemo.collections.tts as nemo_tts" &&
  python -c "import nemo_text_processing.text_normalization as text_normalization"
10/11/2022 9:07 PM UTC
sha256:13fc4cb48358b30ed61972194451e574fd9326b5f44b8a011594ed598839b35dRUN
NEMO_VERSION=1.12.0 /usr/bin/test -n "$NEMO_VERSION" &&
  /bin/echo "export NEMO_VERSION=${NEMO_VERSION}" >> /root/.bashrc &&
  /bin/echo "export BASE_IMAGE=${BASE_IMAGE}" >> /root/.bashrc
10/11/2022 9:06 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
NEMO_VERSION=1.12.0
10/11/2022 9:06 PM UTC
sha256:0fbe8c0509750a5883440e8e46be2249635b9421a7b946f3c89857a522d74324RUN
/bin/bash /tmp/nemo/scripts/speech_recognition/k2/setup.sh ||
  exit 0
10/11/2022 9:06 PM UTC
...