NVIDIA
NVIDIA
NeMo Framework Megatron Backend
Container
NVIDIA
NVIDIA
NeMo Framework Megatron Backend

NVIDIA NeMo™ framework Megatron backend supports pre-training, post-training, and reinforcement learning of LLMs and multi-modal generative AI models with state-of-the-art data processing, model training techniques, and flexible deployment options.

LayerLabelCreated
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4WORKDIR
/workspace/nemo_examples
01/02/2020 6:35 PM UTC
sha256:c07b504b39d7f4096f20538c957611930484429afb42ceafed4c8eecce665efaRUN
printf "#!/bin/bash\njupyter lab --no-browser --allow-root --ip=0.0.0.0" >> start-jupyter.sh &&
  chmod +x start-jupyter.sh
01/02/2020 6:35 PM UTC
sha256:ebf025be547c7fc8513137bf2bb65d2fa9be6b33b2db4ec4f379596a677b23b1RUN
mv examples/ /workspace/nemo_examples &&
  rm -rf /workspace/nemo
01/02/2020 6:35 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4WORKDIR
/workspace/nemo
01/02/2020 6:34 PM UTC
sha256:d17da4df6503f9444431f27c5f5a9a743c1a29d15505991aaa78a622791e436fRUN
cd nemo &&
  pip install . &&
  cd ../collections/nemo_asr &&
  pip install . &&
  cd ../nemo_nlp &&
  pip install . &&
  cd ../nemo_simple_gan &&
  pip install . &&
  cd ../nemo_tts &&
  pip install .
01/02/2020 6:34 PM UTC
sha256:cd1e32397db347cf79d42fd99f03efea0103c6ccbafc8179a003a884379ef3beCOPY
dir:bd5d0adc28f5127bd0193eac1ea9433f2281da7a24bfe029cbd9f9c41fc98040 in .
01/02/2020 6:34 PM UTC
sha256:ea4b2a574759235b879b6a19412fa787d71d9a5e1164b6beb420d43d84a751edRUN
pip install --disable-pip-version-check -U -r requirements.txt
12/07/2019 12:08 AM UTC
sha256:7308ac252806100bc78e3738d342057b029d0cbefd424e384c20ee42436a3c46COPY
file:133daf3065d6e3ce2917f4aa30f7a36dc743a7331f787c4c87306ccc50d4af78 in .
12/07/2019 12:07 AM UTC
sha256:114ec44c0f5d6e09ef063740b3e3b861397e26141d8e6c0bb3c15469c845fc4eWORKDIR
/workspace/nemo
12/07/2019 12:07 AM UTC
sha256:c7b43ad10a4ede52f1b56b9a429e8dbd90bca5cd54f8dd8758b9cd6306a3a18eRUN
git clone https://github.com/onnx/onnx-tensorrt.git &&
  cd onnx-tensorrt &&
  git submodule update --init --recursive &&
  patch -f < ../onnx-trt.patch &&
  mkdir build &&
  cd build &&
  cmake .. -DCMAKE_BUILD_TYPE=Release -DCMAKE_INSTALL_PREFIX=/usr -DGPU_ARCHS="60 70 75" &&
  make -j16 &&
  make install &&
  mv -f /usr/lib/libnvonnx* /usr/lib/x86_64-linux-gnu/ &&
  ldconfig
12/07/2019 12:07 AM UTC
...

NVIDIA uses cookies to improve your experience on our web site. We and our third-party partners also use cookies and other tools to collect and record information you provide as well as information about your interactions with our websites for performance improvement, analytics, and to assist in marketing efforts. By clicking "Accept All", you consent to our use of cookies and other tools as described in our Cookie Policy. You can manage your cookie settings by clicking on "Manage Settings." By continuing to use this site or by clicking one of the buttons below, you agree to our Terms of Service (which contains important waivers). Please see our Privacy Policy for more information on our privacy practices.