NVIDIA
NVIDIA
NeMo Framework Megatron Backend
Container
NVIDIA
NVIDIA
NeMo Framework Megatron Backend

NVIDIA NeMo™ framework Megatron backend supports pre-training, post-training, and reinforcement learning of LLMs and multi-modal generative AI models with state-of-the-art data processing, model training techniques, and flexible deployment options.

LayerLabelCreated
f6a5083aa6d7e1292ebc8c7cc3bc192fdc7c01dd1609c70b6e6f0be7c4a36d49CONFIG
Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /workspace/nemo; ExposedPorts 6006/tcp, 8888/tcp
03/09/2022 1:47 AM UTC
109afb381d28085645168ce669d45dbfce7ee4a7773279044221b559170014e2COPY
tutorials /workspace/nemo/tutorials
03/09/2022 1:47 AM UTC
aaf4027ee783ec6764d12b9fea262aaecc1641a08fc2174099b4617e2cc248caCOPY
tests /workspace/nemo/tests
03/09/2022 1:47 AM UTC
2a68968539d249e9693b2e226fd7b5f41f7fff07a52ec8ce4a6a19fa5dd121f7COPY
examples /workspace/nemo/examples
03/09/2022 1:47 AM UTC
607402eca8d2f206ce6557da9f3db2404aef73afd924aad86eecf60a48307908COPY
scripts /workspace/nemo/scripts
03/09/2022 1:47 AM UTC
9a3ed8095c4ca0007755da1d8e0559f4ac7f2ef607ef7cfa750c4327dbbf9964WORKDIR
/workspace/nemo
03/09/2022 1:47 AM UTC
14705499fd5e492a5077ad7ce6cc46b8fd29a80557374db6048165d7d27d8619RUN
NEMO_VERSION=1.7.1 rm -rf /opt/conda/pkgs/conda-4.11.0-py38h578d9bd_0/info/test/tests/data/env_metadata/
03/09/2022 1:47 AM UTC
6378a35a8e3b5305cb228b772f9b9f6709ad45299098fceb484a6350a1794436RUN
NEMO_VERSION=1.7.1 cd /tmp/nemo &&
  pip install ".[all]" &&
  sed -i "s/_module_available(\"torchtext\")/False/g" /opt/conda/lib/python3.8/site-packages/pytorch_lightning/utilities/imports.py &&
  python -c "import nemo.collections.asr as nemo_asr" &&
  python -c "import nemo.collections.nlp as nemo_nlp" &&
  python -c "import nemo.collections.tts as nemo_tts" &&
  python -c "import nemo_text_processing.text_normalization as text_normalization"
03/09/2022 1:47 AM UTC
f48ac98975b286dfec83b75f8129d1cf9125fbdb026de40675df4b04de91a2b4RUN
NEMO_VERSION=1.7.1 /usr/bin/test -n "$NEMO_VERSION" &&
  /bin/echo "export NEMO_VERSION=${NEMO_VERSION}" >> /root/.bashrc &&
  /bin/echo "export BASE_IMAGE=${BASE_IMAGE}" >> /root/.bashrc
03/09/2022 1:46 AM UTC
4cacaabc85da3ee556a4807b720a42180e15c835cceb8179449e0e50d1166abbARG
NEMO_VERSION=1.7.1
03/09/2022 1:46 AM UTC
...