NVIDIA
NVIDIA
NeMo Framework Megatron Backend
Container
NVIDIA
NVIDIA
NeMo Framework Megatron Backend

NVIDIA NeMo™ framework Megatron backend supports pre-training, post-training, and reinforcement learning of LLMs and multi-modal generative AI models with state-of-the-art data processing, model training techniques, and flexible deployment options.

LayerLabelCreated
223e2452c9702b35e7a6f289f3238acf3ee2f6e291029e80a5a3181983210d3cCONFIG
Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /workspace/nemo; ExposedPorts 6006/tcp, 8888/tcp
07/05/2022 8:58 PM UTC
0db93ec5dc1c923d2163be9203096702fc52abe4129f0e0dcde32c2ba5baf5cdRUN
NEMO_VERSION=1.10.0 printf "#!/bin/bash\njupyter lab --no-browser --allow-root --ip=0.0.0.0" >> start-jupyter.sh &&
  chmod +x start-jupyter.sh
07/05/2022 8:58 PM UTC
e8ba6c8414232e86b0dbaa8d3b57b3bdd43c1c78f496909826d38cffcea29760COPY
tutorials /workspace/nemo/tutorials
07/05/2022 8:58 PM UTC
68b915cfd0a31ba054b66becb11938b8bcf035d8ad4503564a9b9cfd3f27d52eCOPY
tests /workspace/nemo/tests
07/05/2022 8:58 PM UTC
2d2e267c44c4bad9c96f926075836da57d012479c39278bd6b995a0307dbe0ccCOPY
examples /workspace/nemo/examples
07/05/2022 8:58 PM UTC
0a04c090ae82dda7e190272bb9ae06387c8ddf05d7555deb05783c4285782763COPY
scripts /workspace/nemo/scripts
07/05/2022 8:58 PM UTC
1cde04994b4ad5b0af34dec598cc80c2d498a53cdb8a41a0ec4a426a2765e939WORKDIR
/workspace/nemo
07/05/2022 8:58 PM UTC
5672c166f6d34e5b75897a44a394ffbd0b3ee394f4a85bdcd6b5eba172845b64RUN
NEMO_VERSION=1.10.0 cd /tmp/nemo &&
  pip install ".[all]" &&
  sed -i "s/_module_available(\"torchtext\")/False/g" /opt/conda/lib/python3.8/site-packages/pytorch_lightning/utilities/imports.py &&
  python -c "import nemo.collections.asr as nemo_asr" &&
  python -c "import nemo.collections.nlp as nemo_nlp" &&
  python -c "import nemo.collections.tts as nemo_tts" &&
  python -c "import nemo_text_processing.text_normalization as text_normalization"
07/05/2022 8:58 PM UTC
f9b9e6e5624e5944a81fb3620bcc27032b3c2911930f2db2e46955e783f7706fRUN
NEMO_VERSION=1.10.0 /usr/bin/test -n "$NEMO_VERSION" &&
  /bin/echo "export NEMO_VERSION=${NEMO_VERSION}" >> /root/.bashrc &&
  /bin/echo "export BASE_IMAGE=${BASE_IMAGE}" >> /root/.bashrc
07/05/2022 8:58 PM UTC
cd86e70b562d0ff831e5cdf5fbf490d777b558afdf0871888f53e4f6a0d72a14ARG
NEMO_VERSION=1.10.0
07/05/2022 8:58 PM UTC
...