NVIDIA
NVIDIA
NeMo Framework Megatron Backend
Container
NVIDIA
NVIDIA
NeMo Framework Megatron Backend

NVIDIA NeMo™ framework Megatron backend supports pre-training, post-training, and reinforcement learning of LLMs and multi-modal generative AI models with state-of-the-art data processing, model training techniques, and flexible deployment options.

LayerLabelCreated
07f1e3b6cb9659b28bb81c47069631b6b6c30848d2827c0b8ef450e611af1cf0CONFIG
Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /workspace/nemo; ExposedPorts 6006/tcp, 8888/tcp
09/26/2022 7:42 AM UTC
1d85ba690fd3baadcfc5a381cefc8694c4315bca56c9d8651838a97ee35f04c5RUN
NEMO_VERSION=1.11.0 printf "#!/bin/bash\njupyter lab --no-browser --allow-root --ip=0.0.0.0" >> start-jupyter.sh &&
  chmod +x start-jupyter.sh
09/26/2022 7:42 AM UTC
bf8af777ffcd77821141c5127cd65eab9262849317f5918adf231e4213e4f4e4COPY
tutorials /workspace/nemo/tutorials
09/26/2022 7:42 AM UTC
030b73bedaa9c637caae99b6edbbb0c323710903d22ef56d4715f36edd43da35COPY
tests /workspace/nemo/tests
09/26/2022 7:42 AM UTC
623bd3b639155445dd4b39ca437379246a43d5a287e32ee484b5ecd607d786dbCOPY
examples /workspace/nemo/examples
09/26/2022 7:42 AM UTC
ebf414aabc1ea5d02221b611fc652af65355a0e53ecc7d21fd3ae6f6dac89b1bCOPY
scripts /workspace/nemo/scripts
09/26/2022 7:42 AM UTC
d3286fa3b7c73cb9c9148a9e065708914ad1a539095ddaaa09f603b625aa939fWORKDIR
/workspace/nemo
09/26/2022 7:42 AM UTC
c3f78a176e90dff2bc30053d4e1772f288ff92dda5fc2cbce478f8d5c59a2785RUN
NEMO_VERSION=1.11.0 cd /tmp/nemo &&
  pip install ".[all]" &&
  sed -i "s/_module_available(\"torchtext\")/False/g" /opt/conda/lib/python3.8/site-packages/pytorch_lightning/utilities/imports.py &&
  python -c "import nemo.collections.asr as nemo_asr" &&
  python -c "import nemo.collections.nlp as nemo_nlp" &&
  python -c "import nemo.collections.tts as nemo_tts" &&
  python -c "import nemo_text_processing.text_normalization as text_normalization"
09/26/2022 7:42 AM UTC
7e2dd8a761c88a41ac0964db283de7c5de0f1852b6376062d98a4673e1d66c11RUN
NEMO_VERSION=1.11.0 /usr/bin/test -n "$NEMO_VERSION" &&
  /bin/echo "export NEMO_VERSION=${NEMO_VERSION}" >> /root/.bashrc &&
  /bin/echo "export BASE_IMAGE=${BASE_IMAGE}" >> /root/.bashrc
09/14/2022 9:26 PM UTC
af9784fc0a4d643750dfe83faa4f128996c2407147faa2096bd46f9eb6ecf5f3ARG
NEMO_VERSION=1.11.0
09/14/2022 9:26 PM UTC
...