NVIDIA
NVIDIA
NeMo Framework Megatron Backend
Container
NVIDIA
NVIDIA
NeMo Framework Megatron Backend

NVIDIA NeMo™ framework Megatron backend supports pre-training, post-training, and reinforcement learning of LLMs and multi-modal generative AI models with state-of-the-art data processing, model training techniques, and flexible deployment options.

LayerLabelCreated
bd1fbf367b5bf3ca57c2cc56e993b77e699005d49d363e5d13fadb0e674fc3b5CONFIG
Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /workspace/nemo; ExposedPorts 6006/tcp, 8888/tcp
04/27/2022 11:21 PM UTC
8bc7cf7b64a671ae0b4b47da09ba55dc0cc7f402e92094d5b52360ba38bbb5abRUN
NEMO_VERSION=1.8.2 rm -rf /opt/conda/pkgs/conda-4.11.0-py38h578d9bd_0/info/test/tests/data/env_metadata/
04/27/2022 11:21 PM UTC
0449ed3dfa8020e17f25d8b2ed63b21ce1726a4416511e24e98518cf14327766COPY
tutorials /workspace/nemo/tutorials
04/27/2022 11:21 PM UTC
fe0fba666da917552000b6e4d24b14fb875a24807409b72594d67d3585468cd2COPY
tests /workspace/nemo/tests
04/27/2022 11:21 PM UTC
f41a8328bbc6346f13b54b27a075f7f7873382118be5f762b7b6e3d6a36a71d3COPY
examples /workspace/nemo/examples
04/27/2022 11:21 PM UTC
cf3ff7850228e816aa35e18a8c5f907cd007490db7f42b6192d882977bbfb012COPY
scripts /workspace/nemo/scripts
04/27/2022 11:21 PM UTC
b78044d53bae62044874165491fc3719f6beb3cdfa880bc36c3010b793cf61b2WORKDIR
/workspace/nemo
04/27/2022 11:21 PM UTC
d51b1830033bb2fe0697828d351a09a3b52d4890afb74866da8c4572c13b6f6eRUN
NEMO_VERSION=1.8.2 cd /tmp/nemo &&
  pip install ".[all]" &&
  sed -i "s/_module_available(\"torchtext\")/False/g" /opt/conda/lib/python3.8/site-packages/pytorch_lightning/utilities/imports.py &&
  python -c "import nemo.collections.asr as nemo_asr" &&
  python -c "import nemo.collections.nlp as nemo_nlp" &&
  python -c "import nemo.collections.tts as nemo_tts" &&
  python -c "import nemo_text_processing.text_normalization as text_normalization"
04/27/2022 11:21 PM UTC
49e050ff8ca10a410a9ba169e159e1c05853e4ef43a6d245b3422321e4ec6c10RUN
NEMO_VERSION=1.8.2 /usr/bin/test -n "$NEMO_VERSION" &&
  /bin/echo "export NEMO_VERSION=${NEMO_VERSION}" >> /root/.bashrc &&
  /bin/echo "export BASE_IMAGE=${BASE_IMAGE}" >> /root/.bashrc
04/27/2022 11:21 PM UTC
29017d231113d17a067ff832a03482afccc3c75632c6f3b5a98cc246fbc03c56ARG
NEMO_VERSION=1.8.2
04/27/2022 11:21 PM UTC
...