NeMo Framework Megatron Backend

NVIDIA

Container

NVIDIA

NeMo Framework Megatron Backend

NVIDIA NeMo™ framework Megatron backend supports pre-training, post-training, and reinforcement learning of LLMs and multi-modal generative AI models with state-of-the-art data processing, model training techniques, and flexible deployment options.

NVIDIA AI Enterprise Supported

Layer	Label		Created
ccda1a63f7777c9b5608f766c92c73f50f0a193dfbade62551f972f9226d31c1	CONFIG	`Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /workspace/nemo; ExposedPorts 6006/tcp, 8888/tcp`	03/07/2023 9:37 PM UTC
5be3fa1cb47c56b1d107dda96919b41c48731dd4fc1bea5514c2ceb600f1f08e	ARG	`AIS_BIN=https://github.com/NVIDIA/aistore/releases/download/v1.3.15/ais-linux-amd64.tar.gz`	03/07/2023 9:36 PM UTC
14c9a2ae33ee1c338d624e44957c579bee0e6cb03a422a56e83cf56b859f9ff6	ARG	`AIS_VERSION=v1.3.15`	03/07/2023 9:36 PM UTC
c6e18f14a0c2f5b58bd0b32d476bf00ef393a6d0d40b52e9afe5ce5adec8aa64	RUN	`NEMO_VERSION=1.16.0 printf "#!/bin/bash\njupyter lab --no-browser --allow-root --ip=0.0.0.0" >> start-jupyter.sh && chmod +x start-jupyter.sh`	03/07/2023 9:36 PM UTC
d46c94de92add24094ac55eaee1287d9a3b77dbe1cde05ef73e4164ae75fbb5c	COPY	`tutorials /workspace/nemo/tutorials`	03/07/2023 9:36 PM UTC
8e354028d5ff951c18297a77152a5a5935e5686e567b2942b09f1f60c0eacc41	COPY	`tests /workspace/nemo/tests`	03/07/2023 9:36 PM UTC
f817dd90d0da91237c9915b8ddbf8bd2b330e3c2cfb15316ab08c7757d86483f	COPY	`examples /workspace/nemo/examples`	03/07/2023 9:36 PM UTC
86bff672f4b5385c26bd0e68571f2ac2dbc3d76324815b6a85651591ad5b9b4a	COPY	`scripts /workspace/nemo/scripts`	03/07/2023 9:36 PM UTC
b2d370c5c56f1e4cbf9b6551fa98431b212eb7000b383beca3147a01d8ea571e	WORKDIR	`/workspace/nemo`	03/07/2023 9:36 PM UTC
41edbb0f9ee338b34017a453f87eea2d58cbb96373fafe2ac3e462e147e55a4c	RUN	`NEMO_VERSION=1.16.0 pip install numba==0.53.1`	03/07/2023 9:36 PM UTC