NeMo Framework Megatron Backend

NVIDIA

Container

NVIDIA

NeMo Framework Megatron Backend

NVIDIA NeMo™ framework Megatron backend supports pre-training, post-training, and reinforcement learning of LLMs and multi-modal generative AI models with state-of-the-art data processing, model training techniques, and flexible deployment options.

NVIDIA AI Enterprise Supported

Layer	Label		Created
4be76f390965d6aa774fda9af8757efd03e80cfe40db6f784cde2002f666f9b1	CONFIG	`Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /workspace; ExposedPorts 6006/tcp, 8888/tcp`	08/02/2024 11:09 PM UTC
0d59a06e5098bcbe258f33ec8678d7590cf85e1e8d64c7296b2b187627a7347a	ARG	`NVIDIA_BUILD_REF`	08/02/2024 11:09 PM UTC
a49c49c780e5c72e1253c7971c2841dac25853eb7f2df2f891209a5380dab85d	LABEL	`com.nvidia.build.id=85286408`	08/02/2024 11:09 PM UTC
6ea05cf70eb8dedb5053a690744adb36ba2bc380469e56ad388ca8932c866462	ENV	`NVIDIA_BUILD_ID=85286408`	08/02/2024 11:09 PM UTC
5213e470cb8a663595dbea8e161d2c487f00d0bb45af07707993dba43e934322	ARG	`NVIDIA_BUILD_ID`	08/02/2024 11:09 PM UTC
537553433aa26afb7e1f6b1f3896ada876482d0d985f8f4caaef1f63c032f32a	RUN	`NVIDIA_BIGNLP_VERSION= TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= APEX_COMMIT= TE_COMMIT=7d576ed25266a17a7b651f2c12e8498f67e0baea MCORE_COMMIT=core_r0.8.0 ALIGNER_COMMIT=r0.4.0rc0 LAUNCHER_COMMIT= DATA_CURATOR_COMMIT= NEMO_COMMIT=r2.0.0rc1 chmod -R a+w /workspace`	08/02/2024 11:09 PM UTC
0e284ec76d5bd39d590b8056c805fec54767393ed6e40434d0a470f4e676b162	WORKDIR	`/workspace`	08/02/2024 11:09 PM UTC
741174717e9a12850d1d174b78eb1bb407406541e0b99b0d96031600b4b06a63	RUN	`NVIDIA_BIGNLP_VERSION= TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= APEX_COMMIT= TE_COMMIT=7d576ed25266a17a7b651f2c12e8498f67e0baea MCORE_COMMIT=core_r0.8.0 ALIGNER_COMMIT=r0.4.0rc0 LAUNCHER_COMMIT= DATA_CURATOR_COMMIT= NEMO_COMMIT=r2.0.0rc1 python -c "from transformers import CLIPImageProcessor; vit_p=CLIPImageProcessor.from_pretrained('openai/clip-vit-large-patch14'); vit_p_336=CLIPImageProcessor.from_pretrained('openai/clip-vit-large-patch14-336');"`	08/02/2024 11:09 PM UTC
468da3d7616513153c13cf39d938057acb9d64e2e4d216ee379df3cda4bbe6fc	RUN	`NVIDIA_BIGNLP_VERSION= TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= APEX_COMMIT= TE_COMMIT=7d576ed25266a17a7b651f2c12e8498f67e0baea MCORE_COMMIT=core_r0.8.0 ALIGNER_COMMIT=r0.4.0rc0 LAUNCHER_COMMIT= DATA_CURATOR_COMMIT= NEMO_COMMIT=r2.0.0rc1 python -c "from transformers import AutoTokenizer; vit_l_tokenizer=AutoTokenizer.from_pretrained('openai/clip-vit-large-patch14');"`	08/02/2024 11:09 PM UTC
6eaf264a248f5c2f382d588539b099f8fe7e12a5c46568adff794d88728e554a	RUN	NVIDIA_BIGNLP_VERSION= TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= APEX_COMMIT= TE_COMMIT=7d576ed25266a17a7b651f2c12e8498f67e0baea MCORE_COMMIT=core_r0.8.0 ALIGNER_COMMIT=r0.4.0rc0 LAUNCHER_COMMIT= DATA_CURATOR_COMMIT= NEMO_COMMIT=r2.0.0rc1 python -c "from transformers import AutoTokenizer; tok_llama3_8b=AutoTokenizer.from_pretrained('meta-llama/Meta-Llama-3-8B'); tok_llama3_70b=AutoTokenizer.from_pretrained('meta-llama/Meta-Llama-3-70B'); tok_llama3_8b_inst=AutoTokenizer.from_pretrained('meta-llama/Meta-Llama-3-8B-instruct'); tok_llama3_70b_inst=AutoTokenizer.from_pretrained('meta-llama/Meta-Llama-3-70B-instruct');"	08/02/2024 11:09 PM UTC