NeMo Framework Megatron Backend

NVIDIA

Container

NVIDIA

NeMo Framework Megatron Backend

NVIDIA NeMo™ framework Megatron backend supports pre-training, post-training, and reinforcement learning of LLMs and multi-modal generative AI models with state-of-the-art data processing, model training techniques, and flexible deployment options.

NVIDIA AI Enterprise Supported

Layer	Label		Created
sha256:ad5a0d694a39a9abf56029791aead1da98a4ea312a53b0e540b476df6ded7e18	COPY	`./scripts/nlp_language_modeling/merge_lora_weights/merge.py /opt/NeMo/scripts/nlp_language_modeling/merge_lora_weights/merge.py`	02/28/2024 3:38 PM UTC
sha256:27a5e2d9d91402145adc20c791c6b54a9daa5c784348b8e4d73406d7e35d8f09	COPY	`./scripts/nlp_language_modeling/convert_nemo_starcoder2_to_hf.py /opt/NeMo/scripts/nlp_language_modeling/convert_nemo_starcoder2_to_hf.py`	02/28/2024 3:38 PM UTC
sha256:f0cf030ee594081aa616b33eca92237a1657cb0d84253df92f9b3d254f50bbd1	COPY	`./scripts/nlp_language_modeling/convert_hf_starcoder2_to_nemo.py /opt/NeMo/scripts/nlp_language_modeling/convert_hf_starcoder2_to_nemo.py`	02/28/2024 3:38 PM UTC
sha256:1b7d1a56123f2b4f49f851a7bc37bbdd2974cbc3f2b6db2348c76cccfd33f320	COPY	`./examples/nlp/language_modeling/conf/megatron_starcoder2_config.yaml /opt/NeMo/examples/nlp/language_modeling/conf/megatron_starcoder2_config.yaml`	02/28/2024 3:38 PM UTC
sha256:6b2903450e20596ec1bdac0272f415b948ccaa80181865983a3a78a0b9222143	COPY	`llm_inference/nemo-fw/scripts/deploy /opt/NeMo/scripts/deploy`	02/27/2024 4:08 AM UTC
sha256:f4f5dbbb59a9c1bf0405abcc8cb3d77d60094cbf69697c39fab9c66223d6fd09	COPY	`llm_inference/nemo-fw/scripts/export /opt/NeMo/scripts/export`	02/27/2024 4:08 AM UTC
sha256:d146205adbd204a807c4e7d32b02870a94712477e220b2e6b5a14da7d6b28d29	COPY	`llm_inference/nemo-fw/nemo/deploy /opt/NeMo/nemo/deploy`	02/27/2024 4:08 AM UTC
sha256:d55a23c357e280adb325e2562bed9f9203778868303de6db6d33201e066bdc83	COPY	`llm_inference/nemo-fw/nemo/export /opt/NeMo/nemo/export`	02/27/2024 4:08 AM UTC
sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1	WORKDIR	`/opt`	02/27/2024 12:38 AM UTC
sha256:ea828c3ff342bec93b1372d356af4b06bd4b9246f3feb5a8cf9f862e1c400937	RUN	`rm -r /tmp/tensorrt_llm`	02/27/2024 12:38 AM UTC