NeMo Framework Megatron Backend

NVIDIA

Container

NVIDIA

NeMo Framework Megatron Backend

NVIDIA NeMo™ framework Megatron backend supports pre-training, post-training, and reinforcement learning of LLMs and multi-modal generative AI models with state-of-the-art data processing, model training techniques, and flexible deployment options.

NVIDIA AI Enterprise Supported

Layer	Label		Created
sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1	WORKDIR	`/opt`	04/09/2024 2:35 AM UTC
sha256:4a50c9552cd8a71babb0c2e011a02fe72a8368b0f7faac0f55c01105d2850a0e	RUN	`git clone https://github.com/NVIDIA/NeMo.git && cd NeMo && git checkout chcui/conversion_precision_on_24.03 && mkdir -p /opt/NeMo/scripts/checkpoint_converters && cp scripts/checkpoint_converters/* /opt/NeMo/scripts/checkpoint_converters && rm /tmp/NeMo -r`	04/09/2024 2:35 AM UTC
sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1	WORKDIR	`/tmp`	04/09/2024 2:35 AM UTC
sha256:1711e5690843d70130a5867bb5411f86877b431244bbbc1914c7dbb9e55f78e2	COPY	`llm_inference/changes/megatron_gpt_model.py /opt/NeMo/nemo/collections/nlp/models/language_modeling/megatron_gpt_model.py`	04/09/2024 2:35 AM UTC
sha256:4d601922de02009248c58988e08b0fb4dda3ff39524e52bb786a8614f7492d37	COPY	`llm_inference/nemo-fw/scripts/export /opt/NeMo/scripts/export`	04/09/2024 2:35 AM UTC
sha256:8d37603c452994ddc19b5050aa292e0a1392800453d527014c345560f2751111	COPY	`llm_inference/nemo-fw/scripts/deploy /opt/NeMo/scripts/deploy`	04/09/2024 2:35 AM UTC
sha256:4c9edcc44754b0d0a75d391c38df38d33d32c5e13115e9721ba94ba0e6ddc01f	COPY	`llm_inference/nemo-fw/nemo/export /opt/NeMo/nemo/export`	04/09/2024 2:35 AM UTC
sha256:ae212bbbc180cd30039efe9cd2402abdd3fe48d316e477dbff2c224050c8a694	COPY	`llm_inference/nemo-fw/nemo/deploy /opt/NeMo/nemo/deploy`	04/09/2024 2:35 AM UTC
sha256:c21e78ec52a52625e68ec7bee29dada3d697ece338fd59ad83ea3914c9fdfb7e	RUN	`ln -sv $(python3 -c 'import site; print(f"{site.getsitepackages()[0]}/tensorrt_llm/libs")') lib && test -f lib/libnvinfer_plugin_tensorrt_llm.so && ln -sv lib/libnvinfer_plugin_tensorrt_llm.so lib/libnvinfer_plugin_tensorrt_llm.so.9 && echo "/app/tensorrt_llm/lib" > /etc/ld.so.conf.d/tensorrt_llm.conf && ldconfig`	03/18/2024 2:59 PM UTC
sha256:ae1dd4276f3e78f9062a56060bb180a527e98b3598c88216ba8d53d17242892d	RUN	`pip install tensorrt_llm.whl --extra-index-url https://pypi.nvidia.com && rm tensorrt_llm.whl`	03/18/2024 2:59 PM UTC