NeMo Framework Megatron Backend

NVIDIA

Container

NVIDIA

NeMo Framework Megatron Backend

NVIDIA NeMo™ framework Megatron backend supports pre-training, post-training, and reinforcement learning of LLMs and multi-modal generative AI models with state-of-the-art data processing, model training techniques, and flexible deployment options.

NVIDIA AI Enterprise Supported

Layer	Label		Created
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	LABEL	`com.nvidia.build.ref=`	02/21/2024 4:31 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ARG	`NVIDIA_BUILD_REF`	02/21/2024 4:31 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	LABEL	`com.nvidia.build.id=80741402`	02/21/2024 4:31 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NVIDIA_BUILD_ID=80741402`	02/21/2024 4:31 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ARG	`NVIDIA_BUILD_ID`	02/21/2024 4:31 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NVTE_APPLY_QK_LAYER_SCALING=0`	02/21/2024 4:31 AM UTC
sha256:c98290d73e3437a660a574ef52bb2c212508b936cb426723125fc55de6a4fa2a	RUN	`chmod -R a+w /workspace`	02/21/2024 4:31 AM UTC
sha256:fbb7ac0b5d3b76ee48b7b5130335a30d9bbacd71f73aa6941dc8749647418341	COPY	`sequence_packing sequence_packing`	02/21/2024 4:31 AM UTC
sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1	WORKDIR	`/workspace`	02/21/2024 4:31 AM UTC
sha256:a3fe9578f7d20bc3399157e3cc7bf2a758a5e36329dfa5cc30b18f4b3812dd63	RUN	`rm -r /tmp/inflight_batcher_llm && rm -r /tmp/tensorrt_llm`	02/21/2024 4:31 AM UTC