NeMo Framework Megatron Backend

NVIDIA

Container

NVIDIA

NeMo Framework Megatron Backend

NVIDIA NeMo™ framework Megatron backend supports pre-training, post-training, and reinforcement learning of LLMs and multi-modal generative AI models with state-of-the-art data processing, model training techniques, and flexible deployment options.

NVIDIA AI Enterprise Supported

Layer	Label		Created
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	LABEL	`com.nvidia.build.ref=`	04/01/2024 7:22 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ARG	`NVIDIA_BUILD_REF`	04/01/2024 7:22 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	LABEL	`com.nvidia.build.id=82611821`	04/01/2024 7:22 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NVIDIA_BUILD_ID=82611821`	04/01/2024 7:22 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ARG	`NVIDIA_BUILD_ID`	04/01/2024 7:22 PM UTC
sha256:51608a2bc20e2d07f38952642039c34da187817379a5feb21ef15e9e1fcc9137	RUN	`chmod -R a+w /workspace`	04/01/2024 7:22 PM UTC
sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1	WORKDIR	`/workspace`	04/01/2024 7:22 PM UTC
sha256:cd117190a3623db77d63ab127c950f43045273bf3f224df1c0f27c676a71109c	RUN	`TCNN_CUDA_ARCHITECTURES="52,60,61,70,75,80,86,89,90" pip install --no-cache-dir git+https://github.com/NVlabs/tiny-cuda-nn@6f018a9cd1b369bcb247e1d539968db8e48b2b3f#subdirectory=bindings/torch`	04/01/2024 7:22 PM UTC
sha256:dfc402b3a7d6c1f6fbee77de6935bec54c42a7f84824d3cff420eea3365bd44b	RUN	`cd /tmp && git clone https://github.com/ashawkey/stable-dreamfusion.git && cd stable-dreamfusion && git checkout 5550b91862a3af7842bb04875b7f1211e5095a63 && find . -type f -name 'setup.py' -exec sed -i 's/c++14/c++17/g' {} + && pip install --no-cache-dir ./raymarching && pip install --no-cache-dir ./shencoder && pip install --no-cache-dir ./freqencoder && TORCH_CUDA_ARCH_LIST="6.0 6.1 7.0 7.5 8.0 8.6 9.0+PTX" pip install --no-cache-dir ./gridencoder && cd /opt && rm -rf /tmp/stable-dreamfusion`	04/01/2024 6:35 PM UTC
sha256:fd1bcf5376ef05643e86d89db65ad941ddec9410548a1673d058530cc1f61334	RUN	`pip install --no-cache-dir git+https://github.com/NVlabs/nvdiffrast.git@c5caf7bdb8a2448acc491a9faa47753972edd380`	04/01/2024 6:08 PM UTC