NeMo Framework Megatron Backend

NVIDIA

Container

NVIDIA

NeMo Framework Megatron Backend

NVIDIA NeMo™ framework Megatron backend supports pre-training, post-training, and reinforcement learning of LLMs and multi-modal generative AI models with state-of-the-art data processing, model training techniques, and flexible deployment options.

NVIDIA AI Enterprise Supported

Layer	Label		Created
103786e9c18d561c88f5411d24c3e82c0bdbe396c153318e5745069d27489cab	CONFIG	`Entrypoint /usr/local/bin/nvidia_entrypoint.sh; WorkingDir /workspace/nemo; ExposedPorts 6006/tcp, 8888/tcp`	12/11/2020 7:06 PM UTC
3497f3228288ae114aaaeb5fc5dfedf49e3678bcd53c1114321a067b7ae06d21	COPY	`tutorials /workspace/nemo/tutorials`	12/11/2020 7:06 PM UTC
c8289bf792cc43fdcbb04192b975c1a0abefe9b98f0034c7cd233bd85c217fc9	COPY	`tests /workspace/nemo/tests`	12/11/2020 7:06 PM UTC
bb7baf88852cc7cbe83208a047d56628f21003e61558fcfe93dd7857f8532714	COPY	`examples /workspace/nemo/examples`	12/11/2020 7:06 PM UTC
001d93db90dc78ea95333c5593c29238645ff7816f6ccda647bec1b78fb3c7e2	COPY	`scripts /workspace/nemo/scripts`	12/11/2020 7:06 PM UTC
db0a45d4c06bab934389a9e54132f89bcb981ff3ba6e97a1665d226b47e64b0c	WORKDIR	`/workspace/nemo`	12/11/2020 7:06 PM UTC
a13cca312838248bffaa6378f3c8b19354a6e02957a9b5ed9eb68eddbc7d5ceb	RUN	`NEMO_VERSION=v1.0.0b2-2-g93a3d8b7 cd /tmp/nemo && pip install ".[all]"`	12/11/2020 7:06 PM UTC
5c12062bdf813b6e27e8ffcf53cacc4cf2ba98a8c0ce718a24743e392389c96e	RUN	`NEMO_VERSION=v1.0.0b2-2-g93a3d8b7 /usr/bin/test -n "$NEMO_VERSION" && /bin/echo "export NEMO_VERSION=${NEMO_VERSION}" >> /root/.bashrc && /bin/echo "export BASE_IMAGE=${BASE_IMAGE}" >> /root/.bashrc`	12/11/2020 7:05 PM UTC
f3e1151a5fc7d5cd29eedc84d399c9936d17579a25df89fc46241efd4fd3ac7e	ARG	`NEMO_VERSION=1.0.0b3`	12/11/2020 1:28 AM UTC
35b35d6e1025d58b9bff7704058e9547c4d3842c3ea542c97ee2c94f47e1b631	RUN	`for f in $(ls requirements/*.txt); do pip install --disable-pip-version-check --no-cache-dir -r $f; done`	12/11/2020 1:28 AM UTC