NVIDIA
NVIDIA
NeMo Framework Megatron Backend
Container
NVIDIA
NVIDIA
NeMo Framework Megatron Backend

NVIDIA NeMo™ framework Megatron backend supports pre-training, post-training, and reinforcement learning of LLMs and multi-modal generative AI models with state-of-the-art data processing, model training techniques, and flexible deployment options.

  • LayerLabelCreated
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4LABEL
    com.nvidia.build.ref=
    05/29/2024 10:33 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
    NVIDIA_BUILD_REF
    05/29/2024 10:33 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4LABEL
    com.nvidia.build.id=82611821
    05/29/2024 10:33 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    NVIDIA_BUILD_ID=82611821
    05/29/2024 10:33 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
    NVIDIA_BUILD_ID
    05/29/2024 10:33 AM UTC
    sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1RUN
    NEMO_COMMIT=r2.0.0rc0 chmod -R a+w /workspace
    05/29/2024 10:33 AM UTC
    sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1WORKDIR
    /workspace
    05/29/2024 10:33 AM UTC
    sha256:c14507976096909c5cd47ddef2c56d960774d6d58d41c1cb1bbec1f809ae940bRUN
    NEMO_COMMIT=r2.0.0rc0 pip uninstall -y causal-conv1d &&
      pip install --no-cache-dir 'causal-conv1d==1.2.0.post2'
    05/29/2024 10:33 AM UTC
    sha256:4a1ef4d3d2c93a31167897e3b0d9692ba773c6c962bb161448d2f6474de82950RUN
    NEMO_COMMIT=r2.0.0rc0 pip uninstall -y jupyterlab aiohttp onnx &&
      pip install --no-cache-dir jupyterlab==3.6.7 aiohttp==3.9.5 onnx==1.16.0
    05/29/2024 10:33 AM UTC
    sha256:a3c50a0e46b96d9be2c381cc7ce0b766b4fd5457873e9440656013a6978afbf4RUN
    NEMO_COMMIT=r2.0.0rc0 python -c "from transformers import CLIPImageProcessor; vit_p=CLIPImageProcessor.from_pretrained('openai/clip-vit-large-patch14'); vit_p_336=CLIPImageProcessor.from_pretrained('openai/clip-vit-large-patch14-336');"
    05/29/2024 10:32 AM UTC
    ...