NVIDIA
NVIDIA
NeMo Framework Megatron Backend
Container
NVIDIA
NVIDIA
NeMo Framework Megatron Backend

NVIDIA NeMo™ framework Megatron backend supports pre-training, post-training, and reinforcement learning of LLMs and multi-modal generative AI models with state-of-the-art data processing, model training techniques, and flexible deployment options.

  • LayerLabelCreated
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4LABEL
    com.nvidia.build.ref=
    06/27/2024 7:25 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
    NVIDIA_BUILD_REF
    06/27/2024 7:25 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4LABEL
    com.nvidia.build.id=82611821
    06/27/2024 7:25 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    NVIDIA_BUILD_ID=82611821
    06/27/2024 7:25 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
    NVIDIA_BUILD_ID
    06/27/2024 7:25 AM UTC
    sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1RUN
    NVIDIA_BIGNLP_VERSION= TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= APEX_COMMIT=810ffae374a2b9cb4b5c5e28eaeca7d7998fca0c TE_COMMIT=a51ff542dcb1f605aa54f9b0e1aaadb132acd53d MCORE_COMMIT=core_r0.7.0 ALIGNER_COMMIT=dev LAUNCHER_COMMIT=24.05rc DATA_CURATOR_COMMIT=e927313dbc602e2310628dec70f9f25490fedb29 NEMO_COMMIT=r2.0.0rc0 chmod -R a+w /workspace
    06/27/2024 7:25 AM UTC
    sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1WORKDIR
    /workspace
    06/27/2024 7:25 AM UTC
    sha256:488558df44e19f1e63d33c1f6f667a1ef9d893e1da2473993c0ef81c2cdd7377RUN
    NVIDIA_BIGNLP_VERSION= TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= APEX_COMMIT=810ffae374a2b9cb4b5c5e28eaeca7d7998fca0c TE_COMMIT=a51ff542dcb1f605aa54f9b0e1aaadb132acd53d MCORE_COMMIT=core_r0.7.0 ALIGNER_COMMIT=dev LAUNCHER_COMMIT=24.05rc DATA_CURATOR_COMMIT=e927313dbc602e2310628dec70f9f25490fedb29 NEMO_COMMIT=r2.0.0rc0 pip uninstall -y causal-conv1d &&
      pip install --no-cache-dir 'causal-conv1d==1.2.0.post2'
    06/27/2024 7:25 AM UTC
    sha256:5991902ca8ac841e4f2b45ba64076ca23f65cf49f1d7188a97efde01144d9f49RUN
    NVIDIA_BIGNLP_VERSION= TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= APEX_COMMIT=810ffae374a2b9cb4b5c5e28eaeca7d7998fca0c TE_COMMIT=a51ff542dcb1f605aa54f9b0e1aaadb132acd53d MCORE_COMMIT=core_r0.7.0 ALIGNER_COMMIT=dev LAUNCHER_COMMIT=24.05rc DATA_CURATOR_COMMIT=e927313dbc602e2310628dec70f9f25490fedb29 NEMO_COMMIT=r2.0.0rc0 pip uninstall -y jupyterlab aiohttp onnx &&
      pip install --no-cache-dir jupyterlab==3.6.7 aiohttp==3.9.5 onnx==1.16.0
    06/27/2024 7:24 AM UTC
    sha256:eca1597c9a2deb9da635e6d5bd2479e85ef30fdf611326a968541f8d9e4fbbb1RUN
    NVIDIA_BIGNLP_VERSION= TRT_VER= CUDA_VER= CUDNN_VER= NCCL_VER= CUBLAS_VER= APEX_COMMIT=810ffae374a2b9cb4b5c5e28eaeca7d7998fca0c TE_COMMIT=a51ff542dcb1f605aa54f9b0e1aaadb132acd53d MCORE_COMMIT=core_r0.7.0 ALIGNER_COMMIT=dev LAUNCHER_COMMIT=24.05rc DATA_CURATOR_COMMIT=e927313dbc602e2310628dec70f9f25490fedb29 NEMO_COMMIT=r2.0.0rc0 python -c "from transformers import CLIPImageProcessor; vit_p=CLIPImageProcessor.from_pretrained('openai/clip-vit-large-patch14'); vit_p_336=CLIPImageProcessor.from_pretrained('openai/clip-vit-large-patch14-336');"
    06/27/2024 7:24 AM UTC
    ...