ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
  • NVIDIA
    NVIDIA
    NeMo Framework Megatron Backend
    Container
    NVIDIA
    NVIDIA
    NeMo Framework Megatron Backend

    NVIDIA NeMo™ framework Megatron backend supports pre-training, post-training, and reinforcement learning of LLMs and multi-modal generative AI models with state-of-the-art data processing, model training techniques, and flexible deployment options.

  • LayerLabelCreated
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4LABEL
    com.nvidia.build.ref=
    		11/08/2024 1:48 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
    NVIDIA_BUILD_REF
    		11/08/2024 1:48 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4LABEL
    com.nvidia.build.id=100464919
    		11/08/2024 1:48 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    NVIDIA_BUILD_ID=100464919
    		11/08/2024 1:48 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
    NVIDIA_BUILD_ID
    		11/08/2024 1:48 AM UTC
    sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1RUN
    NVIDIA_BIGNLP_VERSION= TRT_VER=10.3.0.26 CUDA_VER=12.5 CUDNN_VER=9.3.0.75-1 NCCL_VER= CUBLAS_VER=12.5.3.2-1 NVRTC_VER=12.5.82-1 APEX_COMMIT=b7a4acc1c8599f9306b519c9a88c044f1b280a07 TE_COMMIT=2215fa5c7557b66034068816020f9f611019e457 MCORE_COMMIT=core_r0.9.0 SRC_DIR=/src/tensorrt_llm CPP_BUILD_DIR=/src/tensorrt_llm/cpp/build ALIGNER_COMMIT=r0.5.0 LAUNCHER_COMMIT=35e439393e2ec8cfb874aa5aec3eac6e73219b37 DATA_CURATOR_COMMIT=r0.5.0 NEMO_COMMIT=r2.0.0 NEMO_RUN_COMMIT=r0.1.0 chmod -R a+w /workspace
    		11/08/2024 1:48 AM UTC
    sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1WORKDIR
    /workspace
    		11/08/2024 1:48 AM UTC
    sha256:0d8994fa8eb8a5ff4f2d63b76c1de8dde755e677fe1e06475ac7f7f56e233267RUN
    NVIDIA_BIGNLP_VERSION= TRT_VER=10.3.0.26 CUDA_VER=12.5 CUDNN_VER=9.3.0.75-1 NCCL_VER= CUBLAS_VER=12.5.3.2-1 NVRTC_VER=12.5.82-1 APEX_COMMIT=b7a4acc1c8599f9306b519c9a88c044f1b280a07 TE_COMMIT=2215fa5c7557b66034068816020f9f611019e457 MCORE_COMMIT=core_r0.9.0 SRC_DIR=/src/tensorrt_llm CPP_BUILD_DIR=/src/tensorrt_llm/cpp/build ALIGNER_COMMIT=r0.5.0 LAUNCHER_COMMIT=35e439393e2ec8cfb874aa5aec3eac6e73219b37 DATA_CURATOR_COMMIT=r0.5.0 NEMO_COMMIT=r2.0.0 NEMO_RUN_COMMIT=r0.1.0 python -c "from transformers import CLIPImageProcessor; vit_p=CLIPImageProcessor.from_pretrained('openai/clip-vit-large-patch14'); vit_p_336=CLIPImageProcessor.from_pretrained('openai/clip-vit-large-patch14-336');"
    		11/08/2024 1:48 AM UTC
    sha256:e84999575cfde1d5aef28e52a3f8a281ca2d6530404fc14d0f1835162e1ee979RUN
    NVIDIA_BIGNLP_VERSION= TRT_VER=10.3.0.26 CUDA_VER=12.5 CUDNN_VER=9.3.0.75-1 NCCL_VER= CUBLAS_VER=12.5.3.2-1 NVRTC_VER=12.5.82-1 APEX_COMMIT=b7a4acc1c8599f9306b519c9a88c044f1b280a07 TE_COMMIT=2215fa5c7557b66034068816020f9f611019e457 MCORE_COMMIT=core_r0.9.0 SRC_DIR=/src/tensorrt_llm CPP_BUILD_DIR=/src/tensorrt_llm/cpp/build ALIGNER_COMMIT=r0.5.0 LAUNCHER_COMMIT=35e439393e2ec8cfb874aa5aec3eac6e73219b37 DATA_CURATOR_COMMIT=r0.5.0 NEMO_COMMIT=r2.0.0 NEMO_RUN_COMMIT=r0.1.0 python -c "from transformers import AutoTokenizer; vit_l_tokenizer=AutoTokenizer.from_pretrained('openai/clip-vit-large-patch14');"
    		11/08/2024 1:48 AM UTC
    sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1RUN
    NVIDIA_BIGNLP_VERSION= TRT_VER=10.3.0.26 CUDA_VER=12.5 CUDNN_VER=9.3.0.75-1 NCCL_VER= CUBLAS_VER=12.5.3.2-1 NVRTC_VER=12.5.82-1 APEX_COMMIT=b7a4acc1c8599f9306b519c9a88c044f1b280a07 TE_COMMIT=2215fa5c7557b66034068816020f9f611019e457 MCORE_COMMIT=core_r0.9.0 SRC_DIR=/src/tensorrt_llm CPP_BUILD_DIR=/src/tensorrt_llm/cpp/build ALIGNER_COMMIT=r0.5.0 LAUNCHER_COMMIT=35e439393e2ec8cfb874aa5aec3eac6e73219b37 DATA_CURATOR_COMMIT=r0.5.0 NEMO_COMMIT=r2.0.0 NEMO_RUN_COMMIT=r0.1.0 python -c "from transformers import AutoTokenizer; tok_llama3_8b=AutoTokenizer.from_pretrained('meta-llama/Meta-Llama-3-8B');  tok_llama3_70b=AutoTokenizer.from_pretrained('meta-llama/Meta-Llama-3-70B');  tok_llama3_8b_inst=AutoTokenizer.from_pretrained('meta-llama/Meta-Llama-3-8B-instruct');  tok_llama3_70b_inst=AutoTokenizer.from_pretrained('meta-llama/Meta-Llama-3-70B-instruct');"
    		11/08/2024 1:48 AM UTC
    ...