ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA
NVIDIA
NeMo Framework Megatron Backend
Container
NVIDIA
NVIDIA
NeMo Framework Megatron Backend

NVIDIA NeMo™ framework Megatron backend supports pre-training, post-training, and reinforcement learning of LLMs and multi-modal generative AI models with state-of-the-art data processing, model training techniques, and flexible deployment options.

NVIDIA AI Enterprise Supported
LayerLabelCreated
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4LABEL
com.nvidia.build.ref=
11/08/2024 1:48 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
NVIDIA_BUILD_REF
11/08/2024 1:48 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4LABEL
com.nvidia.build.id=100464919
11/08/2024 1:48 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
NVIDIA_BUILD_ID=100464919
11/08/2024 1:48 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
NVIDIA_BUILD_ID
11/08/2024 1:48 AM UTC
sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1RUN
NVIDIA_BIGNLP_VERSION= TRT_VER=10.3.0.26 CUDA_VER=12.5 CUDNN_VER=9.3.0.75-1 NCCL_VER= CUBLAS_VER=12.5.3.2-1 NVRTC_VER=12.5.82-1 APEX_COMMIT=b7a4acc1c8599f9306b519c9a88c044f1b280a07 TE_COMMIT=2215fa5c7557b66034068816020f9f611019e457 MCORE_COMMIT=core_r0.9.0 SRC_DIR=/src/tensorrt_llm CPP_BUILD_DIR=/src/tensorrt_llm/cpp/build ALIGNER_COMMIT=r0.5.0 LAUNCHER_COMMIT=35e439393e2ec8cfb874aa5aec3eac6e73219b37 DATA_CURATOR_COMMIT=r0.5.0 NEMO_COMMIT=r2.0.0 NEMO_RUN_COMMIT=r0.1.0 chmod -R a+w /workspace
11/08/2024 1:48 AM UTC
sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1WORKDIR
/workspace
11/08/2024 1:48 AM UTC
sha256:0d8994fa8eb8a5ff4f2d63b76c1de8dde755e677fe1e06475ac7f7f56e233267RUN
NVIDIA_BIGNLP_VERSION= TRT_VER=10.3.0.26 CUDA_VER=12.5 CUDNN_VER=9.3.0.75-1 NCCL_VER= CUBLAS_VER=12.5.3.2-1 NVRTC_VER=12.5.82-1 APEX_COMMIT=b7a4acc1c8599f9306b519c9a88c044f1b280a07 TE_COMMIT=2215fa5c7557b66034068816020f9f611019e457 MCORE_COMMIT=core_r0.9.0 SRC_DIR=/src/tensorrt_llm CPP_BUILD_DIR=/src/tensorrt_llm/cpp/build ALIGNER_COMMIT=r0.5.0 LAUNCHER_COMMIT=35e439393e2ec8cfb874aa5aec3eac6e73219b37 DATA_CURATOR_COMMIT=r0.5.0 NEMO_COMMIT=r2.0.0 NEMO_RUN_COMMIT=r0.1.0 python -c "from transformers import CLIPImageProcessor; vit_p=CLIPImageProcessor.from_pretrained('openai/clip-vit-large-patch14'); vit_p_336=CLIPImageProcessor.from_pretrained('openai/clip-vit-large-patch14-336');"
11/08/2024 1:48 AM UTC
sha256:e84999575cfde1d5aef28e52a3f8a281ca2d6530404fc14d0f1835162e1ee979RUN
NVIDIA_BIGNLP_VERSION= TRT_VER=10.3.0.26 CUDA_VER=12.5 CUDNN_VER=9.3.0.75-1 NCCL_VER= CUBLAS_VER=12.5.3.2-1 NVRTC_VER=12.5.82-1 APEX_COMMIT=b7a4acc1c8599f9306b519c9a88c044f1b280a07 TE_COMMIT=2215fa5c7557b66034068816020f9f611019e457 MCORE_COMMIT=core_r0.9.0 SRC_DIR=/src/tensorrt_llm CPP_BUILD_DIR=/src/tensorrt_llm/cpp/build ALIGNER_COMMIT=r0.5.0 LAUNCHER_COMMIT=35e439393e2ec8cfb874aa5aec3eac6e73219b37 DATA_CURATOR_COMMIT=r0.5.0 NEMO_COMMIT=r2.0.0 NEMO_RUN_COMMIT=r0.1.0 python -c "from transformers import AutoTokenizer; vit_l_tokenizer=AutoTokenizer.from_pretrained('openai/clip-vit-large-patch14');"
11/08/2024 1:48 AM UTC
sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1RUN
NVIDIA_BIGNLP_VERSION= TRT_VER=10.3.0.26 CUDA_VER=12.5 CUDNN_VER=9.3.0.75-1 NCCL_VER= CUBLAS_VER=12.5.3.2-1 NVRTC_VER=12.5.82-1 APEX_COMMIT=b7a4acc1c8599f9306b519c9a88c044f1b280a07 TE_COMMIT=2215fa5c7557b66034068816020f9f611019e457 MCORE_COMMIT=core_r0.9.0 SRC_DIR=/src/tensorrt_llm CPP_BUILD_DIR=/src/tensorrt_llm/cpp/build ALIGNER_COMMIT=r0.5.0 LAUNCHER_COMMIT=35e439393e2ec8cfb874aa5aec3eac6e73219b37 DATA_CURATOR_COMMIT=r0.5.0 NEMO_COMMIT=r2.0.0 NEMO_RUN_COMMIT=r0.1.0 python -c "from transformers import AutoTokenizer; tok_llama3_8b=AutoTokenizer.from_pretrained('meta-llama/Meta-Llama-3-8B');  tok_llama3_70b=AutoTokenizer.from_pretrained('meta-llama/Meta-Llama-3-70B');  tok_llama3_8b_inst=AutoTokenizer.from_pretrained('meta-llama/Meta-Llama-3-8B-instruct');  tok_llama3_70b_inst=AutoTokenizer.from_pretrained('meta-llama/Meta-Llama-3-70B-instruct');"
11/08/2024 1:48 AM UTC
...

NVIDIA uses cookies to improve your experience on our web site. We and our third-party partners also use cookies and other tools to collect and record information you provide as well as information about your interactions with our websites for performance improvement, analytics, and to assist in marketing efforts. By clicking "Accept All", you consent to our use of cookies and other tools as described in our Cookie Policy. You can manage your cookie settings by clicking on "Manage Settings." By continuing to use this site or by clicking one of the buttons below, you agree to our Terms of Service (which contains important waivers). Please see our Privacy Policy for more information on our privacy practices.