ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA
NVIDIA
NeMo Framework Megatron Backend
Container
NVIDIA
NVIDIA
NeMo Framework Megatron Backend

NVIDIA NeMo™ framework Megatron backend supports pre-training, post-training, and reinforcement learning of LLMs and multi-modal generative AI models with state-of-the-art data processing, model training techniques, and flexible deployment options.

NVIDIA AI Enterprise Supported
LayerLabelCreated
19f57c4be414d09687a641107fb814c591ccb292672d773b6db6b9fa109e43c0CONFIG
Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /workspace; ExposedPorts 6006/tcp, 8888/tcp
11/08/2024 1:48 AM UTC
9e75caf23d5db66748a49262d6584217f64b25c896224e9f6f52283b7d33f135ARG
NVIDIA_BUILD_REF
11/08/2024 1:48 AM UTC
0b095f69025a39ba5a34a993778908154beba94b946e24d8438905dab4b0d1fbLABEL
com.nvidia.build.id=100464919
11/08/2024 1:48 AM UTC
9020c4bce6392fff3b134626127a8d2fb6e5dca408e03319764286f7b3529d9dENV
NVIDIA_BUILD_ID=100464919
11/08/2024 1:48 AM UTC
bb8aa09aad1d54ff3d34ce02315b040d1c8f20174efcc671024347dc8cc453ddARG
NVIDIA_BUILD_ID
11/08/2024 1:48 AM UTC
caff7d6ce95dd433cbf080af7133dd0f979934b2f2992f54c3a0a32b3ce5527eRUN
NVIDIA_BIGNLP_VERSION= TRT_VER=10.3.0.26 CUDA_VER=12.5 CUDNN_VER=9.3.0.75-1 NCCL_VER= CUBLAS_VER=12.5.3.2-1 NVRTC_VER=12.5.82-1 APEX_COMMIT=b7a4acc1c8599f9306b519c9a88c044f1b280a07 TE_COMMIT=2215fa5c7557b66034068816020f9f611019e457 MCORE_COMMIT=core_r0.9.0 SRC_DIR=/src/tensorrt_llm CPP_BUILD_DIR=/src/tensorrt_llm/cpp/build ALIGNER_COMMIT=r0.5.0 LAUNCHER_COMMIT=35e439393e2ec8cfb874aa5aec3eac6e73219b37 DATA_CURATOR_COMMIT=r0.5.0 NEMO_COMMIT=r2.0.0 NEMO_RUN_COMMIT=r0.1.0 chmod -R a+w /workspace
11/08/2024 1:48 AM UTC
6f63c875710bf93cf26e293b1d7c63e9479ce94ce4234f942ea84f7ab962fdd6WORKDIR
/workspace
11/08/2024 1:48 AM UTC
1c0af84e24b43a2d1271ae72a13ae78fa8359e3c60694be221347b1c66bfb314RUN
NVIDIA_BIGNLP_VERSION= TRT_VER=10.3.0.26 CUDA_VER=12.5 CUDNN_VER=9.3.0.75-1 NCCL_VER= CUBLAS_VER=12.5.3.2-1 NVRTC_VER=12.5.82-1 APEX_COMMIT=b7a4acc1c8599f9306b519c9a88c044f1b280a07 TE_COMMIT=2215fa5c7557b66034068816020f9f611019e457 MCORE_COMMIT=core_r0.9.0 SRC_DIR=/src/tensorrt_llm CPP_BUILD_DIR=/src/tensorrt_llm/cpp/build ALIGNER_COMMIT=r0.5.0 LAUNCHER_COMMIT=35e439393e2ec8cfb874aa5aec3eac6e73219b37 DATA_CURATOR_COMMIT=r0.5.0 NEMO_COMMIT=r2.0.0 NEMO_RUN_COMMIT=r0.1.0 python -c "from transformers import CLIPImageProcessor; vit_p=CLIPImageProcessor.from_pretrained('openai/clip-vit-large-patch14'); vit_p_336=CLIPImageProcessor.from_pretrained('openai/clip-vit-large-patch14-336');"
11/08/2024 1:48 AM UTC
45bdc2dee3df021041d71657b56ebdcffe15d74a15b8cb3b355506fa8b4faacbRUN
NVIDIA_BIGNLP_VERSION= TRT_VER=10.3.0.26 CUDA_VER=12.5 CUDNN_VER=9.3.0.75-1 NCCL_VER= CUBLAS_VER=12.5.3.2-1 NVRTC_VER=12.5.82-1 APEX_COMMIT=b7a4acc1c8599f9306b519c9a88c044f1b280a07 TE_COMMIT=2215fa5c7557b66034068816020f9f611019e457 MCORE_COMMIT=core_r0.9.0 SRC_DIR=/src/tensorrt_llm CPP_BUILD_DIR=/src/tensorrt_llm/cpp/build ALIGNER_COMMIT=r0.5.0 LAUNCHER_COMMIT=35e439393e2ec8cfb874aa5aec3eac6e73219b37 DATA_CURATOR_COMMIT=r0.5.0 NEMO_COMMIT=r2.0.0 NEMO_RUN_COMMIT=r0.1.0 python -c "from transformers import AutoTokenizer; vit_l_tokenizer=AutoTokenizer.from_pretrained('openai/clip-vit-large-patch14');"
11/08/2024 1:48 AM UTC
6522de91e7ccc8be7a0b7a4531fa1b10c9ec31f92aa01df6f61333f149864b53RUN
NVIDIA_BIGNLP_VERSION= TRT_VER=10.3.0.26 CUDA_VER=12.5 CUDNN_VER=9.3.0.75-1 NCCL_VER= CUBLAS_VER=12.5.3.2-1 NVRTC_VER=12.5.82-1 APEX_COMMIT=b7a4acc1c8599f9306b519c9a88c044f1b280a07 TE_COMMIT=2215fa5c7557b66034068816020f9f611019e457 MCORE_COMMIT=core_r0.9.0 SRC_DIR=/src/tensorrt_llm CPP_BUILD_DIR=/src/tensorrt_llm/cpp/build ALIGNER_COMMIT=r0.5.0 LAUNCHER_COMMIT=35e439393e2ec8cfb874aa5aec3eac6e73219b37 DATA_CURATOR_COMMIT=r0.5.0 NEMO_COMMIT=r2.0.0 NEMO_RUN_COMMIT=r0.1.0 python -c "from transformers import AutoTokenizer; tok_llama3_8b=AutoTokenizer.from_pretrained('meta-llama/Meta-Llama-3-8B');  tok_llama3_70b=AutoTokenizer.from_pretrained('meta-llama/Meta-Llama-3-70B');  tok_llama3_8b_inst=AutoTokenizer.from_pretrained('meta-llama/Meta-Llama-3-8B-instruct');  tok_llama3_70b_inst=AutoTokenizer.from_pretrained('meta-llama/Meta-Llama-3-70B-instruct');"
11/08/2024 1:48 AM UTC
...

NVIDIA uses cookies to improve your experience on our web site. We and our third-party partners also use cookies and other tools to collect and record information you provide as well as information about your interactions with our websites for performance improvement, analytics, and to assist in marketing efforts. By clicking "Accept All", you consent to our use of cookies and other tools as described in our Cookie Policy. You can manage your cookie settings by clicking on "Manage Settings." By continuing to use this site or by clicking one of the buttons below, you agree to our Terms of Service (which contains important waivers). Please see our Privacy Policy for more information on our privacy practices.