NVIDIA
NVIDIA
NeMo Framework Megatron Backend
Container
NVIDIA
NVIDIA
NeMo Framework Megatron Backend

NVIDIA NeMo™ framework Megatron backend supports pre-training, post-training, and reinforcement learning of LLMs and multi-modal generative AI models with state-of-the-art data processing, model training techniques, and flexible deployment options.

LayerLabelCreated
629454936d32238316442aa0a64c4af517f4792abad80df01464bfedba7f8270CONFIG
Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /opt; ExposedPorts 6006/tcp, 8888/tcp
02/28/2024 3:38 PM UTC
5dc813c54e5deaa42ec50131545eb84966a4858ca2cce27bf158b313154aea5aCOPY
./scripts/nlp_language_modeling/convert_nemo_starcoder2_to_hf.py /opt/NeMo/scripts/nlp_language_modeling/convert_nemo_starcoder2_to_hf.py
02/28/2024 3:38 PM UTC
2d139962d849c5edb53eee296716a40ebae56e3a0d8210683fe1cc0a59a71bf5COPY
./scripts/nlp_language_modeling/convert_hf_starcoder2_to_nemo.py /opt/NeMo/scripts/nlp_language_modeling/convert_hf_starcoder2_to_nemo.py
02/28/2024 3:38 PM UTC
aa67f4fb5d2b893e5f78b518a775eb44ffda9cd493ee0acf87966689b26314dbCOPY
./examples/nlp/language_modeling/conf/megatron_starcoder2_config.yaml /opt/NeMo/examples/nlp/language_modeling/conf/megatron_starcoder2_config.yaml
02/28/2024 3:38 PM UTC
218a252818c57a0b3c3bd18af10593a90eaac16ef0afc19f51fb78e88b5803d9COPY
llm_inference/nemo-fw/scripts/deploy /opt/NeMo/scripts/deploy
02/27/2024 4:08 AM UTC
1ef35e3621ff28c2309484402ff2986b1d9f35fabaca58642895ad53d4650da3COPY
llm_inference/nemo-fw/scripts/export /opt/NeMo/scripts/export
02/27/2024 4:08 AM UTC
d46f4fb98d9f5ca3f085f361e85884d0c0479164a74586853232051a763fb3c3COPY
llm_inference/nemo-fw/nemo/deploy /opt/NeMo/nemo/deploy
02/27/2024 4:08 AM UTC
50f15a88f25d9f47afd17b33582a1316470747f4d797670f226ca3e15880b1b1COPY
llm_inference/nemo-fw/nemo/export /opt/NeMo/nemo/export
02/27/2024 4:08 AM UTC
8d19cf2c3e22e3fcabe8300ad83afb3625559fddcdd7c08f6bbb3e6fb524fa01WORKDIR
/opt
02/27/2024 12:38 AM UTC
774419fb3b607b6b5c6dd66a331e042ed0646c828672f73f87fad909e47cee58RUN
rm -r /tmp/tensorrt_llm
02/27/2024 12:38 AM UTC
...

NVIDIA uses cookies to improve your experience on our web site. We and our third-party partners also use cookies and other tools to collect and record information you provide as well as information about your interactions with our websites for performance improvement, analytics, and to assist in marketing efforts. By clicking "Accept All", you consent to our use of cookies and other tools as described in our Cookie Policy. You can manage your cookie settings by clicking on "Manage Settings." By continuing to use this site or by clicking one of the buttons below, you agree to our Terms of Service (which contains important waivers). Please see our Privacy Policy for more information on our privacy practices.