NVIDIA
NVIDIA
NeMo Framework Megatron Backend
Container
NVIDIA
NVIDIA
NeMo Framework Megatron Backend

NVIDIA NeMo™ framework Megatron backend supports pre-training, post-training, and reinforcement learning of LLMs and multi-modal generative AI models with state-of-the-art data processing, model training techniques, and flexible deployment options.

LayerLabelCreated
22454665f1364cbf913955f831bfa05a10df8b027e356d1f1952f9a1287512faCONFIG
Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /workspace; ExposedPorts 6006/tcp, 8888/tcp
11/08/2024 7:35 PM UTC
7f076788f824b8b1dacba1942a5321f5346ec7b02c40f6b0ccd4522a2707599cRUN
GITLAB_CLONE_ACCESS_TOKEN=oauth2:glpat-bKE_tFR6yxAxpZaDx14j pip install --no-cache-dir git+https://github.com/NVIDIA/NeMo-Run.git
11/08/2024 7:34 PM UTC
9a445df2d82bf6f5c8a4d4ad1c71b23434d9f8704db593745ee0144f1bab021bRUN
GITLAB_CLONE_ACCESS_TOKEN=oauth2:glpat-bKE_tFR6yxAxpZaDx14j git clone https://${GITLAB_CLONE_ACCESS_TOKEN}@gitlab-master.nvidia.com/dl/nemo/mcore-vfm &&
  cd mcore-vfm &&
  git checkout 2b7ce132fb3d7a0d4ae0fb6315eb87bab8aee191 &&
  pip install .
11/08/2024 7:34 PM UTC
bd70a22b781cd6ecb4d0124212af090820f7d2ca8f5aa83774eea3bb7e7e838cARG
GITLAB_CLONE_ACCESS_TOKEN
11/08/2024 7:34 PM UTC
23b03f0508ed9a4596dbe6d2d4bb56c7bbea191875d1c04fe6f06cdae3bdd026RUN
sed '/mamba-ssm/d' /app/requirements_nlp.txt > /app/temp_requirements_nlp.txt &&
  pip install --no-cache-dir -r /app/temp_requirements_nlp.txt &&
  rm /app/temp_requirements_nlp.txt
11/08/2024 8:55 AM UTC
6979e80b7ee65fdafe59f44a3d6c8cd3582c2b05cdd418dab677dd5efd2dfa42COPY
../../../requirements/requirements_nlp.txt /app/requirements_nlp.txt
11/08/2024 8:54 AM UTC
20d0784b5d8a55a741fd11d7077955adad87d3ca10875464bdffe2b4020c5933RUN
pip install --no-cache-dir -r /app/requirements_common.txt
11/08/2024 8:54 AM UTC
aef1d24472878190d1199fde388607acb05d15306c59acccc37f9ea7df31bf1fCOPY
../../../requirements/requirements_common.txt /app/requirements_common.txt
11/08/2024 8:54 AM UTC
c50e5106a233fc495bd7bd4ce1e9b8dc0ccd3a920186cee15ea09c85bd99bf6bRUN
pip install --no-cache-dir -r /app/requirements.txt
11/08/2024 8:54 AM UTC
eeee57ad7a7cd3dce2e02d0752c907587f7b4521b93680310ce7ac0a4c800d3bCOPY
../../../requirements/requirements.txt /app/requirements.txt
11/08/2024 8:54 AM UTC
...

NVIDIA uses cookies to improve your experience on our web site. We and our third-party partners also use cookies and other tools to collect and record information you provide as well as information about your interactions with our websites for performance improvement, analytics, and to assist in marketing efforts. By clicking "Accept All", you consent to our use of cookies and other tools as described in our Cookie Policy. You can manage your cookie settings by clicking on "Manage Settings." By continuing to use this site or by clicking one of the buttons below, you agree to our Terms of Service (which contains important waivers). Please see our Privacy Policy for more information on our privacy practices.