NVIDIA
NVIDIA
Merlin Training
Container
NVIDIA
NVIDIA
Merlin Training

This container allows users to do preprocessing and feature engineering with NVTabular, and then train a deep-learning based recommender system model with HugeCTR.

LayerLabelCreated
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4RUN
/bin/bash -c #(nop) CMD ["/bin/bash"]
09/26/2021 1:14 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4RUN
/bin/bash -c #(nop) ENTRYPOINT []
09/26/2021 1:14 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4RUN
/bin/bash -c #(nop) HEALTHCHECK &{["NONE"] "0s" "0s" "0s" '\x00'}
09/26/2021 1:14 AM UTC
sha256:a95b0563518850aa759973ca4c3307327cb997c802b740234b8df5930d0df934RUN
HUGECTR_VER=v3.2 RELEASE=true /bin/bash -c echo $(du -h --max-depth=1 /)
09/26/2021 1:14 AM UTC
sha256:5c1f2912e521b287d45cd35bf0797daef6fe2757611cd27e210d74a215986118RUN
HUGECTR_VER=v3.2 RELEASE=true /bin/bash -c pip install numba numpy --upgrade
09/26/2021 1:14 AM UTC
sha256:6eb8fa92f8f8793f31356b26ad077f44a4c3c593b73d56367aa5ca69f5f1aa38RUN
HUGECTR_VER=v3.2 RELEASE=true /bin/bash -c rm -rf /repos
09/26/2021 1:14 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4RUN
/bin/bash -c #(nop) ENV PYTHONPATH=:/usr/local/hugectr/lib
09/26/2021 1:14 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4RUN
/bin/bash -c #(nop) ENV LD_LIBRARY_PATH=/usr/local/cuda/extras/CUPTI/lib64:/usr/local/cuda/compat/lib:/usr/local/nvidia/lib:/usr/local/nvidia/lib64:/usr/local/cuda/lib64:/usr/local/cuda/extras/CUPTI/lib64:/usr/local/lib:/repos/dist/lib:/usr/local/hugectr/lib PATH=/usr/local/cuda/lib64/:/usr/local/mpi/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/local/ucx/bin:/opt/tensorrt/bin:/usr/local/cuda/bin:/usr/lib/x86_64-linux-gnu/:/usr/local/hugectr/bin
09/26/2021 1:14 AM UTC
sha256:d40ececc983467756f44881d19fb9b7dfa18d1536036e617face92529ef5741aRUN
HUGECTR_VER=v3.2 RELEASE=true /bin/bash -c rm /usr/local/cuda/lib64/stubs/libcuda.so.1
09/26/2021 1:14 AM UTC
sha256:71ac747e37db12acc374f904ed0e2fe1f58eee2115c1a6cf87c130021753a887RUN
HUGECTR_VER=v3.2 RELEASE=true /bin/bash -c cd /var/tmp/HugeCTR &&
  mkdir build &&
  cd build &&
  LD_LIBRARY_PATH=/usr/local/cuda/lib64/stubs/:$LD_LIBRARY_PATH &&
  export PATH=$PATH:/usr/local/cuda-${CUDA_SHORT_VERSION}/compat/ &&
  cmake -DCMAKE_CXX_COMPILER=/usr/bin/g++ -DCMAKE_C_COMPILER=/usr/bin/gcc -DCMAKE_BUILD_TYPE=Release -DSM="60;61;70;75;80" -DVAL_MODE=OFF -DENABLE_MULTINODES=ON -DNCCL_A2A=ON .. &&
  make VERBOSE=1 -j$(nproc) &&
  make install &&
  chmod +x /usr/local/hugectr/bin/* &&
  chmod +x /usr/local/hugectr/lib/* &&
  cd /var/tmp/HugeCTR/onnx_converter &&
  python3 setup.py install &&
  rm -rf /var/tmp/HugeCTR
09/26/2021 1:14 AM UTC
...

NVIDIA uses cookies to improve your experience on our web site. We and our third-party partners also use cookies and other tools to collect and record information you provide as well as information about your interactions with our websites for performance improvement, analytics, and to assist in marketing efforts. By clicking "Accept All", you consent to our use of cookies and other tools as described in our Cookie Policy. You can manage your cookie settings by clicking on "Manage Settings." By continuing to use this site or by clicking one of the buttons below, you agree to our Terms of Service (which contains important waivers). Please see our Privacy Policy for more information on our privacy practices.