Skip to main content
NVIDIA
HugeCTR Release Container
Container
NVIDIA
HugeCTR Release Container

HugeCTR is a high-efficiency GPU framework designed for Click-Through-Rate (CTR) estimating training. HugeCTR is a component of the NVIDIA Merlin, a recommender system framework in open beta. https://github.com/NVIDIA/HugeCTR

LayerLabelCreated
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
PATH=/usr/local/hugectr/bin:/usr/local/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
09/06/2020 2:48 AM UTC
sha256:0eb1f8f9c354ed430614d434487b139b9143b0e8267cb3607d781a9497d08237RUN
CMAKE_BUILD_TYPE=Release ENABLE_MULTINODES=OFF NCCL_A2A=ON SM=60;61;70;75;80 VAL_MODE=OFF git clone https://github.com/NVIDIA/HugeCTR.git HugeCTR &&
  cd HugeCTR &&
  git submodule update --init --recursive &&
  mkdir build &&
  cd build &&
  cmake -DCMAKE_BUILD_TYPE=$CMAKE_BUILD_TYPE -DSM=$SM -DVAL_MODE=$VAL_MODE -DENABLE_MULTINODES=$ENABLE_MULTINODES -DNCCL_A2A=$NCCL_A2A .. &&
  make -j$(nproc) &&
  mkdir /usr/local/hugectr &&
  make install &&
  chmod +x /usr/local/hugectr/bin/* &&
  rm -rf HugeCTR
09/06/2020 2:48 AM UTC
sha256:af9cc194b56647f693451993588fc89ca891200020f61a0478ec77ef9dcdd2d8RUN
CMAKE_BUILD_TYPE=Release ENABLE_MULTINODES=OFF NCCL_A2A=ON SM=60;61;70;75;80 VAL_MODE=OFF mkdir -p /var/tmp &&
  cd /var/tmp &&
  git clone --depth=1 --branch branch-0.15 https://github.com/rapidsai/cudf.git cudf &&
  cd - &&
  git clone --depth=1 --branch master https://github.com/dmlc/dlpack.git /var/tmp/dlpack &&
  cd /var/tmp/cudf/cpp &&
  mkdir -p build &&
  cd build &&
  cmake .. -DCMAKE_INSTALL_PREFIX=$CONDA_PREFIX -DGPU_ARCHS=$SM -DARROW_INCLUDE_DIR=/usr/include/arrow/ -DDLPACK_INCLUDE=/var/tmp/dlpack/include -DBUILD_TESTS=OFF -DBUILD_BENCHMARKS=OFF -DDISABLE_DEPRECATION_WARNING=ON &&
  make -j$(nproc) &&
  make -j$(nproc) install &&
  rm -rf /var/tmp/dlpack /var/tmp/cudf
09/06/2020 2:45 AM UTC
sha256:94e207bf63656417d49f0304ff1fcfdef4da2ab2d39f6589474907425a6f8433RUN
CMAKE_BUILD_TYPE=Release ENABLE_MULTINODES=OFF NCCL_A2A=ON SM=60;61;70;75;80 VAL_MODE=OFF mkdir -p /var/tmp &&
  cd /var/tmp &&
  git clone --depth=1 --branch branch-0.15 https://github.com/rapidsai/rmm.git rmm &&
  cd - &&
  cd /var/tmp/rmm &&
  mkdir -p build &&
  cd build &&
  cmake .. -DCMAKE_INSTALL_PREFIX=$CONDA_PREFIX &&
  make -j$(nproc) &&
  make -j$(nproc) install &&
  rm -rf /var/tmp/rmm
09/06/2020 2:14 AM UTC
sha256:3c32a42e29938b3eab043c233816082f59b269644b859eb6a34781a79c7887b7RUN
CMAKE_BUILD_TYPE=Release ENABLE_MULTINODES=OFF NCCL_A2A=ON SM=60;61;70;75;80 VAL_MODE=OFF if [ $(lsb_release --codename --short) = "stretch" ]; then echo "deb http://deb.debian.org/debian $(lsb_release --codename --short)-backports main" >> /etc/apt/sources.list.d/backports.list; fi &&
  wget https://apache.bintray.com/arrow/$(lsb_release --id --short | tr 'A-Z' 'a-z')/apache-arrow-archive-keyring-latest-$(lsb_release --codename --short).deb &&
  apt install -y -V ./apache-arrow-archive-keyring-latest-$(lsb_release --codename --short).deb &&
  apt update &&
  apt install -y libarrow-dev=0.17.1-1 libarrow-cuda-dev=0.17.1-1
09/06/2020 2:13 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
CONDA_PREFIX=/opt/conda
09/06/2020 2:13 AM UTC
sha256:6ab09fd2f539dfdcab53f546b4654afb236a4e2a76572826c184cca529ffa46eRUN
CMAKE_BUILD_TYPE=Release ENABLE_MULTINODES=OFF NCCL_A2A=ON SM=60;61;70;75;80 VAL_MODE=OFF mkdir -p /opt/conda
09/06/2020 2:13 AM UTC
sha256:ca4b7486b39b8a194e61a67ecff3fe8ace5e831c4c95369d9a6c380af9de9828RUN
CMAKE_BUILD_TYPE=Release ENABLE_MULTINODES=OFF NCCL_A2A=ON SM=60;61;70;75;80 VAL_MODE=OFF pip3 install --upgrade pip &&
  pip3 install numpy pandas sklearn ortools tensorflow
09/06/2020 2:13 AM UTC
sha256:101fbc22b245059ba1b909f2da2ed0a48901f6a0234ef4eb93d3a71066a88bf7RUN
CMAKE_BUILD_TYPE=Release ENABLE_MULTINODES=OFF NCCL_A2A=ON SM=60;61;70;75;80 VAL_MODE=OFF apt-get update -y &&
  DEBIAN_FRONTEND=noninteractive apt-get install -y --no-install-recommends python3-pip python3-setuptools python3-wheel &&
  rm -rf /var/lib/apt/lists/*
09/06/2020 2:12 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
PATH=/usr/local/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
09/06/2020 2:12 AM UTC
1-10 of 43 items

Modal Content

NVIDIA uses cookies to improve your experience on our web site. We and our third-party partners also use cookies and other tools to collect and record information you provide as well as information about your interactions with our websites for performance improvement, analytics, and to assist in marketing efforts. By clicking "Accept All", you consent to our use of cookies and other tools as described in our Cookie Policy. You can manage your cookie settings by clicking on "Manage Settings." By continuing to use this site or by clicking one of the buttons below, you agree to our Terms of Service (which contains important waivers). Please see our Privacy Policy for more information on our privacy practices.