NVIDIA
NVIDIA
Merlin Inference
Container
NVIDIA
NVIDIA
Merlin Inference

This container allows users to deploy NVTabular workflows and HugeCTR or TensorFlow models to Triton Inference server for production.

LayerLabelCreated
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4CONFIG
391a673cb9b3756f4ae109c3546f6e4426988b645e15e6c90caa8c581ebb2993RUN
/bin/bash -c #(nop) ENTRYPOINT []
09/26/2021 12:44 AM UTC
bcbcb666252ccc4d1c637fa22f8f8d245656e16dc27e86bcbb83fbe7be2dd794RUN
/bin/bash -c #(nop) HEALTHCHECK &{["NONE"] "0s" "0s" "0s" '\x00'}
09/26/2021 12:44 AM UTC
c26cd4d306a77318dbd581643a01fea1f0353ce4ddfd958bf3a9c09113e398ebRUN
CUDF_VER=v21.08.02 HUGECTR_VER=v3.2 NVTAB_VER=v0.7.0 RELEASE=true RMM_VER=v21.08.02 SM=60;61;70;75;80 TRITON_VERSION=21.07 /bin/bash -c echo $(du -h --max-depth=1 /)
09/26/2021 12:44 AM UTC
ba3bcd4c1114562f6af5afe63aa390006a35807999c627d6e617693f56473864RUN
CUDF_VER=v21.08.02 HUGECTR_VER=v3.2 NVTAB_VER=v0.7.0 RELEASE=true RMM_VER=v21.08.02 SM=60;61;70;75;80 TRITON_VERSION=21.07 /bin/bash -c pip install numba numpy --upgrade
09/26/2021 12:44 AM UTC
bc42185899386a2b6ce2443635d1ff5e4f6641921ed90573602ef1684ebd9a60RUN
CUDF_VER=v21.08.02 HUGECTR_VER=v3.2 NVTAB_VER=v0.7.0 RELEASE=true RMM_VER=v21.08.02 SM=60;61;70;75;80 TRITON_VERSION=21.07 /bin/bash -c pip install tqdm
09/26/2021 12:44 AM UTC
faea7c58a8fdec6fa7c1ed3dfa3a0e1d39208146fdf458819f71dbd55b11d947RUN
CUDF_VER=v21.08.02 HUGECTR_VER=v3.2 NVTAB_VER=v0.7.0 RELEASE=true RMM_VER=v21.08.02 SM=60;61;70;75;80 TRITON_VERSION=21.07 /bin/bash -c rm -rf /repos
09/26/2021 12:44 AM UTC
dc4b4b0be2909bba5fe6a2b8cd6f096e7441e43e74504c4d7a14782562df0ea5RUN
CUDF_VER=v21.08.02 HUGECTR_VER=v3.2 NVTAB_VER=v0.7.0 RELEASE=true RMM_VER=v21.08.02 SM=60;61;70;75;80 TRITON_VERSION=21.07 /bin/bash -c ln -s /usr/local/hugectr/backends/hugectr /opt/tritonserver/backends/
09/26/2021 12:44 AM UTC
ab47ed50da993e068d2b81d98103d73e2781e46e7ba1d395be69d407a3af61b0RUN
/bin/bash -c #(nop) ENV LD_LIBRARY_PATH=/usr/local/hugectr/lib:/usr/local/cuda/compat/lib:/usr/local/nvidia/lib:/usr/local/nvidia/lib64:/usr/local/cuda/lib64:/usr/local/cuda/extras/CUPTI/lib64:/usr/local/lib:/repos/dist/lib LIBRARY_PATH=/usr/local/hugectr/lib:/usr/local/cuda/lib64/stubs: PYTHONPATH=/usr/local/hugectr/lib:
09/26/2021 12:44 AM UTC
1da8cff4262b0aec0581abeb80dd2ed8690f5d5ec257436e2b78639584154da7RUN
CUDF_VER=v21.08.02 HUGECTR_VER=v3.2 NVTAB_VER=v0.7.0 RELEASE=true RMM_VER=v21.08.02 SM=60;61;70;75;80 TRITON_VERSION=21.07 /bin/bash -c git clone https://github.com/NVIDIA/HugeCTR.git /repos/HugeCTR &&
  cd /repos/HugeCTR &&
  if [ "$RELEASE" == "true" ] &&
  [ ${HUGECTR_VER} != "vnightly" ]; then git fetch --all --tags &&
  git checkout tags/${HUGECTR_VER}; else git checkout ${HUGECTR_VER}-integration; fi &&
  git submodule update --init --recursive &&
  mkdir -p build &&
  cd build &&
  cmake -DCMAKE_BUILD_TYPE=Release -DSM=$SM -DENABLE_INFERENCE=ON .. &&
  make -j$(nproc) &&
  make install &&
  export CPATH=/usr/local/hugectr/include:$CPATH &&
  export LIBRARY_PATH=/usr/local/hugectr/lib:$LIBRARY_PATH &&
  git clone https://github.com/triton-inference-server/hugectr_backend /repos/hugectr_inference_backend &&
  cd /repos/hugectr_inference_backend &&
  if [ "$RELEASE" == "true" ] &&
  [ ${HUGECTR_VER} != "vnightly" ] ; then git fetch --all --tags &&
  git checkout tags/${HUGECTR_VER}; else git checkout main; fi &&
  mkdir -p build &&
  cd build &&
  cmake -DCMAKE_INSTALL_PREFIX:PATH=/usr/local/hugectr -DTRITON_COMMON_REPO_TAG="r$TRITON_VERSION" -DTRITON_CORE_REPO_TAG="r$TRITON_VERSION" -DTRITON_BACKEND_REPO_TAG="r$TRITON_VERSION" .. &&
  make -j$(nproc) &&
  make install
09/26/2021 12:44 AM UTC
...

NVIDIA uses cookies to improve your experience on our web site. We and our third-party partners also use cookies and other tools to collect and record information you provide as well as information about your interactions with our websites for performance improvement, analytics, and to assist in marketing efforts. By clicking "Accept All", you consent to our use of cookies and other tools as described in our Cookie Policy. You can manage your cookie settings by clicking on "Manage Settings." By continuing to use this site or by clicking one of the buttons below, you agree to our Terms of Service (which contains important waivers). Please see our Privacy Policy for more information on our privacy practices.