NVIDIA
NVIDIA
Merlin Inference
Container
NVIDIA
NVIDIA
Merlin Inference

This container allows users to deploy NVTabular workflows and HugeCTR or TensorFlow models to Triton Inference server for production.

LayerLabelCreated
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4CONFIG
b920824368e96cc3a342f2de38010b694cd15f8b1be2925aab5750975c5c2c4cRUN
/bin/bash -c #(nop) ENTRYPOINT []
05/27/2021 1:27 PM UTC
16d5d01beb6f61c0af41fc4bbd0321aab401e4decfe51f2627705d917f63a6deRUN
/bin/bash -c #(nop) HEALTHCHECK &{["NONE"] "0s" "0s" "0s" '\x00'}
05/27/2021 1:27 PM UTC
544016a17a1f86a77eb25e989f701e5713140efdcd5a23c72203e9ce8cb5d749RUN
CUDF_VER=v0.19.2 HUGECTR_VER=v3.0.1 HUGEINF_VER=0 NVTAB_VER=v0.5.3 RELEASE=true RMM_VER=v0.19.0 SM=60;61;70;75;80 TRITON_VERSION=21.03 /bin/bash -c echo $(du -h --max-depth=1 /)
05/27/2021 1:27 PM UTC
3eb483311dea5544b3a945e22368af6430141212b7241e69a5fc8593cfd2ebb7RUN
CUDF_VER=v0.19.2 HUGECTR_VER=v3.0.1 HUGEINF_VER=0 NVTAB_VER=v0.5.3 RELEASE=true RMM_VER=v0.19.0 SM=60;61;70;75;80 TRITON_VERSION=21.03 /bin/bash -c pip install tqdm
05/27/2021 1:27 PM UTC
6398ac703b62c97796256d5524b98503396d94eb6e2815203f83c99eed78c5b9RUN
CUDF_VER=v0.19.2 HUGECTR_VER=v3.0.1 HUGEINF_VER=0 NVTAB_VER=v0.5.3 RELEASE=true RMM_VER=v0.19.0 SM=60;61;70;75;80 TRITON_VERSION=21.03 /bin/bash -c rm -rf /repos
05/27/2021 1:27 PM UTC
0c7e2d7508a2913a3b7d7248a10ec793c749ec6973bd80a1d4047c980452275bRUN
CUDF_VER=v0.19.2 HUGECTR_VER=v3.0.1 HUGEINF_VER=0 NVTAB_VER=v0.5.3 RELEASE=true RMM_VER=v0.19.0 SM=60;61;70;75;80 TRITON_VERSION=21.03 /bin/bash -c echo $(du -h --max-depth=1 /)
05/27/2021 1:27 PM UTC
dfee81818d1cdeb4c7eb24b03dfeff82b3b20ffc6cad33b311189c2aa9601152RUN
CUDF_VER=v0.19.2 HUGECTR_VER=v3.0.1 HUGEINF_VER=0 NVTAB_VER=v0.5.3 RELEASE=true RMM_VER=v0.19.0 SM=60;61;70;75;80 TRITON_VERSION=21.03 /bin/bash -c ln -s /usr/local/hugectr/backends/hugectr /opt/tritonserver/backends/
05/27/2021 1:27 PM UTC
d61b6485dc3309da332f408a826f634602d318c8bcccbaa34847196d34d84851RUN
/bin/bash -c #(nop) ENV LD_LIBRARY_PATH=/usr/local/hugectr/lib:/usr/local/cuda/compat/lib:/usr/local/nvidia/lib:/usr/local/nvidia/lib64:/usr/local/cuda/lib64:/usr/local/cuda/extras/CUPTI/lib64:/usr/local/lib:/repos/dist/lib LIBRARY_PATH=/usr/local/hugectr/lib:/usr/local/cuda/lib64/stubs: PYTHONPATH=/usr/local/hugectr/lib:
05/27/2021 1:27 PM UTC
853ae2f9149df414564e8ec43cdb15b6d5695f7c522ee5d8980013183f41c073RUN
CUDF_VER=v0.19.2 HUGECTR_VER=v3.0.1 HUGEINF_VER=0 NVTAB_VER=v0.5.3 RELEASE=true RMM_VER=v0.19.0 SM=60;61;70;75;80 TRITON_VERSION=21.03 /bin/bash -c git clone https://github.com/NVIDIA/HugeCTR.git /repos/HugeCTR &&
  cd /repos/HugeCTR &&
  if [ "$RELEASE" == "true" ] &&
  [ ${HUGECTR_VER} != 0 ]; then git fetch --all --tags &&
  git checkout tags/${HUGECTR_VER}; else git checkout master; fi &&
  git submodule update --init --recursive &&
  mkdir -p build &&
  cd build &&
  cmake -DCMAKE_BUILD_TYPE=Release -DSM=$SM -DENABLE_INFERENCE=ON .. &&
  make -j$(nproc) &&
  make install &&
  export CPATH=/usr/local/hugectr/include:$CPATH &&
  export LIBRARY_PATH=/usr/local/hugectr/lib:$LIBRARY_PATH &&
  git clone https://github.com/triton-inference-server/hugectr_backend /repos/hugectr_inference_backend &&
  cd /repos/hugectr_inference_backend &&
  if [ "$RELEASE" == "true" ] &&
  [ ${HUGEINF_VER} != 0 ] ; then git fetch --all --tags &&
  git checkout tags/${HUGEINF_VER}; else git checkout main; fi &&
  mkdir -p build &&
  cd build &&
  cmake -DCMAKE_INSTALL_PREFIX:PATH=/usr/local/hugectr .. -D TRITON_COMMON_REPO_TAG="r$TRITON_VERSION" -D TRITON_CORE_REPO_TAG="r$TRITON_VERSION" -D TRITON_BACKEND_REPO_TAG="r$TRITON_VERSION" &&
  make -j$(nproc) &&
  make install
05/27/2021 1:27 PM UTC
...

NVIDIA uses cookies to improve your experience on our web site. We and our third-party partners also use cookies and other tools to collect and record information you provide as well as information about your interactions with our websites for performance improvement, analytics, and to assist in marketing efforts. By clicking "Accept All", you consent to our use of cookies and other tools as described in our Cookie Policy. You can manage your cookie settings by clicking on "Manage Settings." By continuing to use this site or by clicking one of the buttons below, you agree to our Terms of Service (which contains important waivers). Please see our Privacy Policy for more information on our privacy practices.