NVIDIA
NVIDIA
Merlin Tensorflow Inference
Container
NVIDIA
NVIDIA
Merlin Tensorflow Inference

This container allows users to deploy NVTabular workflows and TensorFlow models to Triton Inference server for production.

LayerLabelCreated
b5c62bd857566f990cb775198daf17597994c5e45f4e3d769f3bb99cd2f21b0fRUN
/bin/sh
05/06/2022 10:56 AM UTC
13747685974f3457a1a89d033c3207091f01bd9b61f0779559e51697e7e3ff87CMD
/bin/bash
05/06/2022 10:56 AM UTC
7f3aa45b1187ea75c65e8715d4ab1da56fa920fb3daaa5f8282ac56ba636e602HEALTHCHECK
&{["NONE"] "0s" "0s" "0s" '\x00'}
05/06/2022 10:56 AM UTC
d79004a37d40d18f8edf87e2198017e969917b180d6ff0a9195fcc242c4f8126RUN
CORE_VER=main CUDF_VER=v22.02.00 HUGECTR_BACKEND_VER=main HUGECTR_VER=master MODELS_VER=main NVTAB_BACKEND_VER=main NVTAB_VER=main RMM_VER=v22.02.00 SYSTEMS_VER=main TF4REC_VER=main TRITON_VERSION=22.03 rm -rf /repos
05/06/2022 10:56 AM UTC
b563ef930139257b57b412dce18f82e8ced476691d9ea90fff1c5cf197275eaeRUN
CORE_VER=main CUDF_VER=v22.02.00 HUGECTR_BACKEND_VER=main HUGECTR_VER=master MODELS_VER=main NVTAB_BACKEND_VER=main NVTAB_VER=main RMM_VER=v22.02.00 SYSTEMS_VER=main TF4REC_VER=main TRITON_VERSION=22.03 git clone https://github.com/NVIDIA-Merlin/nvtabular_triton_backend.git build-env &&
  cd build-env &&
  git checkout ${NVTAB_BACKEND_VER} &&
  cd .. &&
  pushd build-env &&
  mkdir build &&
  cd build &&
  cmake -Dpybind11_DIR=/usr/local/lib/python3.8/dist-packages/pybind11/share/cmake/pybind11 -D TRITON_COMMON_REPO_TAG="r$TRITON_VERSION" -D TRITON_CORE_REPO_TAG="r$TRITON_VERSION" -D TRITON_BACKEND_REPO_TAG="r$TRITON_VERSION" .. &&
  make -j &&
  mkdir /opt/tritonserver/backends/nvtabular &&
  cp libtriton_nvtabular.so /opt/tritonserver/backends/nvtabular/ &&
  popd &&
  rm -rf build-env
05/06/2022 10:56 AM UTC
79a34fa0cb3c40cefbbb2ceea8438e55a9d2e0cc59ce6796cb6710d116282725ARG
TRITON_VERSION
05/06/2022 10:56 AM UTC
f42b6edacb403655153d0274034cc51a6e617954035fea6f09547c096343794dRUN
CORE_VER=main CUDF_VER=v22.02.00 HUGECTR_BACKEND_VER=main HUGECTR_VER=master MODELS_VER=main NVTAB_BACKEND_VER=main NVTAB_VER=main RMM_VER=v22.02.00 SYSTEMS_VER=main TF4REC_VER=main git clone https://github.com/NVIDIA-Merlin/Merlin/ /Merlin
05/06/2022 10:56 AM UTC
6537d282662c40ded6fef39fa156b4c1733fb17e0aeb587fd01473e08dda2b8eENV
PYTHONPATH=/usr/lib/python3.8/site-packages::/core:/systems:/nvtabular:/transformers4rec:/models
05/06/2022 10:56 AM UTC
821f07799af24de7c78f6ce44580535809a1b40d6a15619b95ba246de067a609RUN
CORE_VER=main CUDF_VER=v22.02.00 HUGECTR_BACKEND_VER=main HUGECTR_VER=master MODELS_VER=main NVTAB_BACKEND_VER=main NVTAB_VER=main RMM_VER=v22.02.00 SYSTEMS_VER=main TF4REC_VER=main git clone https://github.com/NVIDIA-Merlin/Models.git /models/ &&
  cd /models/ &&
  git checkout ${MODELS_VER} &&
  pip install . --no-deps;
05/06/2022 10:56 AM UTC
380a1b6741aa8d12f8033e592e5351d73ab01aed1746420d42ac230b329a7443ENV
PYTHONPATH=/usr/lib/python3.8/site-packages::/core:/systems:/nvtabular:/transformers4rec
05/06/2022 10:55 AM UTC
...

NVIDIA uses cookies to improve your experience on our web site. We and our third-party partners also use cookies and other tools to collect and record information you provide as well as information about your interactions with our websites for performance improvement, analytics, and to assist in marketing efforts. By clicking "Accept All", you consent to our use of cookies and other tools as described in our Cookie Policy. You can manage your cookie settings by clicking on "Manage Settings." By continuing to use this site or by clicking one of the buttons below, you agree to our Terms of Service (which contains important waivers). Please see our Privacy Policy for more information on our privacy practices.