NVIDIA
Merlin TensorFlow
Container
NVIDIA
Merlin TensorFlow

The Merlin TensorFlow container allows users to do preprocessing and feature engineering with NVTabular, and then train a deep-learning based recommender system model with TensorFlow, and serve the trained model on Triton Inference Server.

  • LayerLabelCreated
    sha256:8f15a7d7af7349d09bbb5a11ef87955c5cdf87fd36e012e92c836e1f5d244973RUN
    HUGECTR_DEV_MODE=false INSTALL_DISTRIBUTED_EMBEDDINGS=true _CI_JOB_TOKEN= _HUGECTR_REPO=github.com/NVIDIA-Merlin/HugeCTR.git if [ "$INSTALL_DISTRIBUTED_EMBEDDINGS" == "true" ]; then git clone https://github.com/NVIDIA-Merlin/distributed-embeddings.git /distributed_embeddings/ &&
      cd /distributed_embeddings &&
      git checkout ${TFDE_VER} &&
      make pip_pkg &&
      pip install artifacts/*.whl &&
      make clean; fi
    08/01/2022 1:09 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
    INSTALL_DISTRIBUTED_EMBEDDINGS=true
    08/01/2022 1:08 PM UTC
    sha256:94e298e39429be34335937a542be54480d455811c1013c8b513581add93370caRUN
    HUGECTR_DEV_MODE=false _CI_JOB_TOKEN= _HUGECTR_REPO=github.com/NVIDIA-Merlin/HugeCTR.git if [ "$HUGECTR_DEV_MODE" == "false" ]; then git clone https://${_CI_JOB_TOKEN}${_HUGECTR_REPO} /hugectr &&
      pushd /hugectr &&
      git checkout ${HUGECTR_VER} &&
      cd sparse_operation_kit &&
      python setup.py install &&
      popd; fi
    08/01/2022 1:08 PM UTC
    sha256:99c11153494b38a78e45832c5820ece5d9ca53ce4c509d6727ea438619b5c36bRUN
    HUGECTR_DEV_MODE=false _CI_JOB_TOKEN= _HUGECTR_REPO=github.com/NVIDIA-Merlin/HugeCTR.git ln -s /usr/lib/x86_64-linux-gnu/libibverbs.so.1 /usr/lib/x86_64-linux-gnu/libibverbs.so
    08/01/2022 12:58 PM UTC
    sha256:154512fcf9b936ab54ddb291505d843578b42202399c69b92f19600e28e7ab13RUN
    HUGECTR_DEV_MODE=false _CI_JOB_TOKEN= _HUGECTR_REPO=github.com/NVIDIA-Merlin/HugeCTR.git mkdir -p /usr/local/nvidia/lib64 &&
      ln -s /usr/local/cuda/lib64/libcusolver.so /usr/local/nvidia/lib64/libcusolver.so.10
    08/01/2022 12:58 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
    _CI_JOB_TOKEN=
    08/01/2022 12:58 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
    _HUGECTR_REPO=github.com/NVIDIA-Merlin/HugeCTR.git
    08/01/2022 12:58 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
    HUGECTR_DEV_MODE=false
    08/01/2022 12:58 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    LD_LIBRARY_PATH=/usr/local/hugectr/lib:/usr/local/cuda/compat/lib:/usr/local/nvidia/lib:/usr/local/nvidia/lib64:/usr/local/cuda/lib64:/usr/local/cuda/extras/CUPTI/lib64:/usr/local/lib:/repos/dist/lib:/opt/tritonserver/lib LIBRARY_PATH=/usr/local/hugectr/lib:/usr/local/cuda/lib64/stubs: SOK_COMPILE_UNIT_TEST=ON
    08/01/2022 12:58 PM UTC
    sha256:5526ea20cb3c6f304ff121031d85e90c652c4546da54a7f6fdc690afd511fbdcRUN
    wget http://www.cmake.org/files/v3.21/cmake-3.21.1.tar.gz &&
      tar xf cmake-3.21.1.tar.gz &&
      cd cmake-3.21.1 &&
      ./configure &&
      make &&
      make install
    08/01/2022 12:58 PM UTC
    ...

    NVIDIA uses cookies to improve your experience on our web site. We and our third-party partners also use cookies and other tools to collect and record information you provide as well as information about your interactions with our websites for performance improvement, analytics, and to assist in marketing efforts. By clicking "Accept All", you consent to our use of cookies and other tools as described in our Cookie Policy. You can manage your cookie settings by clicking on "Manage Settings." By continuing to use this site or by clicking one of the buttons below, you agree to our Terms of Service (which contains important waivers). Please see our Privacy Policy for more information on our privacy practices.