ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA
NVIDIA
Merlin Inference
Container
NVIDIA
NVIDIA
Merlin Inference

This container allows users to deploy NVTabular workflows and HugeCTR or TensorFlow models to Triton Inference server for production.

LayerLabelCreated
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4CONFIG
—
—
ad0defa179afbe3304c99e6f281d5121a4324120de8171cbb92fb4609576d9c0RUN
/bin/bash -c #(nop) ENTRYPOINT []
01/14/2022 11:37 AM UTC
0aec3a2b67f1db66663dec5c8f3d1e5299a053eb63efee0c86c74fe4d090522fRUN
/bin/bash -c #(nop) HEALTHCHECK &{["NONE"] "0s" "0s" "0s" '\x00'}
01/14/2022 11:37 AM UTC
887504b6f408d0a488064e4b5677528f8bda4d17fa1c46f64ccaf8db02712a60RUN
CUDF_VER=vnightly HUGECTR_BACKEND_VER=vnightly HUGECTR_VER=vnightly NVTAB_VER=vnightly RELEASE=false RMM_VER=vnightly TF4REC_VER=vnightly TRITON_VERSION=21.12 /bin/bash -c echo $(du -h --max-depth=1 /)
01/14/2022 11:37 AM UTC
0b8152f3abbe464e39682783be0b7f87725bc09f83ec34566366897ed28508a4RUN
CUDF_VER=vnightly HUGECTR_BACKEND_VER=vnightly HUGECTR_VER=vnightly NVTAB_VER=vnightly RELEASE=false RMM_VER=vnightly TF4REC_VER=vnightly TRITON_VERSION=21.12 /bin/bash -c pip install numba numpy --upgrade
01/14/2022 11:37 AM UTC
58faeb1f20fe15c885595950d056dc0a6fcce02093908985effc0aef97870374RUN
CUDF_VER=vnightly HUGECTR_BACKEND_VER=vnightly HUGECTR_VER=vnightly NVTAB_VER=vnightly RELEASE=false RMM_VER=vnightly TF4REC_VER=vnightly TRITON_VERSION=21.12 /bin/bash -c pip install dask==2021.09.1 distributed==2021.09.1 dask[dataframe]==2021.09.1 dask-cuda
01/14/2022 11:37 AM UTC
a4765a3a2a99e3aa40283bdad7926235aad7fbb3588467e7f879d83045a85639RUN
CUDF_VER=vnightly HUGECTR_BACKEND_VER=vnightly HUGECTR_VER=vnightly NVTAB_VER=vnightly RELEASE=false RMM_VER=vnightly TF4REC_VER=vnightly TRITON_VERSION=21.12 /bin/bash -c rm -rf /repos
01/14/2022 11:37 AM UTC
fe565cc761102dfaa06ab6a811eae9619aedbb0d982912ba0181ce26d3498ac2RUN
CUDF_VER=vnightly HUGECTR_BACKEND_VER=vnightly HUGECTR_VER=vnightly NVTAB_VER=vnightly RELEASE=false RMM_VER=vnightly TF4REC_VER=vnightly TRITON_VERSION=21.12 /bin/bash -c ln -s /usr/local/hugectr/backends/hugectr /opt/tritonserver/backends/
01/14/2022 11:37 AM UTC
807824bb1969c853fe5dac0486806c49eafb5c709f8bcf6d58d846c8238bf6dbRUN
/bin/bash -c #(nop) ENV PATH=/usr/local/hugectr/bin:/usr/local/cuda/lib64/:/opt/tritonserver/bin:/usr/local/mpi/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/local/ucx/bin:/usr/local/cuda/bin
01/14/2022 11:37 AM UTC
e5350574fc60da864cd4b957d0cd270a8b725e106625cf95fff4ef2d055d7173RUN
/bin/bash -c #(nop) ENV LD_LIBRARY_PATH=/usr/local/hugectr/lib:/usr/local/cuda/compat/lib:/usr/local/nvidia/lib:/usr/local/nvidia/lib64:/usr/local/cuda/lib64:/usr/local/cuda/extras/CUPTI/lib64:/usr/local/lib:/repos/dist/lib
01/14/2022 11:37 AM UTC
...