DLI Accelerating Data Engineering Pipelines - Base Environment

DLI Accelerating Data Engineering Pipelines Base Environment Container

This container is used in the NVIDIA Deep Learning Institute workshop Accelerating Data Engineering Pipelines, and with it, you can build your own software using the same libraries and tools used in the workshop. If you have not done so yet, we highly recommend you take the course, and check out other self-paced online courses and instructor-led workshops available from the NVIDIA Deep Learning Institute.

Please Note: This container does not include the training materials or data from the workshop, just the base environment.

Prerequisites

The following are required to run this container.

• NVIDIA Pascal™ GPU architecture or better
• CUDA 10.1/10.2/11.0/11.2 with a compatible NVIDIA driver
• Ubuntu 18.04/20.04 or CentOS 7/8
• Docker CE v18+
• nvidia-container-toolkit

How to Use the Container

If you've never used Docker, we recommend their Orientation and Setup.

Copy and paste the following to download and run the container:

docker run -d \
  --runtime=nvidia \
  -p 8888:8888 \
  -v $PWD:/dli/task/mywork \
  nvcr.io/nvidia/dli/dli-data-engineering:v1.0.0

After running the above, you will be able to access the Jupyter Lab environment running inside the container by visiting <localhost>:8888 in your browser. There you will find a notebook, Toolbox.ipynb containing instructions for a more advanced and open ended project, intended for students who have completed the workshop.

Technical Support

• RAPIDS Docs
• RAPIDS on GitHub
• DLI RAPIDS Course

License

Copyright 2021 NVIDIA

Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License. You may obtain a copy of the License at

http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License.

Base Image Used for This Container

Also used in this container, and with its own licensing:

RAPIDS on NGC

Software Installed on Top of Base Image

Also used in this container, and with its own licensing:

• Bokeh
• Datashader
• cuDF
• Cupy
• cuxfilter
• Graphviz
• Graphviz (Python interface)
• NVTabular
• Plotly
• Panel