NVIDIA
NVIDIA
Triton FIL backend with XGBoost
Resource
NVIDIA
NVIDIA
Triton FIL backend with XGBoost

This resource is a Jupyter Notebook example that showcases NVIDIA Triton with Forest Inference Library (FIL) backend.

Overview

This notebook is a reference for deploying an XGBoost model on Triton with the FIL backend. The notebook explains how one can deploy XGBoost model in Triton, check deployment status and send inference requests, set concurrent model execution and dynamic batching and find the best deployment configuration using Model Analyzer.

Deploying the notebooks

To deploy these notebooks with the optimal configuration to the cloud please click the "deploy" button on the top right of NGC.

Reading the notebook without leaving NGC

If you want to read through the notebook example without leaving our website, follow these steps:

  1. Navigate to the File Browser tab of the asset in NGC
  2. Select the version you'd like to see
  3. Next to the .ipynb file select "View Jupyter"
  4. There you have it! You can read a notebook for documentation and copy code samples without ever leaving NGC.
  5. All the instructions you need to get started are in the resource - so head over and see how to get up and running.
Publisher
NVIDIA
NVIDIA
Latest Version1.0
UpdatedApril 4, 2023 UTC
Compressed Size317.24 KB

NVIDIA uses cookies to improve your experience on our web site. We and our third-party partners also use cookies and other tools to collect and record information you provide as well as information about your interactions with our websites for performance improvement, analytics, and to assist in marketing efforts. By clicking "Accept All", you consent to our use of cookies and other tools as described in our Cookie Policy. You can manage your cookie settings by clicking on "Manage Settings." By continuing to use this site or by clicking one of the buttons below, you agree to our Terms of Service (which contains important waivers). Please see our Privacy Policy for more information on our privacy practices.