NVIDIA
SGLang
Container
NVIDIA
SGLang

SGLang is a fast serving framework for large language models and vision language models. The NVIDIA SGLang NGC Container is optimized for GPU acceleration, and contains a validated set of libraries that enable and optimize GPU performance.

  • This collection contains performance-optimized Deep Learning frameworks.