Container
Model-Free NIM 2.0 is a NIM microservice container designed to support a broad range of LLMs. It includes a production-ready inference runtime with optimized inference engines from NVIDIA and the community such as vLLM.
Subscription required to access this content
Governing Terms:
Governing Download Terms:
The NIM container is governed by the NVIDIA Software License Agreement (https://www.nvidia.com/en-us/agreements/enterprise-software/nvidia-software-license-agreement/) and the Product-Specific Terms for NVIDIA AI Products (https://www.nvidia.com/en-us/agreements/enterprise-software/product-specific-terms-for-ai-products/).