ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
  • NVIDIA
    NVIDIA
    NVCF LLM Request Router
    Container
    NVIDIA
    NVIDIA
    NVCF LLM Request Router

    Routes LLM inference requests to function workers for NVCF Self-Managed deployments.

    Sign in to access all content for this ContainerSigning in will also allow download accessSign In

    NVCF LLM Request Router

    NVCF LLM Request Router (Stargate) dispatches LLM inference requests from the LLM API Gateway to function worker instances in NVIDIA Cloud Functions Self-Managed deployments.

    Documentation and Support

    See the NVIDIA Cloud Functions documentation. Support is available through the NVIDIA Developer Forums.

    License

    Use of this software is governed by the NVIDIA Cloud Agreement and applicable third-party notices.

    Publisher
    NVIDIA
    NVIDIA
    Latest Tag0.3.2
    UpdatedAugust 11, 2026 UTC
    Compressed Size27.48 MB
    Multinode SupportNo
    Multi-Arch SupportYes
    System
    Labels

    NVIDIA uses cookies to improve your experience on our web site. We and our third-party partners also use cookies and other tools to collect and record information you provide as well as information about your interactions with our websites for performance improvement, analytics, and to assist in marketing efforts. By clicking "Accept All", you consent to our use of cookies and other tools as described in our Cookie Policy. You can manage your cookie settings by clicking on "Manage Settings." By continuing to use this site or by clicking one of the buttons below, you agree to our Terms of Service (which contains important waivers). Please see our Privacy Policy for more information on our privacy practices.