Overview

GPUd is designed to ensure GPU efficiency and reliability by actively monitoring GPUs and effectively managing AI/ML workloads.

Why GPUd

GPUd is built on years of experience operating large-scale GPU clusters at Meta, Alibaba Cloud, Uber, and Lepton AI. It is carefully designed to be self-contained and to integrate seamlessly with other systems such as Docker, containerd, Kubernetes, and NVIDIA ecosystems.

• First-class GPU support: GPUd is GPU-centric, providing a unified view of critical GPU metrics and issues.
• Easy to run at scale: GPUd is a self-contained binary that runs on any machine with a low footprint.
• Production grade: GPUd is used in DGX Cloud Lepton's production infrastructure.

License

Apache License 2.0

https://github.com/leptonai/gpud/blob/main/LICENSE