NVIDIA has open-sourced its Run:ai platform, a GPU orchestration tool for Kubernetes, under the Apache 2.0 license. This release allows developers to inspect, fork, and self-host the platform without a subscription, integrating it into the NVIDIA DSX AI Factory. The platform includes components like the KAI Scheduler for GPU-aware scheduling and a GPU Fractioning Operator for CUDA 13.4, enabling features such as gang scheduling, fair-share, and topology awareness. While the community edition lacks enterprise support, it can be deployed from source or via a Helm chart, with options for local development on macOS or Linux without requiring physical GPUs. AI
IMPACT Enables broader adoption and customization of GPU orchestration for AI workloads.
RANK_REASON Open-source release of an existing platform, not a new frontier model or core research.
Read on Mastodon — mastodon.social →
- Apache Software License 2.0
- Azure
- CNCF Sandbox
- CUDA
- GitHub
- GPU Fractioning Operator
- KAI Resource Management
- KAI Scheduler
- Kubernetes
- Linux
- macOS
- Nvidia
- NVIDIA DSX AI Factory
- NVIDIA H100
- OpenShift
- PyTorchJob
- Run:ai
- Tesla-A10
- Workload Map
- CUDA 13.4
- MarkTechPost
AI-generated summary · Google Gemini · from 2 sources. How we write summaries →