Hugging Face AI Open Source Blog: Impactful scheduling for GPU clusters
The AI2 AI Infrastructure team has replaced its priority-based GPU scheduler with a system featuring GPU time budgets, hierarchical fair-share allocation, and time-slice contracts to manage thousands of NVIDIA H100, B200, and B300 GPUs for approximately 150 internal researchers, whose demand exceeds capacity by two to three times.
Return to original text
A short introduction is retained here; the full text from the source website is not reposted. For specific wording and subsequent updates, please refer to the original article.
Open Hugging Face blog original