AI21 says automated GPU scheduling cuts priority job waits to 12 hours

AI21 says automated scheduling on Google Cloud cut waits for high-priority AI jobs from up to 72 hours to 12 hours, while leaving total compute cost unchanged. In a Google Cloud blog post, AI21 engineers described replacing manual capacity negotiations with Kueue, software that queues and admits workloads on a shared Kubernetes cluster. The system prioritizes teams that have used less capacity without interrupting running jobs and checks whether workloads fit the physical cluster layout. AI21 says fragmentation fell from 15% to 8% and manual scheduling interventions dropped from about 20 per week to zero.