How Torc hit 90% GPU utilization and other stories on scaling AI with Ray from Discord, Cubist, and Coinbase
Anyscale's Ray Day event in New York showcased how companies like Torc Robotics, Discord, Cubist, and Coinbase are leveraging the Ray framework to scale their AI workloads. Torc Robotics, for instance, significantly improved GPU utilization from 30-40% to around 90% by unifying their multimodal AI processing stack with Ray, leading to a 4x speedup in model training epochs. Discord transitioned from an open-source Ray deployment to Anyscale's managed platform to handle increased adoption and reduce operational overhead, enabling faster development and deployment of large-scale models. AI
IMPACT Showcases practical applications and scaling challenges of AI infrastructure frameworks in production environments.