Brief

Together AI has launched Together Instant Clusters, a new service providing readily available, self-service GPU clusters for AI development and deployment. This offering aims to simplify the complex process of setting up multi-node GPU infrastructure, allowing users to provision clusters with hundreds of GPUs in minutes via API, CLI, or console. The service includes pre-configured components for distributed training and inference, supporting NVIDIA's latest GPU architectures and high-performance networking solutions. AI

Character.ai has developed an internal system called Slonk, which integrates the traditional SLURM scheduler with Kubernetes for managing GPU research clusters. This system aims to provide researchers with the familiar user experience of SLURM, including features like fair queues and gang scheduling, while leveraging Kubernetes for operational benefits such as orchestration, health checks, and autoscaling. Slonk treats SLURM nodes as Kubernetes pods, allowing for efficient resource sharing and management across heterogeneous clusters and clouds. AI