BurstGPT
PulseAugur coverage of BurstGPT — every cluster mentioning BurstGPT across labs, papers, and developer communities, ranked by signal.
1 day(s) with sentiment data
-
FleetSieve optimizes LLM fleet configuration with intelligent profiling
Researchers have developed FleetSieve, a novel method for optimizing the configuration of large language model (LLM) fleets. This system intelligently selects which configurations to profile, aiming to reduce the comput…
-
Reinforcement learning boosts AI inference routing by 3.5x in multi-GPU systems
Researchers have explored using reinforcement learning (RL) to create adaptive inference batching and routing policies for AI systems. In single-GPU scenarios with predictable traffic, RL offered only minor improvements…
-
Reinforcement learning optimizes AI inference routing, boosting throughput
Researchers have developed a reinforcement learning (RL) approach to optimize inference batching and routing for AI systems, particularly in multi-GPU environments. Their findings indicate that while RL offers only marg…