ENTITY
Llumnix
Llumnix
PulseAugur coverage of Llumnix — every cluster mentioning Llumnix across labs, papers, and developer communities, ranked by signal.
Total · 30d
0
2 over 90d
Releases · 30d
0
0 over 90d
Papers · 30d
0
2 over 90d
TIER MIX · 90D
TOPICS
RECENT · PAGE 1/1 · 2 TOTAL
-
LLM serving scheduler extended to support multi-tier SLAs
Researchers have extended the Llumnix LLM serving scheduler to support more than two priority tiers, enabling it to better manage heterogeneous service-level objectives (SLOs). The enhanced scheduler was evaluated using…
-
Astrolabe system optimizes LLM serving with randomized prediction-guided scheduling
Researchers have developed Astrolabe, a novel scheduling system designed to optimize the serving of large language models (LLMs). This system employs a randomized prediction-guided approach to balance load across multip…