ENTITY
Ray Serve
Ray Serve
PulseAugur coverage of Ray Serve — every cluster mentioning Ray Serve across labs, papers, and developer communities, ranked by signal.
Total · 30d
2
2 over 90d
Releases · 30d
0
0 over 90d
Papers · 30d
0
0 over 90d
TIER MIX · 90D
TOPICS
SENTIMENT · 30D
1 day(s) with sentiment data
RECENT · PAGE 1/1 · 2 TOTAL
-
Anyscale cuts LLM serving costs with disaggregated prefill-decode on AMD
Anyscale has demonstrated significant cost savings in LLM serving by disaggregating the prefill and decode phases of inference. This approach separates prompt processing onto dedicated GPUs from token generation, reduci…
-
Anyscale adds fault tolerance for MoE models in vLLM with Ray Serve
Anyscale has introduced a new fault tolerance feature for its vLLM serving engine, integrated with Ray Serve. This enhancement specifically addresses the challenges of deploying large Mixture-of-Experts (MoE) models, wh…