PulseAugur
实时 04:33:10

Coral and CoRAL systems optimize LLM serving and robotic control

Researchers have developed two distinct systems named Coral and CoRAL. Coral is an adaptive system designed for cost-efficient serving of multiple large language models across heterogeneous cloud GPUs, aiming to optimize resource allocation and reduce serving costs by up to 2.79x. CoRAL, on the other hand, is a framework for robotic manipulation that uses LLMs for adaptive control, enabling zero-shot planning by decoupling high-level reasoning from low-level control and improving success rates by over 50% in contact-rich scenarios. AI

影响 Introduces novel approaches for optimizing LLM serving costs and enhancing robotic manipulation capabilities through LLM integration.

排序理由 Two distinct research papers are presented, one on LLM serving infrastructure and another on LLM-based robotic control.

在 arXiv cs.AI 阅读 →

AI 生成摘要 · Google Gemini · 来自 4 个来源。 我们如何撰写摘要 →

Coral and CoRAL systems optimize LLM serving and robotic control

报道来源 [4]

  1. arXiv cs.LG TIER_1 English(EN) · Yixuan Mei, Zikun Li, Zixuan Chen, Shiqi Pan, Mengdi Wu, Xupeng Miao, Zhihao Jia, K. V. Rashmi ·

    Coral: Cost-Efficient Multi-LLM Serving over Heterogeneous Cloud GPUs

    arXiv:2605.04357v1 Announce Type: cross Abstract: The usage of large language models (LLMs) has grown increasingly fragmented, with no single model dominating. Meanwhile, cloud providers offer a wide range of mid-tier and older-generation GPUs that enjoy better availability and d…

  2. arXiv cs.AI TIER_1 English(EN) · Berk \c{C}i\c{c}ek, Mert K. Er, \"Ozg\"ur S. \"O\u{g}\"uz ·

    CoRAL: Contact-Rich Adaptive LLM-based Control for Robotic Manipulation

    arXiv:2605.02600v1 Announce Type: cross Abstract: While Large Language Models (LLMs) and Vision-Language Models (VLMs) demonstrate remarkable capabilities in high-level reasoning and semantic understanding, applying them directly to contact-rich manipulation remains a challenge d…

  3. arXiv cs.CL TIER_1 English(EN) · K. V. Rashmi ·

    Coral: Cost-Efficient Multi-LLM Serving over Heterogeneous Cloud GPUs

    The usage of large language models (LLMs) has grown increasingly fragmented, with no single model dominating. Meanwhile, cloud providers offer a wide range of mid-tier and older-generation GPUs that enjoy better availability and deliver comparable performance per dollar to top-ti…

  4. arXiv cs.AI TIER_1 English(EN) · Özgür S. Öğüz ·

    CoRAL: Contact-Rich Adaptive LLM-based Control for Robotic Manipulation

    While Large Language Models (LLMs) and Vision-Language Models (VLMs) demonstrate remarkable capabilities in high-level reasoning and semantic understanding, applying them directly to contact-rich manipulation remains a challenge due to their lack of explicit physical grounding an…