PulseAugur
实时 13:25:06

New RCD method optimizes LLM processing of long clinical texts within budget

Researchers have developed a new method called RCD for selecting relevant subsets of long clinical texts to reduce token costs for large language models. This approach frames the problem as a knapsack-constrained subset selection, balancing relevance, coverage, and diversity. Experiments on various datasets showed that different unitization strategies and selection methods perform best depending on the specific task and budget constraints, with diversity-aware methods like MMR proving beneficial for LLM generation. AI

影响 Optimizes LLM token usage for long clinical documents, potentially lowering operational costs and improving efficiency in healthcare AI applications.

排序理由 Academic paper detailing a new method for optimizing LLM input processing.

在 arXiv cs.CL 阅读 →

AI 生成摘要 · Google Gemini · 来自 2 个来源。 我们如何撰写摘要 →

New RCD method optimizes LLM processing of long clinical texts within budget

报道来源 [2]

  1. arXiv cs.CL TIER_1 English(EN) · Khizar Qureshi, Geoffrey Martin, Yifan Peng ·

    Budget-Aware Routing for Long Clinical Text

    arXiv:2605.00336v1 Announce Type: new Abstract: A key challenge for large language models is token cost per query and overall deployment cost. Clinical inputs are long, heterogeneous, and often redundant, while downstream tasks are short and high stakes. We study budgeted context…

  2. arXiv cs.CL TIER_1 English(EN) · Yifan Peng ·

    Budget-Aware Routing for Long Clinical Text

    A key challenge for large language models is token cost per query and overall deployment cost. Clinical inputs are long, heterogeneous, and often redundant, while downstream tasks are short and high stakes. We study budgeted context selection, where a subset of document units is …