English(EN) Selecting the Best Few with Human Evaluators: Adaptively Combining Ratings and Pairwise Comparisons

新算法结合人类评分和成对比较进行项目选择

作者 PulseAugur 编辑部 · [1 个来源] · 2026-10-21 04:00

一篇新的研究论文提出了一种自适应算法，用于利用人类评估从大量候选项目中选择排名前 k 的项目。该算法智能地结合了评分和成对比较，优化了有限评估预算的使用。它采用了一种前瞻性的分配策略，优先考虑为后续轮次提供信息的评估，并在接近最终选择时切换到一种近视策略。 AI

影响这项研究可以提高各种与 AI 相关的应用中选择顶尖候选者的效率，例如 LLM 评估或产品创意选择。

排序理由详细介绍使用人类评估进行项目选择的新算法的学术论文。[lever_c_demoted from research: ic=1 ai=0.7]

AI 生成摘要 · Google Gemini · 来自 1 个来源。我们如何撰写摘要 →

本文如何被排名

Signal score: 0 / 100; Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket: Tool; 详细介绍使用人类评估进行项目选择的新算法的学术论文。[lever_c_demoted from research: ic=1 ai=0.7]
Source corroboration: Single-source cluster; Only one publisher covered this so far. Single-source stories can still rank when the publisher is high-authority, but they lack cross-source corroboration.
Topics: paper, other; Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance: High; Clearly on-topic for AI-industry coverage.
Story freshness: 4 days old; Aged out of breaking-news scoring windows; ranking reflects the durable signal from the full source set.

完整方法见我们的编辑标准。

arXiv cs.LG TIER_1 English(EN) · Motti Goldberger, Nils Rudi · 2026-10-21 04:00

利用人类评估者选择最佳少数：自适应地结合评分和成对比较

arXiv:2610.26380v2 Announce Type: replace-cross Abstract: This paper considers a decision-maker tasked with identifying the $k$ best items from a large pool of candidates, such as job applicants, LLMs, award nominees, or new product ideas. The decision-maker learns about the item…