OpenAI 推出了 LifeSciBench，这是一个旨在评估和增强人工智能在现实世界生命科学研究中能力的新基准。该基准由来自生物技术和制药行业的 173 名科学家合作开发，包含 750 个专家撰写的任务。LifeSciBench 旨在评估人工智能从证据中推理、管理科学产物、处理不确定性以及做出实际决策的能力，超越狭窄的技能测试。 AI
影响 为生命科学领域的人工智能评估设定了新标准，有可能加速该领域人工智能的采用和发展。
排序理由 前沿实验室产品发布，包含新的基准和初步模型性能数据。
在 Mastodon — fosstodon.org 阅读 →
AI 生成摘要 · Google Gemini · 来自 6 个来源。 我们如何撰写摘要 →
LifeSciBench is a foundation for more realistic evaluation, targeted improvements, and continued partnership with the life sciences community—helping the field measure progress, identify gaps, and improve AI together for the benefit of everyone.
Benchmarks often test biological knowledge or narrow skills. The tasks in LifeSciBench test whether models can reason from evidence, work with scientific artifacts, handle uncertainty, and make useful decisions under real-world constraints. GPT‑Rosalind scores above GPT‑5.5 http…
Introducing LifeSciBench, a benchmark for measuring and improving how well AI supports real-world life science research. Developed with 173 scientists from biotechnology and pharmaceutical research, LifeSciBench includes 750 expert-authored tasks across seven biological research…
<p>OpenAI's LifeSciBench evaluates whether frontier AI can handle real life-science research across 750 expert-authored tasks, seven workflows, and seven biological domains. Built by 173 PhD scientists with 19,020 rubric criteria, it grades reasoning and decisions, not just recal…
📰 OpenAI Announces Benchmarks for AI Life Sciences Research. Its Best Model Failed 63.9% of the Test This week OpenAI announced a 750-task test to to measure "whether AI systems can support realistic life science research tasks, not just answer biology questions." But while OpenA…
🤖 Introducing LifeSciBench Introducing LifeSciBench, an expert-authored, expert-reviewed benchmark for evaluating how AI systems handle real-world life science research tasks and decisions. 📰 Source: OpenAI News 🔗 Link: https://openai.com/index/introducing-life-sci-bench # AI # A…