两篇新研究论文强调了基因组基础模型评估中存在的重大问题。第一篇论文认为，当前的做法过于依赖轶事证据，并提出了一个类似于临床试验的框架，以进行更严格的评估。第二篇论文介绍了GENEB，这是一个全面的基准测试，旨在允许对这些模型在各种任务和架构上的直接比较，并揭示模型排名不稳定，并且通常高度依赖于特定任务。 AI
影响 缺乏标准化评估阻碍了基因组AI的进展；新的基准测试旨在为模型选择提供清晰度。
排序理由 两篇论文为基因组AI模型提出了新的评估框架和基准测试。
在 Hugging Face Daily Papers 阅读 →
AI 生成摘要 · Google Gemini · 来自 3 个来源。 我们如何撰写摘要 →
arXiv:2604.04287v2 Announce Type: replace-cross Abstract: Foundation models in genomics have shown mixed success compared to their counterparts in natural language processing. Yet, the reasons for their limited effectiveness remain poorly understood. In this work, we investigate …
arXiv:2606.07607v1 Announce Type: new Abstract: Advances in machine learning and computational power have unlocked the predictive potential of the human genome, yet biologists now demand that these models also elucidate the underlying biological mechanisms. While interpretable ma…
GENEB presents a comprehensive benchmark for evaluating genomic foundation models across diverse tasks and architectures under a unified protocol.