PulseAugur
实时 21:11:39
English(EN) How Can Rhetoric Reward-Hack AI Reviewers? Dissecting Rhetorical Sensitivity in AI-Based Peer Review

AI审稿人被修辞操纵;AI辅助同行评审面临质量挑战 · 跟踪3个来源

一篇新论文探讨了AI审稿人如何通过科学手稿中的修辞措辞被操纵,发现证据的构建方式和新颖性立场显著影响AI的判断。该研究构建了一个包含4,200篇手稿的语料库,由LLM重写器修改,并由五个LLM审稿人进行评估,揭示了AI审稿质量可能受到风格选择而非仅仅是内容的影响。同时,另一项研究调查了会议和期刊的AI审稿人政策,注意到AI/NLP领域与医学领域之间存在显著的监管差异,并发现当前的LLM虽然流畅,但存在过度积极的推荐和证据基础不均衡等弱点,这表明需要对AI生成的审稿进行多维度评估。 AI

影响 AI越来越多地参与科学同行评审,给维护审稿的完整性和质量带来了挑战,需要健全的评估系统和明确的政策。

排序理由 该集群包含两篇学术论文,详细介绍了AI在科学同行评审中的作用的研究,包括其潜在的漏洞和当前的局限性。

在 Hugging Face Daily Papers 阅读 →

AI 生成摘要 · Google Gemini · 来自 14 个来源。 我们如何撰写摘要 →

AI审稿人被修辞操纵;AI辅助同行评审面临质量挑战 · 跟踪3个来源

报道来源 [14]

  1. arXiv cs.AI TIER_1 English(EN) · Ming Li, Chenguang Wang, Xirui Li, Xinyue Zeng, Dianqi Li, Peng Shi, Dawei Zhou, Tianyi Zhou ·

    修辞如何能奖励性地“黑”AI审稿人?剖析AI同行评审中的修辞敏感性

    arXiv:2608.08975v1 Announce Type: cross Abstract: As large language models increasingly participate in scientific evaluation, we investigate a potential form of reward hacking: how rhetorical choices shape AI-review judgments when reported scientific content is preserved and how …

  2. Hugging Face Daily Papers TIER_1 English(EN) ·

    修辞如何能奖励性地“黑”AI审稿人?剖析AI同行评审中的修辞敏感性

    As large language models increasingly participate in scientific evaluation, we investigate a potential form of reward hacking: how rhetorical choices shape AI-review judgments when reported scientific content is preserved and how these effects vary across evaluation conditions. W…

  3. Hugging Face Daily Papers TIER_1 English(EN) ·

    AI 辅助跨研究社区同行评审:从评审 AI 政策到 LLM 评审质量

    AI-assisted peer review is increasingly discussed and adopted as a tool to support the scientific publishing process, yet there is little systematic understanding of how publication venues regulate its use or of how capable current AI review systems are. We address these question…

  4. Ars Technica — AI TIER_1 English(EN) · Saima Sidik ·

    同行评审不堪重负——它能在人工智能时代生存下来吗?

    As research and AI-assisted papers surge, volunteer reviewers struggle to keep up.

  5. Mastodon — sigmoid.social TIER_1 English(EN) · [email protected] ·

    # 人工智能 # 同行评审 # 科学 # 博客 "同行评审不堪重负——它能在人工智能时代生存下来吗?随着研究和人工智能辅助论文激增,志愿评审员在挣扎

    # AI # PeerReview # science # blogs "Peer review is overwhelmed—can it survive in the AI era? As research and AI-assisted papers surge, volunteer reviewers struggle to keep up. The number of papers indexed in the databases Scopus and Web of Science, for example, has recently been…

  6. Mastodon — sigmoid.social TIER_1 Français(FR) · [email protected] ·

    科学研究的基石:同行评审面临志愿者短缺和人工智能使用的挑战

    Le fondement de la recherche scientifique : l’examen par les pairs confronté par la pénurie de bénévoles et le recours à l’intelligence artificielle https:// arstechnica.com/science/2026/0 8/peer-review-is-overwhelmed-can-it-survive-in-the-ai-era/ # science # recherche # pairs # …

  7. Mastodon — fosstodon.org TIER_1 English(EN) · [email protected] ·

    同行评审不堪重负——它能在#人工智能时代幸存下来吗?研究人员需要同行评审的出版物来保住工作和获得资助,因此他们继续艰难地工作

    # PeerReview is overwhelmed—can it survive in the # AI era? Researchers need peer-reviewed publications to secure jobs and grants, so they continue to slog through the system even though it’s becoming “extremely protracted and painful” The number of papers in databases Scopus and…

  8. Mastodon — fosstodon.org TIER_1 English(EN) · [email protected] ·

    AI 垃圾内容的反对浪潮正产生影响 平台终于认识到人们不想消费 AI 垃圾内容。越来越多的网站和应用程序

    The AI Slop Backlash Is Actually Having an Impact Platforms are finally recognizing that people don’t want to consume AI slop. A growing number of sites and apps now have tools and policies to flag, label, and ban AI-generated content. https://www. wired.com/story/the-ai-slop-ba …

  9. Mastodon — fosstodon.org TIER_1 English(EN) · [email protected] ·

    📰同行评审不堪重负——它能在人工智能时代生存下来吗?随着研究和人工智能辅助论文激增,志愿审稿人难以跟上。📰来源:Ars Tech

    📰 Peer review is overwhelmed—can it survive in the AI era? As research and AI-assisted papers surge, volunteer reviewers struggle to keep up. 📰 Source: Ars Technica 🔗 Link: https://arstechnica.com/science/2026/08/peer-review-is-overwhelmed-can-it-survive-in-the-ai-era/ # AI # Art…

  10. Mastodon — mastodon.social TIER_1 English(EN) · [email protected] ·

    AI 辅助论文涌入期刊——志愿者同行评审者根本跟不上 https:// arstechnica.com/science/2026/0 8/peer-review-is-overwhelme

    AI-assisted papers are flooding journals — and volunteer peer reviewers simply can't keep up https:// arstechnica.com/science/2026/0 8/peer-review-is-overwhelmed-can-it-survive-in-the-ai-era/ As research and AI-assisted papers surge, volunteer reviewers struggle to keep up. # sci…

  11. Mastodon — mastodon.social TIER_1 English(EN) · [email protected] ·

    随着研究和AI辅助论文激增,志愿者审稿人难以跟上步伐。#科学 #人工智能 #科学 https://arstechnica.com/science/2026/08/peer-revie

    As research and AI-assisted papers surge, volunteer reviewers struggle to keep up. # science # ai # science https:// arstechnica.com/science/2026/0 8/peer-review-is-overwhelmed-can-it-survive-in-the-ai-era/?utm_source=flipboard&utm_medium=activitypub Posted into FLIPBOARD EXCHANG…

  12. Mastodon — mastodon.social TIER_1 English(EN) · [email protected] ·

    AI 垃圾内容的反对浪潮正产生影响 平台终于认识到人们不想消费 AI 垃圾内容。越来越多的网站和应用

    The AI Slop Backlash Is Actually Having an Impact Platforms are finally recognizing that people don’t want to consume AI slop. A growing number of sites and apps now have tools and policies to flag, label, and ban AI-generated content. https://www. wired.com/story/the-ai-slop-ba …

  13. Mastodon — mastodon.social TIER_1 English(EN) · [email protected] ·

    同行评审不堪重负——它能在人工智能时代生存下来吗?随着研究和人工智能辅助论文激增,志愿审稿人难以跟上。https:// arstechnica

    Peer review is overwhelmed—can it survive in the AI era? As research and AI-assisted papers surge, volunteer reviewers struggle to keep up. https:// arstechnica.com/science/2026/0 8/peer-review-is-overwhelmed-can-it-survive-in-the-ai-era/ # Tech # Technology # TechNews # AI # Gad…

  14. r/singularity TIER_2 English(EN) · /u/JackFisherBooks ·

    同行评审不堪重负——它能在人工智能时代生存下来吗?

    <table> <tr><td> <a href="https://www.reddit.com/r/singularity/comments/1vkptqw/peer_review_is_overwhelmedcan_it_survive_in_the/"> <img alt="Peer review is overwhelmed—can it survive in the AI era?" src="https://external-preview.redd.it/W-Wsv2uEzkp0xG3rL-L5kzwU5jSd7G0jp5TklD3aJUQ…