English(EN)How Can Rhetoric Reward-Hack AI Reviewers? Dissecting Rhetorical Sensitivity in AI-Based Peer Review
AI审稿人被修辞操纵;AI辅助同行评审面临质量挑战 · 跟踪3个来源
作者PulseAugur 编辑部·[14 个来源]·
一篇新论文探讨了AI审稿人如何通过科学手稿中的修辞措辞被操纵,发现证据的构建方式和新颖性立场显著影响AI的判断。该研究构建了一个包含4,200篇手稿的语料库,由LLM重写器修改,并由五个LLM审稿人进行评估,揭示了AI审稿质量可能受到风格选择而非仅仅是内容的影响。同时,另一项研究调查了会议和期刊的AI审稿人政策,注意到AI/NLP领域与医学领域之间存在显著的监管差异,并发现当前的LLM虽然流畅,但存在过度积极的推荐和证据基础不均衡等弱点,这表明需要对AI生成的审稿进行多维度评估。
AI
arXiv:2608.08975v1 Announce Type: cross Abstract: As large language models increasingly participate in scientific evaluation, we investigate a potential form of reward hacking: how rhetorical choices shape AI-review judgments when reported scientific content is preserved and how …
As large language models increasingly participate in scientific evaluation, we investigate a potential form of reward hacking: how rhetorical choices shape AI-review judgments when reported scientific content is preserved and how these effects vary across evaluation conditions. W…
AI-assisted peer review is increasingly discussed and adopted as a tool to support the scientific publishing process, yet there is little systematic understanding of how publication venues regulate its use or of how capable current AI review systems are. We address these question…
# AI # PeerReview # science # blogs "Peer review is overwhelmed—can it survive in the AI era? As research and AI-assisted papers surge, volunteer reviewers struggle to keep up. The number of papers indexed in the databases Scopus and Web of Science, for example, has recently been…
Le fondement de la recherche scientifique : l’examen par les pairs confronté par la pénurie de bénévoles et le recours à l’intelligence artificielle https:// arstechnica.com/science/2026/0 8/peer-review-is-overwhelmed-can-it-survive-in-the-ai-era/ # science # recherche # pairs # …
# PeerReview is overwhelmed—can it survive in the # AI era? Researchers need peer-reviewed publications to secure jobs and grants, so they continue to slog through the system even though it’s becoming “extremely protracted and painful” The number of papers in databases Scopus and…
The AI Slop Backlash Is Actually Having an Impact Platforms are finally recognizing that people don’t want to consume AI slop. A growing number of sites and apps now have tools and policies to flag, label, and ban AI-generated content. https://www. wired.com/story/the-ai-slop-ba …
📰 Peer review is overwhelmed—can it survive in the AI era? As research and AI-assisted papers surge, volunteer reviewers struggle to keep up. 📰 Source: Ars Technica 🔗 Link: https://arstechnica.com/science/2026/08/peer-review-is-overwhelmed-can-it-survive-in-the-ai-era/ # AI # Art…
AI-assisted papers are flooding journals — and volunteer peer reviewers simply can't keep up https:// arstechnica.com/science/2026/0 8/peer-review-is-overwhelmed-can-it-survive-in-the-ai-era/ As research and AI-assisted papers surge, volunteer reviewers struggle to keep up. # sci…
As research and AI-assisted papers surge, volunteer reviewers struggle to keep up. # science # ai # science https:// arstechnica.com/science/2026/0 8/peer-review-is-overwhelmed-can-it-survive-in-the-ai-era/?utm_source=flipboard&utm_medium=activitypub Posted into FLIPBOARD EXCHANG…
The AI Slop Backlash Is Actually Having an Impact Platforms are finally recognizing that people don’t want to consume AI slop. A growing number of sites and apps now have tools and policies to flag, label, and ban AI-generated content. https://www. wired.com/story/the-ai-slop-ba …
Peer review is overwhelmed—can it survive in the AI era? As research and AI-assisted papers surge, volunteer reviewers struggle to keep up. https:// arstechnica.com/science/2026/0 8/peer-review-is-overwhelmed-can-it-survive-in-the-ai-era/ # Tech # Technology # TechNews # AI # Gad…
<table> <tr><td> <a href="https://www.reddit.com/r/singularity/comments/1vkptqw/peer_review_is_overwhelmedcan_it_survive_in_the/"> <img alt="Peer review is overwhelmed—can it survive in the AI era?" src="https://external-preview.redd.it/W-Wsv2uEzkp0xG3rL-L5kzwU5jSd7G0jp5TklD3aJUQ…