PulseAugur
EN
LIVE 21:36:01

LLMs analyze reviewer scores, finding rebuttals bounded by initial review structure

A new study published on arXiv investigates the impact of author rebuttals on peer-review scores in academic conferences, specifically examining data from ICLR 2024-2025. Researchers utilized LLMs, including Gemini Flash 3.0 and Claude Opus 4.6, to analyze reviewer trajectories and identify patterns in score movement. The findings indicate that while rebuttals can influence scores, the extent of this movement is largely constrained by the initial review structure, with specific exchange features correlating with rebuttal success or failure. AI

IMPACT Provides insights into how LLMs can be used to analyze and understand complex human processes like academic peer review.

RANK_REASON The cluster contains a research paper published on arXiv detailing a study on peer review processes using LLMs. [lever_c_demoted from research: ic=1 ai=1.0]

Read on arXiv cs.AI →

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →

LLMs analyze reviewer scores, finding rebuttals bounded by initial review structure

How we ranked this

Signal score
0 / 100
Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket
Tool
The cluster contains a research paper published on arXiv detailing a study on peer review processes using LLMs. [lever_c_demoted from research: ic=1 ai=1.0]
Source corroboration
Single-source cluster
Only one publisher covered this so far. Single-source stories can still rank when the publisher is high-authority, but they lack cross-source corroboration.
Topics
paper, other
Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance
High
Clearly on-topic for AI-industry coverage.
Story freshness
78 days old
Aged out of breaking-news scoring windows; ranking reflects the durable signal from the full source set.

Full methodology in our editorial standards.

COVERAGE [1]

  1. arXiv cs.AI TIER_1 English(EN) · Andres Algaba ·

    Rebuttals Move Peer-Review Scores, but Initial-Review Structure Bounds the Movement

    Author rebuttals are the main post-submission window in peer review, but their effect on reviewer scores remains hard to measure because score updates mix rebuttal content with initial score position, paper-level consensus, reviewer confidence, and discussion dynamics. We study I…