PulseAugur
EN
LIVE 06:59:34

AI reviewers disproportionately focus on paper appendices, study finds

A new study analyzing 2,000 academic papers has found that large language models like GPT and Claude tend to focus their identified weaknesses on a paper's appendix, drawing over 50% of their criticisms from this section. This contrasts sharply with human reviewers, who extract only 8.4% of their critical feedback from appendices and focus more on the paper's core ideas and presentation. The LLMs' criticisms often delve into fine-grained technical details within the appendix that are not central to the paper's main contributions. AI

IMPACT Highlights a potential bias in AI-assisted academic reviewing, suggesting a need for better alignment with human review priorities.

RANK_REASON The cluster contains an academic paper analyzing the behavior of AI models.

Read on Hugging Face Daily Papers →

AI-generated summary · Google Gemini · from 2 sources. How we write summaries →

AI reviewers disproportionately focus on paper appendices, study finds

How we ranked this

Signal score
0 / 100
Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket
Research
The cluster contains an academic paper analyzing the behavior of AI models.
Source corroboration
2 independent sources
Multiple independent publishers reporting the same story raises confidence that it's real and newsworthy.
Topics
paper, opinion
Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance
High
Clearly on-topic for AI-industry coverage.
Story freshness
3 days old
Aged out of breaking-news scoring windows; ranking reflects the durable signal from the full source set.

Full methodology in our editorial standards.

COVERAGE [2]

  1. arXiv cs.CL TIER_1 English(EN) · Saptarshi Ghosh, Mohammad Saim, Tianyu Jiang ·

    AI Reviews Are Biased Towards the Appendix

    arXiv:2611.17811v1 Announce Type: new Abstract: Large language models (LLMs) are increasingly used by reviewers to highlight weaknesses during the reviewing process, and their outputs often shape the reviews that humans submit. Prior work studies how LLM reviews align with human …

  2. Hugging Face Daily Papers TIER_1 English(EN) ·

    AI Reviews Are Biased Towards the Appendix

    Large language models used for peer review draw about half or more of their identified weaknesses from paper appendices, whereas human reviewers draw only 8.4% and focus on presentation and core ideas.