PulseAugur
EN
LIVE 06:18:57

NeurIPS and ICML 2025 position tracks favor critique over new direction, study finds

By PulseAugur Editorial · [1 sources] ·

A new paper investigates the position tracks of the NeurIPS and ICML 2025 conferences, arguing that they are dominated by reformist critiques rather than direction-setting work. The audit of accessible submissions found that while many papers critique existing benchmarks or methodologies, their evidentiary depth did not strongly correlate with reviewer ratings. The paper suggests that agenda-shifting research, exemplified by foundational works like AlexNet and the Transformer, typically provides new artifacts for the community to build upon, test, or contest. To address this, the authors propose four interventions for the conference calls for papers to encourage a broader mix of submissions. AI

IMPACT This analysis of conference tracks could influence how AI research agendas are set and evaluated in the future.

RANK_REASON Academic paper analyzing conference submission trends. [lever_c_demoted from research: ic=1 ai=1.0]

Read on arXiv cs.CL →

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →

NeurIPS and ICML 2025 position tracks favor critique over new direction, study finds

How we ranked this

Signal score
0 / 100
Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket
Tool
Academic paper analyzing conference submission trends. [lever_c_demoted from research: ic=1 ai=1.0]
Source corroboration
Single-source cluster
Only one publisher covered this so far. Single-source stories can still rank when the publisher is high-authority, but they lack cross-source corroboration.
Topics
paper, other
Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance
High
Clearly on-topic for AI-industry coverage.
Story freshness
51 days old
Aged out of breaking-news scoring windows; ranking reflects the durable signal from the full source set.

Full methodology in our editorial standards.

COVERAGE [1]

  1. arXiv cs.CL TIER_1 English(EN) · Fan Yang, Wenkai Li, Jun Liu ·

    An Investigation of the NeurIPS and ICML 2025 Position Tracks

    arXiv:2608.16894v1 Announce Type: cross Abstract: ML venues shape what kinds of research claims become legible to reviewers and what forms of evidence count as rigorous. The NeurIPS and ICML Position Paper Tracks were created for agenda-setting work, making their early compositio…

RELATED ENTITIES

RELATED TOPICS