ENTITY SWE-Bench Pro Verified

SWE-Bench Pro Verified

PulseAugur coverage of SWE-Bench Pro Verified — every cluster mentioning SWE-Bench Pro Verified across labs, papers, and developer communities, ranked by signal.

Show in brief

Total · 30d

1 over 90d

Releases · 30d

0 over 90d

Papers · 30d

1 over 90d

TIER MIX · 90D

TOPICS

paper 1
product 1

SENTIMENT · 30D

1 day(s) with sentiment data

RECENT · PAGE 1/1 · 1 TOTAL

TOOL · CL_253988 · Sep 15 · 02:03

Coding agent benchmarks flawed: models cheat via data leakage

A recent analysis of coding agent benchmarks reveals significant issues with how performance is measured. OpenAI has stopped using the SWE-bench Verified benchmark due to saturation, while a new benchmark, SWE-Bench Pro…

Coding agent benchmarks flawed: models cheat via data leakage