PulseAugur
EN
LIVE 20:10:27

Replit launches ViBench 2.0 for AI long-horizon software building · 2 sources tracked

By PulseAugur Editorial · [2 sources] ·

Replit has launched ViBench 2.0, a new benchmark designed to evaluate AI agents on long-horizon software development tasks. The benchmark simulates building real-world products like Uber or GitHub, with agents tasked to construct 17 different products comprising 241 features. Initial results show that even leading models such as GPT-6.1 Sol, GPT-6 Astra, and Opus 5.5 achieve success rates between 49% and 65% in completing these builds. AI

IMPACT Sets a new standard for evaluating AI agents in complex, multi-step software development tasks.

RANK_REASON The release of a new benchmark for evaluating AI capabilities in software development.

Read on X — Replit (AI dev platform) →

AI-generated summary · Google Gemini · from 2 sources. How we write summaries →

Replit launches ViBench 2.0 for AI long-horizon software building · 2 sources tracked

How we ranked this

Signal score
0 / 100
Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket
Research
The release of a new benchmark for evaluating AI capabilities in software development.
Source corroboration
2 independent sources
Multiple independent publishers reporting the same story raises confidence that it's real and newsworthy.
Topics
product, model release
Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance
High
Clearly on-topic for AI-industry coverage.
Story freshness
5 days old
Aged out of breaking-news scoring windows; ranking reflects the durable signal from the full source set.

Full methodology in our editorial standards.

COVERAGE [2]

  1. X — Replit (AI dev platform) TIER_1 English(EN) · Replit ·

    Each of ViBench 2.0's 17 products is modeled on a real one, like Uber, GitHub, or Google Docs. 241 features to build. 544 test plans in all.

    Each of ViBench 2.0's 17 products is modeled on a real one, like Uber, GitHub, or Google Docs. 241 features to build. 544 test plans in all. A grading agent opens up each finished product in a browser and runs each of its test plans step by step. 8 products and the full harness

  2. X — Replit (AI dev platform) TIER_1 English(EN) · Replit ·

    Today we're releasing ViBench 2.0, a benchmark for long-horizon software building. Agents start from an empty project and build a whole product, one feature at

    Today we're releasing ViBench 2.0, a benchmark for long-horizon software building. Agents start from an empty project and build a whole product, one feature at a time, without seeing what comes next. Even the best models (GPT-6.1 Sol, GPT-6 Astra, Opus 5.5) pass every check in h…

RELATED ENTITIES

RELATED TOPICS