PulseAugur
EN
LIVE 23:09:42

Replit benchmarks AI models: GPT-6.1 Sol leads, Opus 5.5 faster, DeepSeek V4.1 Flash cost-effective · 5…

By PulseAugur Editorial · [5 sources] ·

Replit has released benchmark results for various AI models, revealing that newer models generally perform better. GPT-6.1 Sol and GPT-6 Astra lead in build completion rates, with GPT-6.1 Sol achieving 65% and GPT-6 Astra at 60%. Opus 5.5 also shows strong performance, completing builds faster than Sol, while DeepSeek V4.1 Flash demonstrates high pass rates for open-weight models at a lower cost. The benchmarks also highlight that models exhibit distinct 'house styles' in their output, with GPT models favoring illustrations and Claude models opting for plainer designs, though this stylistic difference did not correlate with performance. AI

IMPACT These benchmarks provide valuable insights into the performance and cost-effectiveness of various AI models, guiding developers in selecting the best tools for their applications.

RANK_REASON Benchmark results for AI models published by a platform.

Read on X — Replit (AI dev platform) →

AI-generated summary · Google Gemini · from 5 sources. How we write summaries →

Replit benchmarks AI models: GPT-6.1 Sol leads, Opus 5.5 faster, DeepSeek V4.1 Flash cost-effective · 5…

How we ranked this

Signal score
0 / 100
Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket
Research
Benchmark results for AI models published by a platform.
Source corroboration
5 independent sources
Strong cross-source corroboration — multiple independent publishers covered this within the clustering window.
Topics
model release, product
Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance
High
Clearly on-topic for AI-industry coverage.
Story freshness
13 days old
Aged out of breaking-news scoring windows; ranking reflects the durable signal from the full source set.

Full methodology in our editorial standards.

COVERAGE [5]

  1. X — Replit (AI dev platform) TIER_1 English(EN) · Replit ·

    The full leaderboard is on the SII: https://t.co/NNvTef9pMC.

    The full leaderboard is on the SII: https://t.co/NNvTef9pMC. The latest results are at https://t.co/CADjeX2ZlM, and our blog covers the method and findings: https://t.co/42LOenQJio

  2. X — Replit (AI dev platform) TIER_1 English(EN) · Replit ·

    Each model family has a house style.

    Each model family has a house style. The specs describe what a product does, not how it looks, so models fall back on their own taste: ▪️ GPT models reach for illustrations and big headlines. ▪️ Claude models build plainer screens. To our eyes, the best-looking builds were no h…

  3. X — Replit (AI dev platform) TIER_1 English(EN) · Replit ·

    Every feature works on its own. Together, they break.

    Every feature works on its own. Together, they break. ~3/4 of the top models' failed builds pass every single-feature check. They break where features meet: ▪️ Code hosting: a draft PR never shows its merge conflict. ▪️ Document editor: nobody can comment on a word inside a

  4. X — Replit (AI dev platform) TIER_1 English(EN) · Replit ·

    Newer models score higher.

    Newer models score higher. On the 8 public products, pass@1 goes from 0% for GPT-5.4 to 31% for GPT-6 Sol and 53% for GPT-6.1 Sol. GPT-6.1 Terra passes 47% at about half Sol's cost. https://t.co/H4YDmqfro3

  5. X — Replit (AI dev platform) TIER_1 English(EN) · Replit ·

    Three models pass more than 40% of their builds. No other model passes 20%.

    Three models pass more than 40% of their builds. No other model passes 20%. ▪️ GPT-6.1 Sol (65%) edges out GPT-6 Astra (60%) at ~$12 per build vs ~$90. ▪️ Opus 5.5 (49%) finishes a build in ~70 minutes, about 2.5× faster than Sol, mostly due to API provider speed. ▪️ Open https:…

RELATED ENTITIES

RELATED TOPICS