PulseAugur
EN
LIVE 10:05:34

VIDRAFT's NL2SQL Engine Outperforms BIRD Mini-Dev Benchmark

By PulseAugur Editorial · [1 sources] ·

VIDRAFT's Darwin-180B-NL2SQL system has achieved a score of 83.80% on the BIRD Mini-Dev benchmark, surpassing the current top-ranked entry. This text-to-SQL engine, utilizing the Darwin-180B-RSI model without fine-tuning or gold SQL during prediction, demonstrated its capabilities on a challenging dataset of real-world databases. VIDRAFT has also launched a public demo of the engine, which can translate natural language questions into SQL queries and generate reports across various data sources. AI

IMPACT Sets a new high score on a challenging text-to-SQL benchmark, potentially influencing future development in natural language querying of databases.

RANK_REASON Research milestone on a text-to-SQL benchmark with a public demo. [lever_c_demoted from research: ic=1 ai=1.0]

Read on dev.to — LLM tag →

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →

VIDRAFT's NL2SQL Engine Outperforms BIRD Mini-Dev Benchmark

How we ranked this

Signal score
33 / 100
Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket
Tool
Research milestone on a text-to-SQL benchmark with a public demo. [lever_c_demoted from research: ic=1 ai=1.0]
Source corroboration
Single-source cluster
Only one publisher covered this so far. Single-source stories can still rank when the publisher is high-authority, but they lack cross-source corroboration.
Topics
model release, product
Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance
High
Clearly on-topic for AI-industry coverage.
Story freshness
Breaking (< 6h)
Fresh story with cross-source coverage still developing. Ranking may shift as more sources report.

Full methodology in our editorial standards.

COVERAGE [1]

  1. dev.to — LLM tag TIER_1 English(EN) · AI OpenFree ·

    VIDRAFT NL2SQL Engine Scores 83.80 on BIRD Mini-Dev, Above the Current #1, and Opens a Public Demo

    <h2> TL;DR </h2> <p>VIDRAFT's text-to-SQL system, <strong>Darwin-180B-NL2SQL</strong>, scored <strong>83.80% execution accuracy (419 of 500)</strong> on <strong>BIRD Mini-Dev (SQLite)</strong>, the official compact leaderboard of BIRD, the most cited text-to-SQL benchmark. The cu…

RELATED ENTITIES

RELATED TOPICS