Researchers have developed a new benchmark and an agentic architecture for natural-language-to-SQL systems designed to handle complex, nested enterprise schemas. The DevRev NL2SQL benchmark includes 900 execution-verified queries and a Semantic Depth Score (SDS) to evaluate analytical reasoning. The proposed cost-aware architecture achieved 91.7% answer correctness on this new benchmark, significantly outperforming existing baselines, and demonstrated competitive performance on the Spider 2.0 Snowflake dataset. AI
IMPACT This research could improve how businesses query complex, nested data using natural language, potentially streamlining data analysis and access.
RANK_REASON The cluster contains a research paper detailing a new benchmark and an associated system for natural-language-to-SQL tasks. [lever_c_demoted from research: ic=1 ai=1.0]
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →