The Schemagate text-to-SQL system has achieved a 63.7% first-try success rate on Oracle databases, significantly outperforming previous benchmarks. This improvement is attributed to specific prompt engineering techniques, including handling Oracle's alias and reserved word conventions, and correctly formatting table names. The system's performance was evaluated on the UniQL dataset, with results showing a notable advantage over models like Claude-4.5-Sonnet, which previously held the best published Oracle score at 49.61%. AI
IMPACT Improves text-to-SQL accuracy on challenging database systems like Oracle, potentially enhancing data analysis capabilities.
RANK_REASON New benchmark results for a text-to-SQL system on a specific database dialect. [lever_c_demoted from research: ic=1 ai=1.0]
- BIRD
- Claude-4.5-Sonnet
- Gemini 3.8 Flash
- LangChain
- langgraph
- MySQL
- November 12
- oracle
- PostgreSQL
- schemagate
- SQLite
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →