SAG: SQL-Retrieval Augmented Generation with Query-Time Dynamic Hyperedges
A new paper introduces SAG (SQL-Retrieval Augmented Generation), an architecture designed to enhance large language models' ability to access external knowledge. Unlike traditional RAG methods that rely on dense similarity retrieval, SAG uses SQL join queries to dynamically link related data chunks into local hyperedges at query time. This approach avoids the need for pre-built, static knowledge graphs and supports incremental updates and scaling. The system has demonstrated state-of-the-art performance on multi-hop reasoning benchmarks like HotpotQA, 2WikiMultiHopQA, and MuSiQue, and has been deployed at a production scale with low retrieval latency. AI
IMPACT SAG's dynamic SQL-based approach could improve LLM reasoning over structured data and reduce maintenance overhead for knowledge retrieval systems.