Knowledge Distillation for Low-Resource Open-source Text-to-SQL Model
Researchers have developed a new knowledge-aware framework to improve Text-to-SQL models, particularly in low-resource environments. This approach constructs a task-specific knowledge base encompassing schema semantics, business logic, and query patterns. By injecting this knowledge into both training and inference, the framework generates diverse synthetic data and enhances model performance, demonstrating significant improvements across seven benchmarks for both open-source and closed-source large language models. AI
IMPACT Enhances the capability of AI models to interact with structured data, making database access more accessible in resource-constrained scenarios.