Researchers have introduced Build2SPARQL, a large-scale benchmark dataset designed to improve the translation of natural language questions into SPARQL queries for building automation knowledge graphs. The dataset addresses the scarcity of such benchmarks by generating executable SPARQL queries through a graph-traversal code pipeline, ensuring correctness independently of language model behavior. Natural language questions are then generated by large language models, achieving high semantic fidelity and naturalness in human validation. This benchmark aims to enhance the capabilities of language agents in querying complex building knowledge graphs. AI
IMPACT This benchmark could significantly improve the ability of AI agents to query complex building knowledge graphs, enabling more sophisticated automation and control systems.
RANK_REASON The cluster describes a new benchmark dataset for a specific AI task, presented in an academic paper. [lever_c_demoted from research: ic=1 ai=1.0]
- ASHRAE 223P
- Brick
- Build2SPARQL
- Hugging Face
- knowledge graph
- Language agents
- large-language models
- SPARQL
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →