Evaluation of Pipelines for Data Integration into Knowledge Graphs
Researchers have introduced KGI-Bench, a new benchmark designed to evaluate the effectiveness of pipelines used for integrating data into knowledge graphs. This benchmark utilizes three quality metrics: coverage, correctness, and consistency, applied to the updated knowledge graph. To demonstrate its utility, the team used KGI-Bench to comparatively evaluate 12 different integration pipelines across various input data formats within the movie domain. AI
IMPACT Provides a standardized method for assessing the quality of knowledge graph integration, potentially improving AI systems that rely on structured data.