PulseAugur
EN
LIVE 11:26:23

New framework CONSISTRE improves LLM relation extraction consistency

Researchers have developed CONSISTRE, a new framework designed to improve document-level relation extraction (DocRE) using large language models (LLMs). The framework addresses the issue of LLMs producing inconsistent or contradictory predictions by incorporating consistency checks. CONSISTRE offers two approaches: one for black-box LLMs that refines predictions through prompting and self-reflection, and another for open-source models that uses knowledge distillation and reinforcement learning to inject consistency knowledge. Experiments on the DocRED dataset demonstrate that both methods enhance the reliability of relation extraction. AI

IMPACT Enhances the reliability of LLM-based relation extraction, potentially improving information retrieval and knowledge graph construction.

RANK_REASON The cluster describes a new framework and methodology presented in an academic paper.

Read on Hugging Face Daily Papers →

AI-generated summary · Google Gemini · from 2 sources. How we write summaries →

New framework CONSISTRE improves LLM relation extraction consistency

COVERAGE [2]

  1. arXiv cs.CL TIER_1 English(EN) · Mingxuan Sun ·

    CONSISTRE: A Unified Consistency-Aware Framework for Document-Level Relation Extraction with Large Language Models

    arXiv:2607.24312v1 Announce Type: new Abstract: Document-level relation extraction (DocRE) aims to extract relations among multiple entities across extended contexts while maintaining consistency across predicted triples. Although large language models (LLMs) show remarkable reas…

  2. Hugging Face Daily Papers TIER_1 English(EN) ·

    CONSISTRE: A Unified Consistency-Aware Framework for Document-Level Relation Extraction with Large Language Models

    Document-level relation extraction (DocRE) aims to extract relations among multiple entities across extended contexts while maintaining consistency across predicted triples. Although large language models (LLMs) show remarkable reasoning capabilities in information extraction, th…