PulseAugur
EN
LIVE 05:56:46

AI Summarization Factuality Enhanced by Consensus and Preference Learning

By PulseAugur Editorial · [3 sources] ·

Two new research papers propose methods to improve the factuality of AI-generated summaries. The first paper, "Enhancing Factuality through Consensus and Consistency in Summarization Using Minimum Bayes Risk Decoding," introduces a system called ConSUM that reranks candidate summaries based on their consistency with the source document and consensus among other generated summaries. The second paper, "Optimising Factual Consistency in Summarisation via Preference Learning from Multiple Imperfect Metrics," details an automated training pipeline that aggregates scores from multiple weak factuality metrics to improve consistency, demonstrating gains across various language models. AI

IMPACT These research papers explore novel techniques to enhance the accuracy of AI-generated summaries, potentially leading to more reliable information extraction and synthesis tools.

RANK_REASON Two academic papers published on arXiv detailing new methods for improving AI summarization factuality.

Read on arXiv cs.CL →

AI-generated summary · Google Gemini · from 3 sources. How we write summaries →

AI Summarization Factuality Enhanced by Consensus and Preference Learning

COVERAGE [3]

  1. arXiv cs.CL TIER_1 English(EN) · Riza Setiawan Soetedjo, Yusuke Sakai, Hidetaka Kamigaito, Jingun Kwon, Manabu Okumura, Taro Watanabe ·

    Enhancing Factuality through Consensus and Consistency in Summarization Using Minimum Bayes Risk Decoding

    arXiv:2605.29336v1 Announce Type: new Abstract: Improving the quality of model-generated summaries, especially factuality, the accuracy of a summary with respect to its source content, remains a challenge. While reranking could select the optimal output from multiple generated ca…

  2. arXiv cs.CL TIER_1 English(EN) · Yuxuan Ye, Raul Santos-Rodriguez, Edwin Simpson ·

    Optimising Factual Consistency in Summarisation via Preference Learning from Multiple Imperfect Metrics

    arXiv:2605.26840v1 Announce Type: new Abstract: Reinforcement learning with evaluation metrics as rewards is widely used to enhance specific capabilities of language models. However, for tasks such as factually consistent summarisation, existing metrics remain underdeveloped, lim…

  3. arXiv cs.CL TIER_1 English(EN) · Edwin Simpson ·

    Optimising Factual Consistency in Summarisation via Preference Learning from Multiple Imperfect Metrics

    Reinforcement learning with evaluation metrics as rewards is widely used to enhance specific capabilities of language models. However, for tasks such as factually consistent summarisation, existing metrics remain underdeveloped, limiting their effectiveness as signals for shaping…

RELATED ENTITIES

RELATED TOPICS