XSum dataset
PulseAugur coverage of XSum dataset — every cluster mentioning XSum dataset across labs, papers, and developer communities, ranked by signal.
2 day(s) with sentiment data
-
Research paper proposes synthetic data verification to prevent model collapse
A new research paper explores the phenomenon of "model collapse," where generative models trained on their own synthetic data degrade in performance over time. The study proposes that incorporating an external synthetic…
-
New metrics proposed for abstractiveness in text summarization · 2 sources tracked
Researchers have introduced new metrics—Reference Abstraction (RA), Summary Abstraction (SA), and Abstraction Ratio (AR)—to better evaluate the abstractiveness of text summarization models. These metrics aim to quantify…
-
New SenFlow method improves AI-generated text detection in hybrid documents · 2 sources tracked
Researchers have developed SenFlow, a novel method for detecting AI-generated text in documents co-authored by humans and AI. Unlike previous approaches that analyze sentences in isolation, SenFlow models inter-sentence…
-
New benchmark reveals LLMs exhibit significant framing bias in news summaries
Researchers have developed a new benchmark called Frame In, Frame Out (FIFO) to measure framing bias in news summaries generated by large language models. The benchmark, which includes over 15,000 jury-annotated example…
-
Eugene Yan shares insights on LLM system building and AI engineering trends
Eugene Yan presented key learnings from building with Large Language Models (LLMs) at the AI Engineer World's Fair 2024. The keynote, co-authored with others, focused on practical aspects of LLM system development, incl…
-
Eugene Yan explores challenges in evaluating abstractive summaries and detecting hallucinations
Evaluating abstractive summarization, which involves rephrasing source material rather than copying sentences, presents challenges, particularly in assessing relevance and factual consistency. While fluency and coherenc…