PulseAugur
EN
LIVE 20:21:53
ENTITY Fleiss' kappa

Fleiss' kappa

PulseAugur coverage of Fleiss' kappa — every cluster mentioning Fleiss' kappa across labs, papers, and developer communities, ranked by signal.

Show in brief
Total · 30d
4
9 over 90d
Releases · 30d
0
0 over 90d
Papers · 30d
4
9 over 90d
TIER MIX · 90D
TOPICS
SENTIMENT · 30D

3 day(s) with sentiment data

RECENT · PAGE 1/1 · 9 TOTAL
  1. TOOL · CL_327109 ·

    New framework MLA enhances inter-annotator reliability for multi-label tasks

    Researchers have introduced Multi-Label Agreement (MLA), a new framework designed to improve the evaluation of inter-annotator reliability in multi-label annotation tasks. Unlike existing metrics that are primarily for …

  2. TOOL · CL_335433 ·

    New framework Multi-Label Agreement enhances inter-annotator reliability analysis

    Researchers have introduced Multi-Label Agreement (MLA), a new framework designed to evaluate inter-annotator reliability in multi-label annotation tasks. Unlike existing metrics that are primarily for single-label sett…

  3. TOOL · CL_321924 ·

    New benchmark ANT-A and framework ANT-OR improve LLM annotation consistency

    Researchers have introduced the ANT-A Benchmark to address limitations in current LLM annotation benchmarks, which often fail to account for the nuanced and sometimes divergent judgments of human annotators. This new be…

  4. TOOL · CL_286849 ·

    Humans and LLMs struggle with social media sentiment analysis, study finds

    A new study published on arXiv evaluates the performance of sentiment analysis tools and large language models (LLMs) on social media texts. The research found that even human annotators exhibit only fair agreement when…

  5. TOOL · CL_259279 ·

    Word sense disambiguation bottlenecked by labels, not models, study finds

    A new paper on English word sense disambiguation (WSD) highlights that current frontier LLMs are so accurate that the quality of the training labels has become the primary bottleneck for benchmark performance. The resea…

  6. TOOL · CL_228747 ·

    New VFR-Audit framework enhances reliability of AI fairness audits

    Researchers have introduced VFR-Audit, a new framework designed to assess the reliability of fairness audits in clinical AI applications, specifically for predicting hospital length-of-stay. This framework focuses on th…

  7. TOOL · CL_185386 ·

    New benchmark evaluates LLMs' ability to find errors in synthetic math data

    Researchers have introduced MathDebugger, a new benchmark designed to evaluate the ability of large language models to detect and diagnose errors within synthetic mathematical data. The benchmark includes a dataset of c…

  8. RESEARCH · CL_139208 ·

    Small language models show creativity, honesty, and designed forgetting

    Researchers have demonstrated that small language models, specifically those with 146 million to 3 billion parameters, can exhibit creativity, honesty, and designed forgetting. These models, built on a hyperbolic substr…

  9. RESEARCH · CL_133121 ·

    SynthAVE uses LLM arena for scalable e-commerce data labeling · 2 sources tracked

    Researchers have developed SynthAVE, a novel system for generating and validating synthetic labels for e-commerce attribute extraction at an industrial scale. This approach addresses the prohibitive cost of human labeli…