New Decan metric measures creative text diversity using language models

Researchers have introduced a new metric called Decan ($D_{Ca_n}$) to measure the diversity of creative text outputs. This method utilizes in-context learning from a single forward pass of a language model, eliminating the need for separate embedding models or reference corpora. Decan has shown promising results on benchmarks like McDiv, approaching the performance of established neural baselines, and has successfully detected diversity loss in different stages of AI model training. AI

IMPACT Provides a novel, efficient method for evaluating creative AI output diversity without external datasets.

RANK_REASON The cluster contains an academic paper detailing a new metric for evaluating AI-generated text diversity. [lever_c_demoted from research: ic=1 ai=1.0]

Read on arXiv cs.AI →

• D_{Ca_n}
• Decan
• OLMo-2-7B
• SentBERT

• paper
• model release

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →