Researchers have developed CLIN, a new framework to objectively evaluate creativity in short Persian literary texts generated by large language models. The study found that LLMs struggle with subjective creativity dimensions like emotion and attractiveness, showing better alignment with structured properties such as originality and fluency. CLIN utilizes proxy metrics for these dimensions, achieving human-level agreement with lower computational cost compared to direct LLM evaluation. AI
IMPACT This research offers a more efficient and objective method for evaluating creative text generation by LLMs, particularly for low-resource languages.
RANK_REASON The cluster describes a new research paper introducing a framework for evaluating creativity in LLM outputs.
Read on Hugging Face Daily Papers →
- arXiv
- Attractiveness
- Elaboration
- Emotion
- Fluency
- Hugging Face
- Mohammad-Reza Modarresi Yazdi
- Originality
- Persian
- Torrance Tests of Creative Thinking
- large language model
AI-generated summary · Google Gemini · from 2 sources. How we write summaries →