New framework EiCAP probes and improves LLM emotional intelligence

Researchers have developed EiCAP, a new framework to assess and enhance the emotional intelligence (EI) of large language models (LLMs). The framework includes EiCAP-Bench, a 3,174-probe evaluation suite, and EiCAP-SFT, a large corpus for supervised fine-tuning. Experiments show that standard conversational fine-tuning does not improve EI, but targeted EI-grounded LoRA training on Qwen-2.5-7B-Base significantly boosts performance across all EI subcategories. AI

IMPACT This research provides a method to imbue LLMs with emotional intelligence, crucial for sensitive applications like mental health support.

RANK_REASON The cluster describes a new academic paper introducing a novel framework and benchmark for evaluating LLM emotional intelligence. [lever_c_demoted from research: ic=1 ai=1.0]

Read on arXiv cs.CL →

• EiCAP-Bench
• EiCAP-SFT
• LLMs
• Qwen-2.5-7B-Base
• UltraChat

• paper
• model release

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →