PulseAugur
LIVE 14:08:56
research · [1 source] ·
0
research

LLMs outperform mental health pros in diagnosing personality disorders from text

A new study evaluated large language models, specifically Gemini Pro, against mental health professionals in diagnosing personality disorders from autobiographical narratives. While the LLMs demonstrated higher overall diagnostic scores, particularly for Borderline Personality Disorder, they significantly underdiagnosed Narcissistic Personality Disorder. The models provided detailed, pattern-focused justifications, contrasting with the human experts' more concise and patient-centered approach, highlighting potential biases and reliability concerns in LLM clinical assessments. AI

Summary written by gemini-2.5-flash-lite from 1 source. How we write summaries →

IMPACT LLMs show potential in clinical narrative analysis but require careful validation due to bias and reliability issues.

RANK_REASON Academic paper evaluating LLM performance against human experts on a specific clinical task.

Read on arXiv cs.CL →

COVERAGE [1]

  1. arXiv cs.CL TIER_1 · Karolina Dro\.zd\.z, Kacper Dudzic, Anna Sterna, Marcin Moskalewicz ·

    Patterns vs. Patients: Evaluating LLMs against Mental Health Professionals on Personality Disorder Diagnosis through First-Person Narratives

    arXiv:2512.20298v2 Announce Type: replace Abstract: Growing reliance on LLMs for psychiatric self-assessment raises questions about their ability to interpret qualitative patient narratives. This depth-first case study provides the first direct comparison of state-of-the-art LLMs…