PulseAugur
EN
LIVE 07:40:48

LLMs outperform mental health pros in diagnosing personality disorders from text

A new study evaluated large language models, specifically Gemini Pro, against mental health professionals in diagnosing personality disorders from autobiographical narratives. While the LLMs demonstrated higher overall diagnostic scores, particularly for Borderline Personality Disorder, they significantly underdiagnosed Narcissistic Personality Disorder. The models provided detailed, pattern-focused justifications, contrasting with the human experts' more concise and patient-centered approach, highlighting potential biases and reliability concerns in LLM clinical assessments. AI

IMPACT LLMs show potential in clinical narrative analysis but require careful validation due to bias and reliability issues.

RANK_REASON Academic paper evaluating LLM performance against human experts on a specific clinical task.

Read on arXiv cs.CL →

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →

LLMs outperform mental health pros in diagnosing personality disorders from text

COVERAGE [1]

  1. arXiv cs.CL TIER_1 English(EN) · Karolina Dro\.zd\.z, Kacper Dudzic, Anna Sterna, Marcin Moskalewicz ·

    Patterns vs. Patients: Evaluating LLMs against Mental Health Professionals on Personality Disorder Diagnosis through First-Person Narratives

    arXiv:2512.20298v2 Announce Type: replace Abstract: Growing reliance on LLMs for psychiatric self-assessment raises questions about their ability to interpret qualitative patient narratives. This depth-first case study provides the first direct comparison of state-of-the-art LLMs…