A new study, LLM4SDM, investigates the use of open-source smaller language models (OS-sLLMs) for assessing shared decision-making (SDM) in clinical consultations. Unlike previous research that utilized large commercial models, this study focuses on privacy-preserving, locally deployable models and Dutch melanoma consultation transcripts. The findings indicate that general-domain OS-sLLMs performed better than medical-domain models, with Gemma3:12b showing the strongest agreement with human annotations. While current OS-sLLMs are not yet capable of replacing human annotators, they present a viable foundation for privacy-preserving, human-in-the-loop SDM assessment. AI
IMPACT These OS-sLLMs offer a promising avenue for privacy-preserving, human-in-the-loop assessment of shared decision-making in clinical settings.
RANK_REASON The cluster describes a research paper published on arXiv detailing an investigation into the capabilities of open-source smaller language models.
AI-generated summary · Google Gemini · from 2 sources. How we write summaries →