General LLMs outperform specialized AI in medical knowledge, study finds

A recent study published in Nature Medicine found that general-purpose large language models like Gemini 3.1 Pro, GPT-5.2, and Claude Opus 4.6 outperformed specialized physician-facing AI tools in medical knowledge questions and clinical scenarios. These widely available LLMs, costing $20 per month or less, achieved higher scores than tools costing up to $600 annually. The findings suggest a shift for healthcare AI entrepreneurs, moving away from expensive, doctor-specific tools towards leveraging accessible LLMs for broader patient use and health management. AI

IMPACT Suggests a shift in healthcare AI development towards more accessible, patient-focused LLM applications rather than expensive, physician-specific tools.

RANK_REASON Study published in Nature Medicine comparing AI tools. [lever_c_demoted from research: ic=1 ai=1.0]

Read on Forbes — Innovation →

• ChatGPT
• Claude Opus 4.6
• Gemini 3.1 Pro
• GPT-5.2
• Microsoft
• Nature Medicine
• OpenAI
• OpenEvidence
• UpToDate Expert AI

• product
• other

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →