PulseAugur
EN
LIVE 21:30:11

AI health chatbots provide inaccurate answers, study finds

By PulseAugur Editorial · [1 sources] ·

A recent study found that half of the health-related answers provided by major AI chatbots are inaccurate, despite sounding convincing. Experts reviewed answers from models like ChatGPT, Gemini, Grok, MetaAI, and DeepSeek to 50 medical questions. The analysis revealed that nearly 20% of the responses were highly problematic, with no chatbot consistently providing accurate references. AI

IMPACT AI chatbots provide inaccurate health information, highlighting risks for users seeking medical advice.

RANK_REASON The cluster reports on a study evaluating the accuracy of AI models on health-related questions. [lever_c_demoted from research: ic=1 ai=1.0]

Read on Mastodon — fosstodon.org →

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →

AI health chatbots provide inaccurate answers, study finds

How we ranked this

Signal score
0 / 100
Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket
Tool
The cluster reports on a study evaluating the accuracy of AI models on health-related questions. [lever_c_demoted from research: ic=1 ai=1.0]
Source corroboration
Single-source cluster
Only one publisher covered this so far. Single-source stories can still rank when the publisher is high-authority, but they lack cross-source corroboration.
Topics
safety, paper
Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance
High
Clearly on-topic for AI-industry coverage.
Story freshness
122 days old
Aged out of breaking-news scoring windows; ranking reflects the durable signal from the full source set.

Full methodology in our editorial standards.

COVERAGE [1]

  1. Mastodon — fosstodon.org TIER_1 English(EN) · [email protected] ·

    Half of # AI # health answers are wrong even though they sound convincing # Chatbots , # ChatGPT , # Gemini , # Grok , # MetaAI and # DeepSeek , asked 50 health

    Half of # AI # health answers are wrong even though they sound convincing # Chatbots , # ChatGPT , # Gemini , # Grok , # MetaAI and # DeepSeek , asked 50 health and # medical questions spanning cancer, vaccines, stem cells, and nutrition. Two experts rated every answer. Nearly 20…

    LINKS theconversation.com/half-of-ai-health-ans…

RELATED ENTITIES

RELATED TOPICS