ChatGPT struggles with consistent carb estimates, showing AI unreliability

By PulseAugur Editorial · [1 sources] · 2026-05-03 02:28

A user found that ChatGPT provided significantly different carb estimates for the same lunch photo when asked repeatedly. Across 500 queries, the AI's responses varied widely, indicating a lack of consistent output for a critical task. This inconsistency raises concerns about the reliability of AI in applications where precise and stable answers are necessary, such as dietary management. AI

IMPACT Highlights potential unreliability of LLMs for precise, repeated tasks, impacting user trust in AI-driven recommendations.

RANK_REASON User-generated report of inconsistent AI output in a specific application.

Read on Mastodon — sigmoid.social →

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →

COVERAGE [1]

Mastodon — sigmoid.social TIER_1 English(EN) · [email protected] · 2026-05-03 02:28

"Ask ChatGPT to estimate the carbs in your lunch. Now ask it again. And again. Five hundred times." "You'd expect the same answer each time. It's the same photo

"Ask ChatGPT to estimate the carbs in your lunch. Now ask it again. And again. Five hundred times." "You'd expect the same answer each time. It's the same photo, the same model, the same question. But you won't get the same answer. Not even close -- and the differences are large …

COVERAGE [1]

"Ask ChatGPT to estimate the carbs in your lunch. Now ask it again. And again. Five hundred times." "You'd expect the same answer each time. It's the same photo

RELATED ENTITIES

RELATED TOPICS