PulseAugur
EN
LIVE 23:04:22

ChatGPT, Gemini, and Claude tested on new features; ChatGPT misses 16

A recent test revealed significant discrepancies in how three major AI models, ChatGPT, Gemini, and Claude, handle questions about recently released features. Out of 40 questions about features introduced between November 2025 and November 2026, ChatGPT incorrectly stated that 16 features did not exist, Gemini incorrectly answered 4, and Claude answered all correctly. The study suggests that ChatGPT, in its default mode, often relies on memory which can be outdated, while Gemini and Claude are more likely to search the web for current information. The findings highlight the challenge AI models face in keeping up with rapid feature updates and advise users to verify AI responses about new features. AI

IMPACT Highlights the challenge AI models face in staying current with rapidly evolving features, impacting user trust and the reliability of AI-generated information.

RANK_REASON The item is a commentary on the performance of AI models in a specific test scenario, rather than a direct release or significant industry event.

Read on dev.to — LLM tag →

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →

ChatGPT, Gemini, and Claude tested on new features; ChatGPT misses 16

How we ranked this

Signal score
10 / 100
Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket
Commentary
The item is a commentary on the performance of AI models in a specific test scenario, rather than a direct release or significant industry event.
Source corroboration
Single-source cluster
Only one publisher covered this so far. Single-source stories can still rank when the publisher is high-authority, but they lack cross-source corroboration.
Topics
product, other
Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance
High
Clearly on-topic for AI-industry coverage.
Story freshness
Breaking (< 6h)
Fresh story with cross-source coverage still developing. Ranking may shift as more sources report.

Full methodology in our editorial standards.

COVERAGE [1]

  1. dev.to — LLM tag TIER_1 English(EN) · Regga ·

    We asked three AIs about 40 new features. One said 16 of them don't exist.

    <p><em>A small test of ChatGPT, Gemini and Claude, and what to do when your AI tells you no.</em></p> <p>You ask an AI whether your phone can do something. It says no, with confidence. Most of us stop there. We wanted to know how often that no is simply out of date.</p> <h2> What…