PulseAugur
EN
LIVE 18:43:38

Grok-4.7's web search citations differ from other LLMs

A recent evaluation of xAI's Grok-4.7 model revealed discrepancies in how it handles web search results and citations. When using the web_search API, Grok-4.7 returned 1,656 URL annotations, but none of these were inline citations pointing to specific parts of the answer text. Instead, these URLs represented the model's entire reading list, including pages it deemed irrelevant. The study compared Grok-4.7's responses to those from ChatGPT, Claude, Gemini, and Perplexity across 24 software-buying questions, highlighting potential pitfalls in evaluating LLM answers that incorporate web search. AI

IMPACT Highlights potential issues in evaluating LLM responses that use web search, impacting how users and developers interpret AI-generated information.

RANK_REASON Analysis of an LLM's output format and citation handling. [lever_c_demoted from research: ic=1 ai=1.0]

Read on Towards AI →

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →

Grok-4.7's web search citations differ from other LLMs

How we ranked this

Signal score
28 / 100
Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket
Tool
Analysis of an LLM's output format and citation handling. [lever_c_demoted from research: ic=1 ai=1.0]
Source corroboration
Single-source cluster
Only one publisher covered this so far. Single-source stories can still rank when the publisher is high-authority, but they lack cross-source corroboration.
Topics
product, other
Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance
High
Clearly on-topic for AI-industry coverage.
Story freshness
Breaking (< 6h)
Fresh story with cross-source coverage still developing. Ranking may shift as more sources report.

Full methodology in our editorial standards.

COVERAGE [1]

  1. Towards AI TIER_1 English(EN) · WhiskeyJack ·

    1,656 Sources, 0 Inline Citations: What Grok’s web_search API Returns, and How to Count It

    <blockquote><em>Disclosure: this article was written with the help of AI tools. The data collection, numbers and conclusions were checked by the Mention Impossible team against the raw API logs.</em></blockquote><p><em>A single-run evaluation of grok-4.7 on 24 questions, compared…