A user discovered that Anthropic's Haiku 5.5 model, when configured with "thinking off" via the API, was still engaging in reasoning. This was due to the output format prioritizing the clue over the reasoning field, causing the model to commit to a clue before its internal thought process could review it. Once the output format was adjusted to place the reasoning field first, Haiku 5.5's performance improved significantly in a word-association game, reducing illegal clues and increasing clue grades. In direct comparisons, Haiku 5.5 performed worse than GPT-6 Luna and Google's Gemini 4 Argon in clue-giving tasks. AI
IMPACT Highlights potential nuances in controlling LLM reasoning and the impact of output formatting on perceived performance.
RANK_REASON User-reported observation of model behavior, not an official release or benchmark.
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →