PulseAugur
EN
LIVE 16:47:53

Mistral Small struggles with function calling, leading to high costs and retries

By PulseAugur Editorial · [1 sources] ·

Mistral Small, a model priced at $0.15 per million input tokens, demonstrated a significant issue with function calling, returning empty replies for 19.3% of tasks even after multiple retries. This resulted in a higher cost per successful task ($0.000098) compared to GPT-6 Luna ($0.000051), which passed 93.0% of tasks without retries. The analysis revealed that Mistral Small's retries accounted for 23.9% of its spending, and at least three in four of these retries remained unreadable, indicating a specific behavioral problem with this model rather than a general difficulty with function calling for cheaper models. AI

IMPACT Highlights potential reliability and cost issues with specific LLMs for function-calling tasks, impacting developer choices.

RANK_REASON Analysis of a specific model's performance on a particular task (function calling) and its cost implications.

Read on dev.to — LLM tag →

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →

Mistral Small struggles with function calling, leading to high costs and retries

How we ranked this

Signal score
5 / 100
Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket
Tool
Analysis of a specific model's performance on a particular task (function calling) and its cost implications.
Source corroboration
Single-source cluster
Only one publisher covered this so far. Single-source stories can still rank when the publisher is high-authority, but they lack cross-source corroboration.
Topics
model release, product
Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance
High
Clearly on-topic for AI-industry coverage.
Story freshness
Same-day
Cluster formed today. Ranking reflects the current source set at time of score.

Full methodology in our editorial standards.

COVERAGE [1]

  1. dev.to — LLM tag TIER_1 English(EN) · Grain64 ·

    Mistral Small: 58 empty replies in 300 tool calls, and the retry loop

    <p>On 300 public function-calling tasks, Mistral Small (2603) returned an empty reply 58 times, even after two retries. That is 19.3% of tasks with nothing to parse, and it is why a model priced at $0.15 per million input tokens ended up at $0.000098 per successful task against $…

RELATED ENTITIES

RELATED TOPICS