PulseAugur
EN
LIVE 09:18:25

AI token costs lack transparency and are difficult to verify

The concept of AI tokens is fundamentally flawed, as their definition and cost are inconsistent across different Large Language Models (LLMs) and depend on factors like caching. This lack of transparency makes it difficult for users to verify billing, leading to a situation where customers cannot effectively contest the costs they incur. AI

IMPACT Lack of clear token definitions and cost verification hinders user trust and potentially inflates AI service expenses.

RANK_REASON The item is an opinion piece discussing the nature of AI tokens and their associated costs.

Read on Mastodon — fosstodon.org →

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →

AI token costs lack transparency and are difficult to verify

COVERAGE [1]

  1. Mastodon — fosstodon.org TIER_1 English(EN) · [email protected] ·

    The notion of AI tokens is really all wrong if we think about it : it's not clear what a token is, it depends on the LLM, the costs vary on time schedule, cache

    The notion of AI tokens is really all wrong if we think about it : it's not clear what a token is, it depends on the LLM, the costs vary on time schedule, cache miss, cache hit. In the end, I don't think anybody can contest the bill they get because we just don't have the tools t…