AI models like GPT-4, Claude 3, and Gemini are incurring a hidden 'token tax' where users are billed for a significant number of tokens before they even begin interacting with the AI. This occurs because the AI client rebuilds the complete list of installed tools for each new session. This practice, which can amount to 70,000 tokens per session, is a concern for users and impacts the perceived cost and efficiency of using these advanced AI systems. AI
IMPACT Users may face unexpectedly high costs due to hidden token charges before interaction, impacting the perceived value and efficiency of AI tools.
RANK_REASON The item discusses a perceived issue with AI model billing and token usage, rather than a new release or significant industry event.
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →