A single text prompt processed by ChatGPT consumes approximately 0.42 watt-hours of energy. The platform handles around 2.5 billion prompts daily, equating to an annual energy expenditure of 383 gigawatt-hours for this single product. This calculation highlights the significant ongoing inference costs associated with large language models, in addition to their initial training expenses. AI
IMPACT Highlights the substantial ongoing energy costs of AI inference, separate from training expenses.
RANK_REASON Article discusses the energy cost of AI inference, not a new release or significant industry event.
Read on Mastodon — fosstodon.org →
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →