PulseAugur
EN
LIVE 08:46:48

ChatGPT prompt processing consumes 383 GWh annually

A single text prompt processed by ChatGPT consumes approximately 0.42 watt-hours of energy. The platform handles around 2.5 billion prompts daily, equating to an annual energy expenditure of 383 gigawatt-hours for this single product. This calculation highlights the significant ongoing inference costs associated with large language models, in addition to their initial training expenses. AI

IMPACT Highlights the substantial ongoing energy costs of AI inference, separate from training expenses.

RANK_REASON Article discusses the energy cost of AI inference, not a new release or significant industry event.

Read on Mastodon — fosstodon.org →

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →

ChatGPT prompt processing consumes 383 GWh annually

COVERAGE [1]

  1. Mastodon — fosstodon.org TIER_1 English(EN) · [email protected] ·

    One text prompt takes about 0.42 watt hours. ChatGPT handles close to 2.5 billion of them a day, around 383 gigawatt hours a year for one product. Training cost

    One text prompt takes about 0.42 watt hours. ChatGPT handles close to 2.5 billion of them a day, around 383 gigawatt hours a year for one product. Training costs once. Inference costs every time it runs. # ai https:// open.substack.com/pub/michaela ndersentech/p/the-cost-of-ai-th…