An analysis of the energy cost of AI responses revealed that generating a short answer from the Qwen3-8B model on a MacBook consumed approximately 34 joules. Longer outputs, such as a 16,000-token document, required significantly more energy, around 57 times that of a short answer. Even a coding task demanded nearly 4,000 joules. The study concluded that producing 1,000 short answers would cost roughly one-sixth of a cent. AI
IMPACT Provides insight into the energy efficiency of LLMs, relevant for optimizing computational costs and environmental impact.
RANK_REASON Analysis of energy consumption for AI model responses. [lever_c_demoted from research: ic=1 ai=1.0]
Read on Mastodon — mastodon.social →
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →