PulseAugur
EN
LIVE 13:19:56

LLMs function as averaging machines, defaulting to the most probable answer

Large Language Models (LLMs) function as averaging machines, consistently producing the most probable outcome for any given input. This means that for every creative decision delegated to an LLM, the model will default to the most average or common answer. This tendency limits their capacity for genuine novelty and highlights a trade-off between convenience and creative output. AI

IMPACT Highlights the inherent limitations of LLMs in generating novel or creative outputs, suggesting a trade-off for users.

RANK_REASON Opinion piece discussing the fundamental nature of LLMs as averaging machines.

Read on Mastodon — fosstodon.org →

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →

LLMs function as averaging machines, defaulting to the most probable answer

COVERAGE [1]

  1. Mastodon — fosstodon.org TIER_1 English(EN) · [email protected] ·

    「 LLMs are averaging machines. Every answer they produce, everything they do, fundamentally comes down to the most likely result. Meaning for every tiny creativ

    「 LLMs are averaging machines. Every answer they produce, everything they do, fundamentally comes down to the most likely result. Meaning for every tiny creative decision you cede, however small, the decision will be “made” by the LLM and given the most average possible answer 」 …