PulseAugur
EN
LIVE 00:59:57

Pretraining LLMs is obsolete for most, says SemiAnalysis

Pretraining large language models is no longer a sensible endeavor for most organizations outside of major frontier AI labs, according to SemiAnalysis. The firm suggests that while some enterprises and startups engage in pretraining for perceived impact or career advancement, prompt engineering likely offers a better return on investment, despite being less glamorous. AI

IMPACT Suggests a strategic shift away from large-scale pretraining towards prompt engineering for most AI practitioners.

RANK_REASON Opinion piece from a known analyst firm about AI training strategies.

Read on X — SemiAnalysis →

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →

Pretraining LLMs is obsolete for most, says SemiAnalysis

COVERAGE [1]

  1. X — SemiAnalysis TIER_1 English(EN) · SemiAnalysis_ ·

    Pretraining fundamentally does not make sense anymore for anyone other than frontier labs. Although there are a lot of people at enterprises & startups who

    Pretraining fundamentally does not make sense anymore for anyone other than frontier labs. Although there are a lot of people at enterprises & startups who have "Pretrainitis" to show “impact” and get promotions, fundamentally, it doesn’t make sense. There is probably higher…