Smol AI dissects its 72B parameter Smaug model

By PulseAugur Editorial · [1 sources] · 2024-02-13 01:40

Smol AI has released Smaug-72B, a new large language model. This model is notable for its performance on various benchmarks, including achieving state-of-the-art results on the MT-Bench leaderboard. Smaug-72B was trained on a dataset of 1.5 trillion tokens and is available for research purposes. AI

RANK_REASON Release of a 72B parameter model with benchmark results, not from a tier-1 lab.

Read on Smol AINews →

model release
paper

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →

COVERAGE [1]

Smol AINews TIER_1 English(EN) · 2024-02-13 01:40

The Dissection of Smaug (72B)

**Abacus AI** launched **Smaug 72B**, a large finetune of **Qwen 1.0**, which remains unchallenged on the **Hugging Face Open LLM Leaderboard** despite skepticism from **Nous Research**. **LAION** introduced a local voice assistant model named **Bud-E** with a notable demo. The *…

COVERAGE [1]

The Dissection of Smaug (72B)

RELATED TOPICS