PulseAugur
实时 03:37:46

Meta's Llama 3.1 leaks reveal significant upgrades to 8B and 70B models, plus a new 405B SOTA OSS model.

Meta AI's upcoming Llama 3.1 models are reportedly set to feature significant performance improvements, particularly in the 8B parameter version. The 70B parameter model is also expected to see enhancements, though to a lesser extent. Additionally, a new 405B parameter open-source model is anticipated to achieve state-of-the-art performance. AI

排序理由 Leak of upcoming frontier-tier open-source models from a major AI lab.

在 Smol AINews 阅读 →

AI 生成摘要 · Google Gemini · 来自 1 个来源。 我们如何撰写摘要 →

报道来源 [1]

  1. Smol AINews TIER_1 English(EN) ·

    Llama 3.1 Leaks: big bumps to 8B, minor bumps to 70b, and SOTA OSS 405b model

    **Llama 3.1** leaks reveal a **405B dense model** with **128k context length**, trained on **39.3M GPU hours** using H100-80GB GPUs, and fine-tuned with **over 25M synthetic examples**. The model shows significant benchmark improvements, especially for the 8B and 70B variants, wi…