PulseAugur
LIVE 12:27:49
research · [1 source] ·
0
research

Smol AI releases ModernBert, a small retriever/classifier with 8k context

By PulseAugur Editorial · Summary by gemini-2.5-flash-lite from 1 source

Smol AI has released ModernBert, a new model designed for retrieval and classification tasks. It boasts an 8,000-token context window and was trained on 2 trillion tokens. This release positions ModernBert as a capable workhorse for specific AI applications. AI

Summary written by gemini-2.5-flash-lite from 1 source. How we write summaries →

RANK_REASON Release of a new model from a non-frontier lab with technical specifications.

Read on Smol AINews →

COVERAGE [1]

  1. Smol AINews TIER_1 ·

    ModernBert: small new Retriever/Classifier workhorse, 8k context, 2T tokens,

    **Answer.ai/LightOn** released **ModernBERT**, an updated encoder-only model with **8k token context**, trained on **2 trillion tokens** including code, with **139M/395M parameters** and state-of-the-art performance on retrieval, NLU, and code tasks. It features **Alternating Att…

RELATED TOPICS