PulseAugur
EN
LIVE 10:00:28

Open-source Soofi S 30B-A3B model released for German and English

By PulseAugur Editorial · [3 sources] ·

Researchers have introduced Soofi S 30B-A3B, a new open-source foundation model designed for German and English languages. This model utilizes a hybrid Mamba-Transformer architecture, activating only 3 billion of its 30 billion parameters per token, which offers significant throughput advantages for long-context applications. Soofi S was trained on approximately 27 trillion tokens and has demonstrated competitive performance against larger dense models, particularly excelling in code generation tasks and outperforming other European sovereign models. The development was conducted on Deutsche Telekom's German Industrial AI Cloud infrastructure in Munich, and the model will be released with permissive open-access terms, including weights, code, and detailed data accounting. AI

IMPACT This open-source model could accelerate development and deployment of German and English language AI applications, particularly those requiring long contexts and high concurrency.

RANK_REASON The cluster describes a new research paper detailing an open-source foundation model.

Read on Hugging Face Daily Papers →

AI-generated summary · Google Gemini · from 3 sources. How we write summaries →

Open-source Soofi S 30B-A3B model released for German and English

COVERAGE [3]

  1. arXiv cs.AI TIER_1 English(EN) · The Soofi-Team, :, Benedikt Droste, David Fitzek, Ruben H\"arle, Lukas Helff, Maximilian Idahl, Alex Jude, Abbas Goher Khan, Maurice Kraus, Timm Ruland, Richard Rutmann, Sebastian Sztwiertnia, Markus Frey, Daniil Gurgurov, Jan Pfister, Tom R\"ohr, Sebas… ·

    A Sovereign, Open-Source Foundation Model for German and English

    arXiv:2607.09424v1 Announce Type: cross Abstract: We present Soofi S 30B-A3B, a sovereign, open-source Mixture-of-Experts (MoE) hybrid Mamba Transformer foundation model for German and English. Its hybrid design activates only 3B of 30B parameters per token and keeps the inferenc…

  2. arXiv cs.AI TIER_1 English(EN) · Max Lübbering ·

    A Sovereign, Open-Source Foundation Model for German and English

    We present Soofi S 30B-A3B, a sovereign, open-source Mixture-of-Experts (MoE) hybrid Mamba Transformer foundation model for German and English. Its hybrid design activates only 3B of 30B parameters per token and keeps the inference cache near-constant as context grows, giving it …

  3. Hugging Face Daily Papers TIER_1 English(EN) ·

    A Sovereign, Open-Source Foundation Model for German and English

    We present Soofi S 30B-A3B, a sovereign, open-source Mixture-of-Experts (MoE) hybrid Mamba Transformer foundation model for German and English. Its hybrid design activates only 3B of 30B parameters per token and keeps the inference cache near-constant as context grows, giving it …

RELATED ENTITIES

RELATED TOPICS