PulseAugur
EN
LIVE 00:04:43

Ornith AI releases Ornith-1.5 DFlash models with speculative decoding

Ornith AI has released several new models under the Ornith-1.5 DFlash series, including versions with 9B, 397B, and 35B parameters. These models integrate the Ornith-1.5 base models with a DFlash draft model to enhance speculative decoding capabilities. The releases are available on Hugging Face, offering different sizes for various computational needs. AI

IMPACT Provides new options for researchers and developers working with open-source large language models, potentially improving inference speed.

RANK_REASON Release of new open-source models from a non-frontier lab. [lever_c_demoted from research: ic=1 ai=1.0]

Read on r/LocalLLaMA →

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →

Ornith AI releases Ornith-1.5 DFlash models with speculative decoding

COVERAGE [1]

  1. r/LocalLLaMA TIER_1 English(EN) · /u/jacek2023 ·

    Ornith-1.5 DFlash

    <!-- SC_OFF --><div class="md"><p><strong>Ornith-1.5-9B-DFlash</strong> pairs the <strong>Ornith-1.5-9B</strong> model with a DFlash draft model for speculative decoding.</p> <p><a href="https://huggingface.co/ornith-ai/Ornith-1.5-9B-DFlash">https://huggingface.co/ornith-ai/Ornit…