PulseAugur
EN
LIVE 04:46:39

Ling-3.0 model support added to llama.cpp via PR #26608

A pull request (PR #26608) has been submitted to the llama.cpp project to add support for the Ling-3.0 model architecture. This architecture is noted to be similar to DeepSeekV2. A small addition to support the Tiny model has been merged, and it is being used for home assistant voice with positive results, particularly its tendency to admit when it doesn't know something. However, the main PR remains unmerged due to CI issues and a need for more testing data. AI

IMPACT This integration could expand the usability of the Ling-3.0 model within the local LLM community.

RANK_REASON A pull request for adding model support to an existing software project.

Read on r/LocalLLaMA →

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →

Ling-3.0 model support added to llama.cpp via PR #26608

COVERAGE [1]

  1. r/LocalLLaMA TIER_1 Italiano(IT) · /u/Public_Umpire_1099 ·

    [llama.cpp PR #26608] Ling-3.0 support (unmerged)

    <!-- SC_OFF --><div class="md"><p>aetherbird has done some great work getting Ling-3.0 to work in llama.cpp. The architecture is generally identical to deepseekv2. </p> <p>I recently added a microscopic 40 line PR to his that adds support for the Tiny model, works great. Using it…