PulseAugur
EN
LIVE 18:47:13

llama.cpp adds ET backend for open-source hardware integration

By PulseAugur Editorial · [2 sources] ·

The llama.cpp project has introduced a new backend called ggml-et, designed to support the ET-SOC-1 processor. This integration aims to incorporate open-source hardware into the broader open-source inference ecosystem. While the ET processor may not match the absolute performance of modern CPUs, it offers improved performance per watt. The development includes numerous kernel additions and optimizations, such as support for various mathematical operations, performance logging, and vectorized computations, with examples provided for building and running the backend. AI

IMPACT Enhances inference capabilities on specific open-source hardware, potentially improving performance per watt for certain models.

RANK_REASON This is a software integration and backend addition to an existing project, not a frontier release or significant industry event.

Read on r/LocalLLaMA →

AI-generated summary · Google Gemini · from 2 sources. How we write summaries →

llama.cpp adds ET backend for open-source hardware integration

How we ranked this

Signal score
0 / 100
Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket
Tool
This is a software integration and backend addition to an existing project, not a frontier release or significant industry event.
Source corroboration
2 independent sources
Multiple independent publishers reporting the same story raises confidence that it's real and newsworthy.
Topics
infra, product
Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance
High
Clearly on-topic for AI-industry coverage.
Story freshness
49 days old
Aged out of breaking-news scoring windows; ranking reflects the durable signal from the full source set.

Full methodology in our editorial standards.

COVERAGE [2]

  1. llama.cpp — Releases TIER_1 Dansk(DA) · marty1885 ·

    b9951: ggml-et: Initial ET backend (#24179)

    <ul> <li> <p>ggml-et: Add performance logging</p> </li> <li> <p>ggml-et: Quants helpers</p> </li> <li> <p>ggml-et: Add MUL_MAT kernel</p> </li> <li> <p>ggml-et: Add ROPE kernel</p> </li> <li> <p>ggml-et: Add RMS_NORM kernel</p> </li> <li> <p>ggml-et: Add GLU kernel</p> </li> <li>…

  2. r/LocalLLaMA TIER_1 English(EN) · /u/pmttyji ·

    Initial ET backend by marty1885 · Pull Request #24179 · ggml-org/llama.cpp

    <table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1ush79v/initial_et_backend_by_marty1885_pull_request/"> <img alt="Initial ET backend by marty1885 · Pull Request #24179 · ggml-org/llama.cpp" src="https://external-preview.redd.it/-mAhbx4ExmannZuGzKgjQjQWlYakU…

RELATED ENTITIES

RELATED TOPICS