PulseAugur
EN
LIVE 19:58:13

13M ASR Conformer Model Runs on Low-Cost Microcontroller

A developer has successfully implemented a 13.1 million parameter Automatic Speech Recognition (ASR) conformer model on a low-cost ESP32-S3 microcontroller. Through distillation and quantization, the model was reduced to fit within 14MB of flash memory and 256KB of SRAM, enabling it to transcribe 8 seconds of audio. While inference speed is still slow, it represents a significant improvement over previous attempts, and the developer advocates for more research into model efficiency to make AI more accessible on affordable hardware. AI

IMPACT Demonstrates potential for running sophisticated AI models on low-cost, embedded devices, increasing accessibility.

RANK_REASON This is a research project demonstrating the feasibility of running a specific AI model on constrained hardware. [lever_c_demoted from research: ic=1 ai=1.0]

Read on r/LocalLLaMA →

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →

13M ASR Conformer Model Runs on Low-Cost Microcontroller

COVERAGE [1]

  1. r/LocalLLaMA TIER_1 English(EN) · /u/wunschpunsch3D ·

    Running a 13M ASR conformer on a microcontroller

    <table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1v1pume/running_a_13m_asr_conformer_on_a_microcontroller/"> <img alt="Running a 13M ASR conformer on a microcontroller" src="https://external-preview.redd.it/ZDc5NnZ0ODduZWVoMeeRTcl9KjdEC41WCW7uRuGpGusZf3DpzGl…