PulseAugur
EN
LIVE 21:53:12

Frontier AI models struggle to label ASMR audio, human input sought

By PulseAugur Editorial · [1 sources] ·

A project training a text-to-ASMR model found that current frontier AI models struggle with accurately labeling audio clips for specific sounds like paper rustling or brushing. While models like Gemini 3.1 Pro performed well on general sound effects, their performance dropped significantly on ASMR-specific triggers when compared to human labels. The project is crowdsourcing human labels for ASMR clips to improve model training and fill the gap in identifying subtle audio cues. AI

IMPACT Highlights limitations of current frontier models in nuanced audio understanding, indicating a need for specialized training data and human oversight for specific AI applications.

RANK_REASON The item details an evaluation of frontier models on a specific task (audio labeling for ASMR) and presents benchmark results, fitting the research category. [lever_c_demoted from research: ic=1 ai=1.0]

Read on r/MachineLearning →

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →

Frontier AI models struggle to label ASMR audio, human input sought

How we ranked this

Signal score
0 / 100
Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket
Tool
The item details an evaluation of frontier models on a specific task (audio labeling for ASMR) and presents benchmark results, fitting the research category. [lever_c_demoted from research: ic=1 ai…
Source corroboration
Single-source cluster
Only one publisher covered this so far. Single-source stories can still rank when the publisher is high-authority, but they lack cross-source corroboration.
Topics
model release, product, other
Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance
High
Clearly on-topic for AI-industry coverage.
Story freshness
1 days old
Coverage has settled into its steady-state source set.

Full methodology in our editorial standards.

COVERAGE [1]

  1. r/MachineLearning TIER_1 English(EN) · /u/MissAppleby ·

    Frontier models are bad at hearing ASMR: 8 judges vs human labels on 480 clips [P]

    <!-- SC_OFF --><div class="md"><p>I'm training text2asmr, a text-to-ASMR model (whispering plus trigger sounds like tapping, crinkling, brushing). The generator needs every training clip tagged with the sounds in it, and there are about 126k recordings, so I tried frontier models…

RELATED ENTITIES

RELATED TOPICS