Large Audio-Language Models
PulseAugur coverage of Large Audio-Language Models — every cluster mentioning Large Audio-Language Models across labs, papers, and developer communities, ranked by signal.
- instance of alphaXiv 90%
- instance of Gotit.pub 90%
- instance of ScienceCast 90%
- instance of CatalyzeX 90%
- instance of Audio Flamingo 3 90%
- developed ScienceCast 70%
- used by ScienceCast 70%
- used by speech recognition 70%
- uses alphaXiv 70%
- used by alphaXiv 60%
- used by CatalyzeX 50%
- developed CatalyzeX 50%
5 day(s) with sentiment data
-
New attack exploits speech tokenizer vulnerabilities, robust alternative proposed
Researchers have identified a vulnerability in speech tokenizers, which are crucial components for processing speech signals for AI models. They developed a transferable semantic attack called T-SemAttack that can disru…
-
Audio-R1 framework uses reinforcement learning to boost audio model reasoning
Researchers have introduced Audio-R1, a novel framework that leverages reinforcement learning to enhance the reasoning capabilities of large audio-language models (LALMs). This approach utilizes answers derived from sel…
-
New research explores audio LLM generalization, multilingual medical AI, and activation sparsity
Three new research papers explore advancements in large language models (LLMs) and audio language models. One paper introduces T2L-ICAG, a method for generating instruction-conditioned adapters to improve compositional …
-
AI models' cognitive impairment detection methods analyzed
Researchers have investigated how Large Audio-Language Models (LALMs) assess cognitive impairment (CI) from speech, focusing on identifying which internal components drive decisions and how much CI information is access…
-
AI models struggle to locate temporal information in music, study finds
A new arXiv paper explores the temporal understanding capabilities of large audio-language models (LALMs). Researchers found that while these models can verify specific musical moments when provided with context, they s…
-
Researchers identify cross-modal neurons aligning audio and text in LALMs
Researchers have identified cross-modal concept neurons in large audio-language models (LALMs) that are responsible for representing both audio and text information. These neurons demonstrate alignment between audio and…
-
New benchmark evaluates large audio-language models on underwater acoustics
Researchers have introduced UA-Bench, a new benchmark designed to evaluate the performance of large audio-language models (LALMs) in recognizing underwater acoustic signals. The benchmark consists of over 375,000 audio …
-
New benchmark evaluates speech recognition with visual context
Researchers have introduced ScreenASR-Bench, a new benchmark designed to evaluate speech recognition models, particularly those incorporating visual context. The benchmark features three tiers: Explicit Textual Evidence…
-
New Audit Method Reveals Model-Dependent Audio Grounding in LALMs
Researchers have developed a novel black-box causal audit to investigate hallucinations in Large Audio-Language Models (LALMs). This method isolates and removes evidence regions to test model reliability, revealing that…
-
SWEAR framework improves audio reasoning efficiency in LALMs
Researchers have developed SWEAR, a novel framework for large audio-language models (LALMs) that enhances reasoning efficiency. Unlike previous methods that used broad difficulty estimates, SWEAR employs five-dimensiona…
-
New ICAP-Gate mechanism controls audio influence in large audio-language models
Researchers have developed a new mechanism called ICAP-Gate to control the influence of audio on large audio-language models (LALMs). This method addresses the issue where task-irrelevant audio can alter a model's text-…
-
New AnchorPrompt method boosts audio-language model robustness
Researchers have developed AnchorPrompt, a novel method for improving the robustness of large audio-language models (LALMs). This technique involves training a single block of prompt vectors that are inserted into the m…
-
New methods enhance Large Audio-Language Models via encoder selection and contrastive decoding · 2 sources tracked
Researchers have developed two novel methods to improve the performance of Large Audio-Language Models (LALMs). The first, CUES (Correlation-Guided Encoder Selection), uses a lightweight heuristic to select optimal enco…
-
Machine unlearning techniques reduce privacy risks in audio-language models
Researchers have developed and evaluated several machine unlearning strategies for Large Audio-Language Models (LALMs) used in Speech Question Answering. These methods, including gradient ascent, task arithmetic, and al…
-
New method enhances temporal perception in Large Audio-Language Models
Researchers have developed a new method to improve the temporal perception capabilities of Large Audio-Language Models (LALMs). Current LALMs struggle with precise event localization, often relying on post-training to p…
-
New framework enhances empathetic dialogue in large audio-language models
Researchers have introduced ER-EDF, a novel framework designed to enhance empathetic dialogue generation in large audio-language models (LALMs). This framework, grounded in psychological theories, explicitly separates t…
-
New Hybrid Search method enhances LLM-based speech recognition
Researchers have developed a new method called Hybrid Search to improve automatic speech recognition (ASR) systems that integrate large language models (LLMs). This technique leverages the interaction features between t…
-
New benchmark tests AI's grasp of auditory illusions
Researchers have introduced AIB, the first benchmark designed to evaluate Large Audio Language Models (LALMs) on their ability to replicate human auditory illusions. The benchmark covers ten distinct illusions across mu…
-
New MRMAD benchmark reveals LALMs struggle with audio degradation perception
Researchers have introduced MRMAD, a new benchmark designed to evaluate how well large audio-language models (LALMs) understand acoustic degradation. Unlike existing benchmarks that focus on semantic understanding, MRMA…
-
Speech enhancement may hinder Alzheimer's detection models, study finds
A new research paper published on arXiv questions the effectiveness of speech enhancement and data curation techniques in Alzheimer's disease detection models. The study found that while "cleaner" speech datasets can im…