PulseAugur
EN
LIVE 07:28:18

New RL method boosts code-switched ASR data efficiency

Researchers have developed a novel reinforcement learning technique, RLVR, to improve the data efficiency of audio-language models for code-switched Automatic Speech Recognition (ASR). This method utilizes group relative policy optimization with a combination of error rate and script fidelity rewards to adapt models like Qwen2-Audio. Experiments show that RLVR, trained on only 10% of the data, can match the performance of supervised fine-tuning using the full dataset, particularly excelling with typologically distant language pairs and transferring gains to human-recorded speech. AI

IMPACT This research could significantly reduce the data requirements for training code-switched ASR systems, making them more accessible and efficient.

RANK_REASON Research paper detailing a new method for ASR. [lever_c_demoted from research: ic=1 ai=1.0]

Read on arXiv cs.CL →

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →

New RL method boosts code-switched ASR data efficiency

COVERAGE [1]

  1. arXiv cs.CL TIER_1 English(EN) · Ziwei Ye, Peter Vickers ·

    Reinforcement Learning for Data-Efficient Code-Switched ASR

    arXiv:2607.02757v1 Announce Type: new Abstract: Audio-language models can be prompted for code-switched speech, but their decoding is not optimized for code-switching and often fails at language boundaries. We propose a practical reinforcement learning with verifiable rewards rec…