VIB-AVSR

New VIB-AVSR method enhances LLM-based speech recognition in noisy conditions

Researchers have introduced VIB-AVSR, a novel approach to enhance audio-visual speech recognition models. This method integrates Variational Information Bottleneck layers into the LLM backbone to improve robustness agai…