DNSMOS

LLM guides reinforcement learning for enhanced audio-visual speech

Researchers have developed a novel audio-visual speech enhancement (AVSE) system that utilizes a Large Language Model (LLM) to guide the reinforcement learning process. Instead of relying solely on traditional metrics l…