DuplexJev

Frozen LLMs gain speech understanding beyond transcripts with DuplexJev

Researchers have developed DuplexJev, a novel system that enables frozen Large Language Models (LLMs) to process spoken audio beyond simple transcription. By feeding audio encoder hidden states directly into an LLM thro…