Speech translation
PulseAugur coverage of Speech translation — every cluster mentioning Speech translation across labs, papers, and developer communities, ranked by signal.
-
Speech LLMs enhanced by translation-based encoder pre-training
A new research paper proposes using speech translation to bridge the gap between speech encoders and large language models (LLMs) in Speech LLMs. The paper argues that current architectures have a structural misalignmen…
-
New framework measures user understanding of speech translation AI
A new research paper introduces a framework for studying users' mental models of speech translation systems. The study uses cross-lingual question answering, where users decide whether to accept machine translation (MT)…
-
New Research Defines Machine Interpreting Design Priorities
A new paper published on arXiv introduces the concept of "machine interpreting" (MI) as a distinct subfield of speech translation, emphasizing the need for evaluation metrics beyond simple textual fidelity. The research…
-
New technique boosts Vietnamese speech translation accuracy
Researchers have developed a new data augmentation technique called Phonetically-Informed Data Augmentation (PiDA) to improve Vietnamese speech translation. The method addresses error propagation in cascaded speech tran…
-
New framework reveals speech translation usability gaps
Researchers have developed Ouvia, a new framework for evaluating speech translation (ST) systems based on user-perceived usability in real-world scenarios. A study involving over 1,750 interactions between English and P…