Wav2Vec 2.0 model interpretability for pathological speech assessment studied

Researchers have investigated the interpretability of a Wav2Vec 2.0 model used for assessing pathological speech in oral and oropharyngeal cancer patients. Using canonical correlation analysis, they measured the correlation between the model's embeddings and acoustic features. The study found that the model's learned representations are most strongly associated with spectral and prosodic features, with the first Mel Frequency Cepstral Coefficient showing the highest correlations across all layers. This research not only aids in understanding how speech assessment models encode acoustic information but also provides practical insights for selecting acoustic features in pathological speech analysis. AI

IMPACT Provides insights into how speech assessment models process acoustic data, potentially improving pathological speech analysis.

RANK_REASON Academic paper detailing a case study on model interpretability. [lever_c_demoted from research: ic=1 ai=1.0]

Read on arXiv cs.NE (Neural & Evolutionary) →

• canonical correlation analysis
• eGeMAPS
• Mel Frequency Cepstral Coefficients
• oral and oropharyngeal cancer patients
• wav2vec 2.0

• paper
• other

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →