Detecting Voice Fatigue With Artificial Intelligence

Abstract

Voice fatigue (VF) has many symptoms and can occur after extended or brief voice use, depending on the presence or absence of voice pathology, and other factors. However, fatigue is difficult to detect and quantify through current approaches. This study explores the use of artificial intelligence (AI) in the automatic detection and analysis of voice fatigue, presenting a novel approach to detect and monitor the condition. ObjectiveThis study aims to create an AI-based system for detecting voice fatigue. The AI model’s performance is evaluated against traditional methods of assessment conducted by speech-language pathologists (SLPs). MethodsVoice samples were collected from individuals experiencing varying levels of voice fatigue. To validate these samples, we calculated fo, increases which have been shown to be correlated with voice fatigue, at the beginning and end of the recordings. The samples were processed using a machine learning model trained to recognize patterns associated with voice fatigue. To build the model, we extracted embeddings from an ECAPA-TDNN model that has been shown to capture changes in the voice characteristics of a speaker over time and used a convolutional neural network for classification. To validate the model, the model’s accuracy in detecting voice fatigue was compared to assessments from SLPs. ResultsWe achieved an accuracy score of 93% on our dataset of English academic lectures and podcasts. As further validation, we asked 3 experienced SLPs to classify audio segments from our dataset and compared their responses to the classifications from our model, and achieved an accuracy of 86% as compared to their ratings. ConclusionThe application of AI in the detection of voice fatigue shows a generalizable approach for the analysis of voice fatigue. Future research will incorporate patient data to validate further the models that we created.