Abstract Details

Title Comparison of Machine Learning Architectures for Acoustic Analysis of Vowel Articulation Among Parkinson’s Disease Patients

Topic Movement Disorders

Presentation(s) P3 - Poster Session 3 (11:45 AM-12:45 PM)

Poster/Presentation
Number 5-008

Objective Our aim was to develop and compare machine learning (ML) algorithms for identification of Parkinson’s disease (PD) patients via acoustic analysis of vowel articulation.

Background Vocal impairments are common among PD patients and characterized with hypokinetic dysarthria, hypophonia, monotony, and hoarseness. We hypothesize that these acoustic biomarkers can be leveraged by ML models to differentiate the voice of those with PD from control.

Design/Methods Two public datasets containing PD speech recordings including the NeuroVoz and Italian Parkinson’s Voice/Speech datasets were utilized. Vowel articulation tasks were pooled together. Each recording was truncated to 4 seconds, adjusted to audio frequency of 16 kHz, and processed using time and pitch augmentation. Both raw WAV files and log-mel spectrograms (LMS) were used as inputs into different models to compare relative performances. Three different modeling approaches were utilized: ResNet18, a convolutional neural network (CNN) based architecture; HuBERT, a mixed CNN-Transformer architecture; the Audio Spectrogram Transformer (AST). Original WAV files were used as input into the HuBERT model, while LMS transformed data were used as input into the CNN and AST models. Performance was evaluated after aggregation of metrics over a fivefold cross-validation.

Results 150 patients (44% female) with mean age of 67.1±9.87 were included. 74 patients (49.3%) had a diagnosis of PD. The HuBERT model demonstrated average area under the curve of receiver operating characteristics (AUC-ROC) of 0.733±0.0429 and accuracy of 0.621±0.0713. The CNN model demonstrated AUC-ROC of 0.839±0.0501 and accuracy of 0.750±0454. The AST demonstrated AUC-ROC of 0.820±0.0548 and accuracy of 0.752±0.0622.

Conclusions ML algorithms are capable of accurately classifying PD patients from controls based on vowel articulation. In our cohort, LMS transformed data yielded better performance compared to raw WAV files, and CNN-based models yielded better performance than Transformer-based models. Future works will include more samples and explore various methods that enhance explainability of above models.

Authors/Disclosures
Kotaro Tsutsumi, MD PRESENTER	Dr. Tsutsumi has nothing to disclose.
Peter Chang, MD	Dr. Chang has received personal compensation in the range of $10,000-$49,999 for serving as a Consultant for Bayer. Dr. Chang has received personal compensation in the range of $10,000-$49,999 for serving as a Consultant for Canon Medical. Dr. Chang has stock in Avicenna.ai. The institution of Dr. Chang has received research support from Novocure.
Sanaz Attaripour, MD, FAAN (University of California, Irvine)	Dr. Attaripour has nothing to disclose.

��ɫ��

��ɫ��