Supervised learning for automatic emotion recognition in Parkinson’s disease through smartwatch signals

Abstract

People with Parkinson’s Disease (PwPD) usually experience several neuropsychiatric signs such as anxiety, depression, and negative emotions that contribute to disability and worsening of quality of life. Notwithstanding, the assessment of these symptoms are largely underrated, subjective and difficult due to a large overlapping with other PD symptoms, like hypomimia and bradikinesia. The aim and novelty of the current work is to study and validate a method for automatic emotion recognition in PwPD during daily living through autonomic signals acquired by acceptable and low-cost consumer technology. The best shallow learning algorithm and the best minimal feature set are individuated. 11 PwPD and 8 subjects with no history of neurological injury or illness were enrolled in the study. Participants were asked to watch video clips purposely selected to arouse emotions, and annotate arousal and valence of emotions triggered by video clips, while their heart rate, skin conductance, and temperature were recorded by a smartwatch. Smartwatch data was used for features extraction, while participants’ reported arousal and valence were used as gold-standard to train machine learning algorithms for emotion classification (low/high arousal, positive/negative valence). Different feature sets and different algorithms (i.e. decision tree (DT), random forest (RF), support vector machine (SVM), and multilayer perceptron (MLP)) were evaluated to find the best solution for each group of participant. In each group of participants, it was possible to find a combination of feature set and algorithm to reach a classification accuracy greater than 90%. The Random Forest reached the best performance in both groups and for both valence and arousal. For each classification task (valence or arousal, PwPD or controls), the best model was selected and the minimal feature set was found by performing a recursive feature elimination based on the Shapley value. A lower accuracy of appraisal emerged for arousal compared to valence. Obtained results showed the feasibility of automatic emotion recognition in PwPDs through autonomic signals. Autonomic dysfunction in PwPDs may explain the lower arousal accuracy. The findings warrant confirmation from trials on larger samples and there are open issues to be deepened in future work.