Stress recognition with multi‐modal sensing using bootstrapped ensemble deep learning model

Abstract

AbstractThe factors that influence a person's mental health are numerous, interconnected, and multi‐dimensional. Recognition of stress is one of the facets in developing the Mental Healthcare (MHC) system framework. With the advent of technology, smart wearable devices have paved a way to collect data in real‐time to provide the cutting‐edge reports about the individual. Due to the physiological sensors present in the smart wearable devices, it is now possible to have a robust system to recognize the stress of the smart wearable devices user thus consecutively leading to recognition of factors in leading to stress. However, the current MHC system for recognition and identification of stress have several drawbacks. First, stress recognition is mostly designed for a particular group of individuals like occupational stress, perinatal maternal stress, or health worker stress and fails to propose a framework that would not be targeted for a particular group of individual. Second, most of the previous work done on stress recognition focuses on the extraction of handcrafted features thus requiring human intervention and expertise. To address these issues, this study proposes, a hybrid deep learning based ensemble approach for automated extraction of features and classification into various state of stress for MHC system. The proposed framework takes input from wearable physiological sensors and is provided to deep learning classifier of convolutional neural network (CNN) and CNN‐long short term memory based ensemble model. The proposed framework has been experimented on the wearable stress and affect detection dataset and reports an accuracy of 91.52% that is 7.20% higher than earlier reported accuracies from other machine learning and deep learning models.