A Deep Learning Control Strategy of IMU-Based Joint Angle Estimation for Hip Power-Assisted Swimming Exoskeleton

Abstract

Wearable exoskeleton techniques are becoming mature and wildly used in many areas. However, the biggest challenge lies in that the control system should recognize and follow the wearer’s motion correctly and quickly. In this study, we propose a deep learning control strategy utilizing inertial measurement units (IMU) for hip power-assisted swimming exoskeleton. The control strategy includes two steps: Step 1, the swimming stroke is recognized by a deep convolutional neural and bidirectional long short-term memory network (DCNN-BiLSTM); Step 2, the hip joint angles are estimated with BiLSTM network belonging to the recognized motion to predict the hip trajectory. The dataset of motion recognition and estimation of four swimming strokes are collected by placing IMUs on swimmers’ back and thighs. We conduct offline and online testing of control strategy for accuracy and robustness validation. During offline testing, we achieve an accuracy more than 96% of motion recognition and root mean square error (RMSE) less than 1.2° of hip joint angle estimation, outperforming 2.76% of accuracy and 0.09° of RMSE compared with those of ELM or CNN-GRU. During online testing, the pre-trained networks are transplanted into a Raspberry Pi 4B and achieve 8.47ms for conducting one motion recognition and 6.72ms for one hip joint angle estimation on average, which are far less than 300ms of delayed sensations between the action of exoskeleton and human, while keeping a satisfying recognition accuracy as well. The experiment results show that the accuracy and robustness of proposed control strategy are stable and feasible for the application to exoskeletons.