A gait phase recognition method for obstacle crossing based on multi-sensor fusion

Abstract

The analysis of human motion patterns and gait phase detection holds significant importance for both human motion analysis and precise control of exoskeleton devices. Presently, research on gait during obstacle crossing primarily focuses on the medical rehabilitation domain, with limited studies concerning gait phase analysis during obstacle crossing. This study conducts a detailed analysis of gait data during obstacle crossing and proposes a CNN-PCA-LSTM algorithm that fuses multi-sensor data to accurately identify gait phases when crossing obstacles in the horizontal direction. A wearable multi-sensor data acquisition system was designed, utilizing flexible capacitive pressure sensors to collect pressure data from the soles of both feet and IMUs to gather foot motion data. Kinematic simulation analyses of human obstacle-crossing motions were performed using Anybody software to determine various gait phases, validating the efficacy of the simulation model. Subsequently, one-dimensional and two-dimensional convolutional neural networks were separately employed to extract features from sole pressure data and foot motion data. Principal Component Analysis (PCA) was utilized to reduce the dimensionality of these feature datasets, which were then inputted into LSTM networks. Finally, the Softmax function was employed for the classification and recognition of gait phases when crossing obstacles in the horizontal direction. The experimental results indicate that employing the CNN-PCA-LSTM algorithm integrating multiple sensor data achieves a recognition accuracy of 97.91 % for identifying gait phases during horizontal obstacle crossing.