Short-term Memory Deep Neural Networks Research Articles

CNN-BiLSTM-DNN-Based Modulation Recognition Algorithm at Low SNR

Radio spectrum resources are very limited and have become increasingly tight in recent years, and the exponential growth of various frequency-using devices has led to an increasingly complex and changeable electromagnetic environment. Wireless channel complexity and uncertainty have increased dramatically, and automated modulation recognition (AMR) performs poorly at low signal-to-noise ratios. It is proposed to use convolutional bidirectional long short-term memory deep neural networks (CNN-BiLSTM-DNNs) as a deep learning framework to extract features from single and mixed in-phase/orthogonal (I/Q) symbols in modulated data. The framework combines the capabilities of one- and two-dimensional convolution, a bidirectional long short-term memory network, and a deep neural network more efficiently, extracting characteristics from the perspective of time and space to enhance the accuracy of automatic modulation recognition. Modulation recognition experiments on the benchmark datasets RML2016.10b and RML2016.10a show that the average recognition accuracies of the proposed model from −20 dB to 18 dB are 64.76% and 62.73%, respectively, and the improvement ranges of modulation recognition accuracy are 0.29−5.56% and 0.32−4.23% when the signal-to-noise ratio (SNR) is −10 dB to 4 dB, respectively. The CNN-BiLSTM-DNN model outperforms classical models such as MCLDNN, MCNet, CGDNet, ResNet, and IC-AMCNet in terms of modulation type recognition accuracy.

Advancing Accuracy in Sea Level Estimation with GNSS-R: A Fusion of LSTM-DNN-Based Deep Learning and SNR Residual Sequences

The global navigation satellite system reflectometry (GNSS-R) technique has shown promise in retrieving sea levels using signal-to-noise ratio (SNR) data. However, its accuracy and performance are often limited compared to conventional tide gauges, particularly due to constraints in satellite elevation angles. To address these limitations, we propose a methodology integrating Long Short-Term Memory Deep Neural Networks (LSTM-DNN) models, utilising SNR residual sequences as key feature inputs. Our study focuses on the SC02 station, examining elevation angles ranging from 5° to 10°, 5° to 15°, and 5° to 20°. Results reveal notable reductions in root mean square errors (RMSE) of 2.855%, 17.519%, and 15.756%, respectively, showcasing improvements in accuracy across varying elevation angles. Of particular significance is the enhancement in precision observed at higher elevation angles. This underscores the valuable contribution of our approach to nearshore sea level wave height retrieval, promising advancements in the GNSS-R technique.

Research on Communication Signal Modulation Recognition Based on a CCLDNN

In this paper, a new automatic modulation recognition (AMR) method named CCLDNN (complex-valued convolution long short-term memory deep neural network) is proposed. It is designed to significantly improve the recognition accuracy of modulation modes in low signal-to-noise ratio (SNR) environments. The model integrates the advantages of existing mainstream neural networks. The phase and amplitude information of complex signals is effectively captured through a complex module in the input layer. The Squeeze-and-Excitation (SE) attention mechanism, Bi-LSTM layer, and deep convolutional layer are introduced in the feature extraction layer to gradually enhance feature expression. Among these, the introduction of LSTM enables the model to capture the sequence dependence of signals, and the application of the SE attention mechanism further improves the model’s ability to focus on key features. Tests using the RadioML2016.10a dataset show that the model performs well at multiple SNR levels, achieving an average recognition accuracy of more than 80% over an SNR range of 0 dB to 18 dB. However, under the condition of a low SNR from −20 dB to −2 dB, the model still maintains a high recognition ability. The advanced CCLDNN method shows great deep learning potential in solving practical communication problems.

Hybrid Neural Networks for Enhanced Predictions of Remaining Useful Life in Lithium-Ion Batteries

With the proliferation of electric vehicles (EVs) and the consequential increase in EV battery circulation, the need for accurate assessments of battery health and remaining useful life (RUL) is paramount, driven by environmentally friendly and sustainable goals. This study addresses this pressing concern by employing data-driven methods, specifically harnessing deep learning techniques to enhance RUL estimation for lithium-ion batteries (LIB). Leveraging the Toyota Research Institute Dataset, consisting of 124 lithium-ion batteries cycled to failure and encompassing key metrics such as capacity, temperature, resistance, and discharge time, our analysis substantially improves RUL prediction accuracy. Notably, the convolutional long short-term memory deep neural network (CLDNN) model and the transformer LSTM (temporal transformer) model have emerged as standout remaining useful life (RUL) predictors. The CLDNN model, in particular, achieved a remarkable mean absolute error (MAE) of 84.012 and a mean absolute percentage error (MAPE) of 25.676. Similarly, the temporal transformer model exhibited a notable performance, with an MAE of 85.134 and a MAPE of 28.7932. These impressive results were achieved by applying Bayesian hyperparameter optimization, further enhancing the accuracy of predictive methods. These models were bench-marked against existing approaches, demonstrating superior results with an improvement in MAPE ranging from 4.01% to 7.12%.

A Softwarized Intrusion Detection System for IoT-Enabled Smart Healthcare System

The Internet of Things-enabled Smart Healthcare System (IoT-SHS) is a networked infrastructure of intelligent wearables, software applications, health systems, and services that continuously monitors and transmits patient-sensitive data using an open wireless channel. The conventional security mechanisms are unsuitable for detecting attacks in the dynamic IoT-SHS context due to resource limitations and heterogeneity in low-cost healthcare devices. Deep Learning (DL) solutions for Intrusion Detection System (IDS) and softwarization of the network has the potential to achieve secure network services in the IoT-SHS environment. Motivated by the aforementioned discussion, we propose an intelligent softwarized IDS for protecting the critical infrastructure of the IoT-SHS ecosystem. Specifically, the DL-based IDS is designed using a hybrid cuda Long Short-Term Memory Deep Neural Network (cuLSTM-DNN) algorithm to assist network administrators in efficient decision-making for the generated intrusions. To further bolster the system’s resilience, we suggest a deployment architecture for the proposed CUDA-powered IDS using OpenStack Tacker in a real SDN environment, ensuring that virtual machines can directly utilize the host’s NVIDIA GPU, thereby streamlining and enhancing the network’s operational efficiency. The experimental results using the CICDDoS2019 dataset confirm the effectiveness of the proposed framework over some baseline and recent state-of-the-art techniques.

Data-driven synchronization-avoiding algorithms in the explicit distributed structural analysis of soft tissue

We propose a data-driven framework to increase the computational efficiency of the explicit finite element method in the structural analysis of soft tissue. An encoder–decoder long short-term memory deep neural network is trained based on the data produced by an explicit, distributed finite element solver. We leverage this network to predict synchronized displacements at shared nodes, minimizing the amount of communication between processors. We perform extensive numerical experiments to quantify the accuracy and stability of the proposed synchronization-avoiding algorithm.

Driver Mental Fatigue Detection Based on Head Posture Using New Modified reLU-BiLSTM Deep Neural Network

Early detection of driver mental fatigue is one of the active areas of research in smart and intelligent vehicles. There are various methods, based on measuring the physiological characteristics of the driver utilising sensors and computer vision, proposed in the literature. In general, driver behaviour is unpredictable that can suddenly change the nature of driving and dynamics under mental fatigue. This results in sudden variations in driver body posture and head movement, with consequent inattentive behaviour that can end in fatal accidents and crashes. In the process of delineating the different driving patterns of driver states while active or influenced by mental fatigue, this paper contributes to advancing direct measurement approaches. In the novel approach proposed in this paper, driver mental fatigue and drowsiness are measured by monitoring driver’s head posture motions using XSENS motion capture system. The experiments were conducted on 15 healthy subjects on a MATHWORKS driver-in-loop (DIL) simulator, interfaced with Unreal Engine 4 studio. A new modified bidirectional long short-term memory deep neural network, based on a rectified linear unit layer, was designed, trained and tested on 3D time-series head angular acceleration data for sequence-to-sequence classification. The results showed that the proposed classifier outperformed state-of-art approaches and conventional machine learning tools, and successfully recognised driver’s active, fatigue and transition states, with overall training accuracy of 99.2%, sensitivity of 97.54%, precision and F1 scores of 97.38% and 97.46%, respectively. The limitations of the current work and directions for future work are also explored.

Research on Modulation Signal Recognition Based on CLDNN Network

Modulated signal recognition and classification occupies an important position in electronic information warfare, intelligent wireless communication, and fast modulation and demodulation. To address the shortcomings of existing recognition methods, such as high manual involvement, few recognition types, and a low recognition rate under a low signal-to-noise ratio, we propose an attention mechanism short-link convolution long short-term memory deep neural networks (ASCLDNN) recognition model. The network is optimized for modulated signal recognition and incorporates an attention mechanism to achieve higher accuracy by adding weights to important signals. The experimental results show that ASCLDNN can recognize 11 signal modulations with high accuracy at a low signal-to-noise ratio and no confusion for specific signals.

An automatic P-wave onset time picking method for mining-induced microseismic data based on long short-term memory deep neural network

The automatic P-wave onset time (P-onset) picking of microseismic (MS) waveforms generated during rock failure is the basis of and key to locating the source and exploring the failure mechanism of rock failure in underground engineering. However, it is hard to ensure the accuracy in picking P-onset of MS waveforms with a low signal-to-noise ratio (SNR) mixed with noises. Moreover, traditional P-onset picking methods mainly depend on manual intervention, which imposes onerous requirements on the SNR of MS waveforms. Hence, a new P-onset picking method is proposed based on the deep learning model: the principal components of MS waveforms are extracted based on the multi-channel singular spectrum analysis (MSSA) method to reduce the influence of noise; afterwards, a short-time Fourier transform (STFT) is applied to the processed MS waveforms to attain essential parameters of the waveforms; finally, a model for P-onset picking is established based on the long short-term memory (LSTM) network. Subsequently, a comparison is conducted between the proposed method and other methods based on actual field MS data collected from Xiadian Gold Mine and the seismic data from Stanford Earthquake Dataset. The results show that the proposed method can accurately extract data features of MS waveforms and further improve the P-onset picking performance.

Prostate Cancer: Early Detection and Assessing Clinical Risk Using Deep Machine Learning of High Dimensional Peripheral Blood Flow Cytometric Phenotyping Data.

Detecting the presence of prostate cancer (PCa) and distinguishing low- or intermediate-risk disease from high-risk disease early, and without the need for potentially unnecessary invasive biopsies remains a significant clinical challenge. The aim of this study is to determine whether the T and B cell phenotypic features which we have previously identified as being able to distinguish between benign prostate disease and PCa in asymptomatic men having Prostate-Specific Antigen (PSA) levels < 20 ng/ml can also be used to detect the presence and clinical risk of PCa in a larger cohort of patients whose PSA levels ranged between 3 and 2617 ng/ml. The peripheral blood of 130 asymptomatic men having elevated Prostate-Specific Antigen (PSA) levels was immune profiled using multiparametric whole blood flow cytometry. Of these men, 42 were subsequently diagnosed as having benign prostate disease and 88 as having PCa on biopsy-based evidence. We built a bidirectional Long Short-Term Memory Deep Neural Network (biLSTM) model for detecting the presence of PCa in men which combined the previously-identified phenotypic features (CD8+CD45RA-CD27-CD28- (CD8+ Effector Memory cells), CD4+CD45RA-CD27-CD28- (CD4+ Effector Memory cells), CD4+CD45RA+CD27-CD28- (CD4+ Terminally Differentiated Effector Memory Cells re-expressing CD45RA), CD3-CD19+ (B cells), CD3+CD56+CD8+CD4+ (NKT cells) with Age. The performance of the PCa presence ‘detection’ model was: Acc: 86.79 ( ± 0.10), Sensitivity: 82.78% (± 0.15); Specificity: 95.83% (± 0.11) on the test set (test set that was not used during training and validation); AUC: 89.31% (± 0.07), ORP-FPR: 7.50% (± 0.20), ORP-TPR: 84.44% (± 0.14). A second biLSTM ‘risk’ model combined the immunophenotypic features with PSA to predict whether a patient with PCa has high-risk disease (defined by the D’Amico Risk Classification) achieved the following: Acc: 94.90% (± 6.29), Sensitivity: 92% (± 21.39); Specificity: 96.11 (± 0.00); AUC: 94.06% (± 10.69), ORP-FPR: 3.89% (± 0.00), ORP-TPR: 92% (± 21.39). The ORP-FPR for predicting the presence of PCa when combining FC+PSA was lower than that of PSA alone. This study demonstrates that AI approaches based on peripheral blood phenotyping profiles can distinguish between benign prostate disease and PCa and predict clinical risk in asymptomatic men having elevated PSA levels.

Deep Learning for Recognition of Digital Modulations: A Detailed Study

The automatic modulation recognition of the received signal is very attractive in both military and civilian applications. In recent years, deep learning techniques have received much attention since their excellent performance in signal, audio, image and video processing. This paper examines the feasibility of using deep learning algorithms on automatic recognition of the received radio signals' modulation schemes. Modulation recognition has been performed on eight digital modulation types with a signal-to-noise ratio (SNR) from -20dB to 20dB. First, a vanilla neural network is used to classify the type of modulation. Then, convolutional neural networks (CNN) and recurrent neural networks are applied for modulation recognition. These neural networks are widely used in image and signal processing applications. This is followed by designing the other architectures, including densely connected neural network (DenseNet), inception network, recurrent neural network (RNN), long-short term memory network (LSTM), and convolutional long short-term memory deep neural network (CLDNN) for modulation recognition problem, and their results are presented. During this investigation, a basic model is initially considered for each architecture, and then the network performance is studied by adjusting its parameters. The simulation results show that the proposed modified CLDNN model can provide an accuracy of 98% in high SNRs.

Air quality prediction using CNN+LSTM-based hybrid deep learning architecture.

Air pollution prediction based on variables in environmental monitoring data gains further importance with increasing concerns about climate change and the sustainability of cities. Modeling of the complex relationships between these variables by sophisticated methods in machine learning is a promising field. The objectives of this work are to develop a supervised model for the prediction of air pollution by using real sensor data and to transfer the model between cities. The combination of a convolutional neural network and a long short-term memory deep neural network model was proposed to predict the concentration of air pollutants in multiple locations of a city by using spatial-temporal relationships. Two approaches have been adopted: the univariate model contains the information of one pollutant whereas the multivariate model contains the information of all pollutants and meteorology data for prediction. The study was carried out for different pollutants which are in the publicly available data of the cities of Barcelona, Kocaeli, and İstanbul. The hyperparameters of the model (filter, frame, and batch sizes; number of convolutional/LSTM layers and hidden units; learning rate; and parameters for sample selection, pooling, and validation) were tuned to determine the architecture that achieved the lowest test error. The proposed model improved the prediction performance (measured by the root mean square error) by 11-53% for particulate matter, 20-31% for ozone, 9-47% for nitrogenoxides, and 18-46% for sulfurdioxide with respect to the 1-hidden layer long short-term memory networks utilized in the literature. The multivariate model without using meteorological data revealed the best results. Regarding transfer learning, the network weights were transferred from the source city to the target city. The model has more accurate prediction performance with the transfer of the network from Kocaeli to İstanbul as those neighbor cities have similar air pollution and meteorological characteristics.

Machine Learning in Modeling of Mouse Behavior.

Mouse behavior is a primary outcome in evaluations of therapeutic efficacy. Exhaustive, continuous, multiparametric behavioral phenotyping is a valuable tool for understanding the pathophysiological status of mouse brain diseases. Automated home cage behavior analysis produces highly granulated data both in terms of number of features and sampling frequency. Previously, we demonstrated several ways to reduce feature dimensionality. In this study, we propose novel approaches for analyzing 33-Hz data generated by CleverSys software. We hypothesized that behavioral patterns within short time windows are reflective of physiological state, and that computer modeling of mouse behavioral routines can serve as a predictive tool in classification tasks. To remove bias due to researcher decisions, our data flow is indifferent to the quality, value, and importance of any given feature in isolation. To classify day and night behavior, as an example application, we developed a data preprocessing flow and utilized logistic regression (LG), support vector machines (SVM), random forest (RF), and one-dimensional convolutional neural networks paired with long short-term memory deep neural networks (1DConvBiLSTM). We determined that a 5-min video clip is sufficient to classify mouse behavior with high accuracy. LG, SVM, and RF performed similarly, predicting mouse behavior with 85% accuracy, and combining the three algorithms in an ensemble procedure increased accuracy to 90%. The best performance was achieved by combining the 1DConv and BiLSTM algorithms yielding 96% accuracy. Our findings demonstrate that computer modeling of the home-cage ethome can clearly define mouse physiological state. Furthermore, we showed that continuous behavioral data can be analyzed using approaches similar to natural language processing. These data provide proof of concept for future research in diagnostics of complex pathophysiological changes that are accompanied by changes in behavioral profile.

Prediction of COVID-19 Confirmed Cases after Vaccination: Based on Statistical and Deep Learning Models

In this paper, we analyze and predict the number of daily confirmed cases of coronavirus (COVID-19) based on two statistical models and a deep learning (DL) model; the autoregressive integrated moving average (ARIMA), the generalized autoregressive conditional heteroscedasticity (GARCH), and the stacked long short-term memory deep neural network (LSTM DNN). We find the orders of the statistical models by the autocorrelation function and the partial autocorrelation function, and the hyperparameters of the DL model, such as the numbers of LSTM cells and blocks of a cell, by the exhaustive search. Ten datasets are used in the experiment; nine countries and the world datasets, from Dec. 31, 2019, to Feb. 22, 2021, provided by the WHO. We investigate the effects of data size and vaccination on performance. Numerical results show that performance depends on the used data's dates and vaccination. It also shows that the prediction by the LSTM DNN is better than those of the two statistical models. Based on the experimental results, the percentage improvements of LSTM DNN are up to 88.54% (86.63%) and 90.15% (87.74%) compared to ARIMA and GARCH, respectively, in mean absolute error (root mean squared error). While the performances of ARIMA and GARCH are varying according to the datasets. The obtained results may provide a criterion for the performance ranges and prediction accuracy of the COVID-19 daily confirmed cases.Doi: 10.28991/SciMedJ-2021-0302-7 Full Text: PDF

Non-invasive wearable seizure detection using long–short-term memory networks with transfer learning

Objective. The detection of seizures using wearable devices would improve epilepsy management, but reliable detection of seizures in an ambulatory environment remains challenging, and current studies lack concurrent validation of seizures using electroencephalography (EEG) data. Approach. An adaptively trained long–short-term memory deep neural network was developed and trained using a modest number of seizure data sets from wrist-worn devices. Transfer learning was used to adapt a classifier that was initially trained on intracranial electroencephalography (iEEG) signals to facilitate classification of non-EEG physiological datasets comprising accelerometry, blood volume pulse, skin electrodermal activity, heart rate, and temperature signals. The algorithm’s performance was assessed with and without pre-training on iEEG signals and transfer learning. To assess the performance of the seizure detection classifier using long-term ambulatory data, wearable devices were used for multiple months with an implanted neurostimulator capable of recording iEEG signals, which provided independent electrographic seizure detections that were reviewed by a board-certified epileptologist. Main results. For 19 motor seizures from 10 in-hospital patients, the algorithm yielded a mean area under curve (AUC), a sensitivity, and an false alarm rate per day (FAR/day) of 0.98, 0.93, and 2.3, respectively. Additionally, for eight seizures with probable motor semiology from two ambulatory patients, the classifier achieved a mean AUC of 0.97 and an FAR of 2.45 events/day at a sensitivity of 0.9. For all seizure types in the ambulatory setting, the classifier had a mean AUC of 0.82 with a sensitivity of 0.47 and an FAR of 7.2 events/day. Significance. The performance of the algorithm was evaluated using motor and non-motor seizures during in-hospital and ambulatory use. The classifier was able to detect multiple types of motor and non-motor seizures, but performed significantly better on motor seizures.

Derin Öğrenme İle Türkçe Müziklerden Müzik Türü Sınıflandırması

In this study, an architecture called Convolutional Long Short-term memory deep neural network (CLDNN) based on deep learning, which has not been used before in this field, is used for music genre classification. In addition, a new Turkish Music Database consisting of 200 music belonging to various music genres has been created. The classification performance of the proposed architecture and commonly used machine learning methods has been evaluated on this database. In addition, new features are obtained by using Convolutional Neural Network (CNN), which is the first part of this architecture. Both Mel Frequency Cepstrum Coefficients (MFCC) and log mel filterbank energies were used as input to the Convolutional Neural Network to obtain these new features. In addition to these features, many standard features have been obtained by using various toolboxes. The most successful classification results for all methods are achieved when standard features are used together with new features. The best results among the compared classifiers were achieved with 99.5% by using the remaining part of the proposed architecture, Long Short Term Memory (LSTM), together with the Deep Neural Network (DNN) consisting of fully connected layers.

Holistic, long-term soundscape monitoring in Upstate New York using convolutional long short-term memory deep neural networks

As part of a long-term bioacoustics monitoring project, audio data containing both anthrophony and biophony was collected 24/7 in a residential area of upstate NY for ten months of the 2019–2020 year. To analyze the ecological content of the data with as little manual intervention as possible, the data is automatically classified using deep learning techniques. First, the data is segmented and fed through a binary CNN long short-term memory network to separate “signal” from “silence.” Next, a small subset of the dataset is manually annotated via visual inspection of log-mel spectrograms to train a multiclass CNN-LSTM—a method which reaches testing accuracies of over 90%. Algorithm performance on this manually annotated dataset is compared to performance on unabridged, “real world” audio data, and strategies to handle issues such as lack of training data, multi-label classification, and the “none of the above” class are also explored. The classification results are ultimately used to generate long-term seasonal sound maps which are cross-referenced with local weather data.

Artificial intelligence-enabled context-aware air quality prediction for smart cities

Metropolitan areas around the world are experiencing a surge in air pollution levels due to different anthropogenic causes, making accurate air quality prediction a critical task for public health. Although many prediction systems have been researched and modelled, many of them have neglected the different effects that air pollution has on each individual citizen. Hence, we present a novel context prediction model that includes context-aware computing concepts to merge an accurate air pollution prediction algorithm (using Long Short-Term Memory Deep Neural Network) with information from both surrounding pollution sources (e.g., bushfire incidents, traffic volumes) and user’s health profile. This model is then integrated into a tool called My Air Quality Index (MyAQI), which is further implemented and evaluated in a real-life use case set up in Melbourne Urban Area (Victoria, Australia). Results obtained with MyAQI show both that (i) high precision levels are reached (90–96%) when forecasting air quality situations in four air quality monitoring stations, and (ii) the proposed model is highly adaptable to users’ individual health condition effects under the same airborne pollutant levels.

Multi-Sensor Time-Series Classification for Activity Tracking Under Variable Length

Recent advances in mobile devices, wearable sensors and data analytics are enabling greater adoption of remote health monitoring systems, where human activity recognition (HAR) plays a key role. Most HAR systems assume that consecutive data segments are independent and aim at accurately classifying each individual data segment. However, because training and operating contexts are often different, and collecting labels can be time-consuming and expensive, the recognition accuracy is typically considerably lower in the new (operating) context. In this paper, we propose a framework for HAR that has several unique capabilities: 1) Turns predictions into useful information (e.g. daily distribution of activities for a user) that could be assessed by a clinician or health professional. Our goal is to mitigate the effects of variation between a training and an operating context. 2) Leverages the dependence between consecutive data samples to perform robust activity recognition. And 3) Performs activity classification for variable length set of activities. The framework we present encompasses two main modules. The first is a Recurrent Long Short-Term Memory deep neural network, the core component which gives us the capability to capture the dependence between consecutive sensor data samples and generate labels for every micro segment. The second is a post-processing step performed for uncertainty filtering and label smoothing of decisions. The filtering method enables the system to recognize activities in the presence of difference in the training and testing data distributions, and the smoothing method makes the system properly capture the distribution of activities. We demonstrate that our deep learning architecture can achieve 90% accuracy in standard training scenarios. Furthermore, we show that, in the case of inter-subject variation, the two methods allow us to still accurately capture the distribution of activities.

Walking Gait Phase Detection Based on Acceleration Signals Using LSTM-DNN Algorithm

Gait phase detection is a new biometric method which is of great significance in gait correction, disease diagnosis, and exoskeleton assisted robots. Especially for the development of bone assisted robots, gait phase recognition is an indispensable key technology. In this study, the main characteristics of the gait phases were determined to identify each gait phase. A long short-term memory-deep neural network (LSTM-DNN) algorithm is proposed for gate detection. Compared with the traditional threshold algorithm and the LSTM, the proposed algorithm has higher detection accuracy for different walking speeds and different test subjects. During the identification process, the acceleration signals obtained from the acceleration sensors were normalized to ensure that the different features had the same scale. Principal components analysis (PCA) was used to reduce the data dimensionality and the processed data were used to create the input feature vector of the LSTM-DNN algorithm. Finally, the data set was classified using the Softmax classifier in the full connection layer. Different algorithms were applied to the gait phase detection of multiple male and female subjects. The experimental results showed that the gait-phase recognition accuracy and F-score of the LSTM-DNN algorithm are over 91.8% and 92%, respectively, which is better than the other three algorithms and also verifies the effectiveness of the LSTM-DNN algorithm in practice.