A deep Kalman filter network for hand kinematics estimation using sEMG

Abstract

In human-machine interfaces (HMI), deep learning (DL) techniques such as convolutional neural networks (CNN), long-short term memory networks (LSTM) and the hybrid CNN-LSTM framework have been exploited for hand kinematics estimation using surface electromyography (sEMG). However, these DL techniques only capture the relationship between sEMG and hand kinematics, but ignores the prior knowledge of the system. By contrast, Kalman filter (KF) can apply Kalman gain to combine the internal transition model and the observation model effectively. To this end, we propose a novel architecture named deep Kalman filter network (DKFN), in which we utilize CNN to extract high-level features from sEMG and employ a LSTM-based Kalman filter process (LSTM-KF) to conduct sequential regression. In particular, LSTM-KF adopts the computational graph of KF but estimates parameters of the transition/observation model and the Kalman gain from data using LSTM modules. With this process, the advantages of KF and LSTM can be exploited jointly. Experimental results demonstrate that the proposed DKFN can outperform CNN and CNN-LSTM in the sequential regression for wrist/fingers kinematics estimation.