Development of an Electronic Shift Lever Control System Using Hand Pose Recognition

Abstract

In this paper, we introduce an electronic shift lever control system based on hand pose recognition technology to provide a convenient and simple interface to drivers. The hand pose recognition algorithm consists of three processes. The first is hand localization using a simple approach based on deep learning. The second step is the prediction of the 3D hand joint location, and the final step is hand pose recognition. During this process, we define six hand poses and extract feature vectors obtained using the 3D offset from the center of the hand location to the hand joint location. The hand pose is then recognized using a simple KNN classifier.