Abstract

The increasing significance of technology in daily lives led to the need for the development of convenient methods of human-computer interaction (HCI). Given that the existing HCI approaches exhibit various limitations, hand gesture recognition-based HCI may serve as a more intuitive mode of human-machine interaction in many situations. In addition, the system has to be deployable on low-power devices for applicability in broadly defined Internet of Things (IoT) and smart home solutions. Recent advances exhibit the potential of deep learning models for gesture classification, whereas they are still limited to high-performance hardware. Embedded neural network accelerators are constrained in terms of available memory, central processing unit (CPU) clock speed, graphics processing unit (GPU) performance, and a number of supported operations. The aforementioned problems are addressed in this paper by namely two approaches - simplifying the signal processing pipeline to avoid recurrent structures and efficient topological design. This paper employs an intuitive scheme allowing for the generation of the data in the compressed form from the sequence of range-Doppler images (RDI). Thus, it allows for the design of a neural classifier avoiding the usage of recurrent layers. The proposed framework has been optimized for Intel® Neural Compute Stick 2 (Intel® NCS 2), at the same time achieving promising classification accuracy of 97.57%. To confirm the robustness of the proposed algorithm, five independent persons have been involved in the algorithm testing process.

Highlights

  • Artificial intelligence (AI) has led to rise in smart sensors and devices in the market [1]

  • Chmurski et al.: Analysis of Edge-Optimized Deep Learning Classifiers for Radar-Based Gesture Recognition of the global internet congestion will be generated by Internet of Things (IoT) devices, which confirms the need for thorough research in this direction

  • We use the dedicated version of TensorFlow for Intel processors [50], which is built on top of the Intel R Math Kernel Library for Deep Neural Network (Intel R MKL-DNN) [51]

Read more

Summary

INTRODUCTION

Artificial intelligence (AI) has led to rise in smart sensors and devices in the market [1]. M. Chmurski et al.: Analysis of Edge-Optimized Deep Learning Classifiers for Radar-Based Gesture Recognition of the global internet congestion will be generated by IoT devices, which confirms the need for thorough research in this direction. Neural network optimization, including both architectural design and post training optimization, gives the developers the possibility to convert a very complex deep learning model into a streamlined implementation [9]. Post-training quantizations involve network pruning, quantizations, format optimization [17], [18] Another challenge is the choice of appropriate optimization strategy that highly depends on the data characteristics. The main focus of this paper is placed on the design of an intuitive signal processing scheme allowing for optimization and deployment of deep learning gesture classifier on the edge. 4) Family of the deep neural classifiers optimized for the deployment on the NCS 2

RELATED WORKS
DEEP LEARNING FRAMEWORK
TOPOLOGY DESIGN AND OPTIMIZATIONS
SYSTEM DESCRIPTION AND IMPLEMENTATION
RADAR OPERATING PARAMETERS
TOPOLOGY AND EMBEDDED OPTIMIZATION
OPTIMIZATION AND INFERENCE ON THE EDGE
Full Text
Published version (Free)

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call