Abstract
In-situ detection and recognition of handgestures in an unconstrained environment is a crucial task in the field of machine vision and video recognition. Hand gesture recognizing task is perhaps more complicated, with varying lighting conditions and background. Robust, accurate hand detection and classification becomes necessary to facilitate the Graphical User Interface, Tele-surgery, etc. In this paper, a Convolutional Neural Network (CNN) based Hybrid Single Stage Recognition (Hybrid-SSR) framework is proposed for real-time hand gesture recognition. The time-efficient Enhanced Xception (E-Xception) CNN model is proposed for feature extraction. The framework is evaluated using three separate datasets (NUSHP-II, Senz-3D, and MITI-HD). The performance of the framework is evaluated for the range of IoU from 0.5 to 0.95. In comparison with the conventional single-stage hand gesture recognition system, the Hybrid-SSR model resulted in higher precision values (99.60 % on AP0.5, 97.80 % on AP0.75, and 88.20 % on AP0.5:0.95) for the MITI-HD dataset. The Hybrid-SSR model with Adam Optimizer surpasses the other optimization techniques. The proposed model achieved comparatively higher precision and recall values for focusing parameter (γ) = 2 and weighting parameter (α) = 0.5. The misclassification problem encountered by the conventional single-stage models is mitigated by implementing the focal loss function in the classification sub-network. The computation cost of Hybrid-SSR (12 ms) is significantly lower compared to other single-stage hand gesture recognition frameworks.
Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have
Disclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.