Abstract
In this work, we propose a vision-based hand gesture recognition system to provide a high-security and smart node in the application layer of Internet of Things. The system can be installed in any terminal device with a monocular camera and interact with users by recognizing pointing gestures in the captured images. The interaction information is determined by a straight line from the user’s eye to the tip of the index finger, which achieves real-time and authentic data communication. The system mainly contains two modules. The first module is an edge repair-based hand subpart segmentation algorithm which combines pictorial structures and edge information to extract hand regions from complex backgrounds. Second, the position which the user focuses on is located by an adaptive method of pointing gesture estimation, which adjusts the offsets between the target position and the calculated position due to lack of depth information.
Highlights
Internet of Things (IoT) which connects objects around us together to the Internet becomes one of the most important information technologies nowadays
We develop a vision-based interaction system using pointing gesture recognition as a node in the application layer of IoT
A security and smart Internet of Things interaction system based on hand gesture recognition is proposed in this work
Summary
Internet of Things (IoT) which connects objects around us together to the Internet becomes one of the most important information technologies nowadays. According to the principle of information generation and the technical architecture, IoT consists of three layers, namely, perception [1, 2], network protocol [3, 4], and application layers [5, 6]. The perception layer recognizes objects and collects information with Radio Frequency Identification (RFID) and Wireless Sensor Networks (WSNs); the security issue for the perception layer is essentially on node capture attacks of RFID and WSNs [7, 8]. The application layer realizes the intelligent services by connecting IoT and users, such as city management, intelligent transportation, telemedicine, and smart home. This study is aimed at developing a secure and authentic interaction system based on computer vision for smart home in the application layer of IoT. Since the interaction data is produced only when the user’s eye and fingertip are detected and the pointing direction is recognized, the system can effectively avoid unauthorized access of illegal users, which is more secure than the traditional point-touch devices
Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have