REAL TIME FINGER WRITING RECOGNITION USING WEBCAMERA

Abstract

This paper proposes a real time finger writing recognition system using a web camera to enable user to interact with computer systems by their own bare hands. The hand region is firstly extracted by background subtraction and blob labelling . Then, convex hull and convexity defect are used to count the fingers and detect the fingertip coordinates. The trajectory of the fingertip is smoothed and drawn to become a finger writing character. This paper describes a system which uses multiple visual process to detect like Hand Tracking, Volume Gesture, Finger counter which ultimately tracks Finger Recognition based on computer vision. In modern technologies video tracking and processing the feed has been very essential. This processed data can be used for many research purposes or to express a particular output on a particular system. There are various methods for processing and manipulation of data to get the required output. This application is created using OpenCV module and Mediapipe. OpenCV is a computer vision and machine learning software library that includes many common image analysis algorithms that will help us build custom intelligent computer vision applications. In this application frequent image feed results in video tracking of our particular finger. Video tracking is the process of locating a moving object (or multiple objects) over time using a camera. The ability to perceive the shape and motion of hands can be a vital component in improving the user experience across a variety of technological domains and platforms .One such technology is using MediaPipe .MediaPipe is a framework mainly used for building audio, video, or any time series data. With the help of the MediaPipe framework, we can build very impressive pipelines for different media processing functions.