AI-based real-time hand gesture-controlled virtual mouse

Abstract

ABSTRACT Hand gesture control technology is an emerging alternative to conventional input devices like keyboards and mice, enabling users to interact with computers through natural hand movements. Although, many researchers worked on gesture recognition and its challenges, yet wide range of gestures has not been addressed. In this direction, the author proposed a novel gesture-controlled virtual mouse system that uses hand gestures and hand tip detection with a webcam or internal camera for computer navigation that accurately recognizes various gestures, including cursor movement, left and right clicks, double clicks, scrolling, drag and drop, multiple item selection, volume control. To deal with this real-world problem, the authors proposed a solution for limited space situations and assist individuals with hand impairments who cannot use a physical mouse. Furthermore, it surpasses the limitations of traditional mice, such as mechanical wear and tear, adaptability to different environments, and restricted functionalities. By leveraging hand gestures and tip detection through a camera proposed system offers an efficient and adaptable approach to operating a PC mouse. The proposed methodology uses computer vision and AI for the accurate detection of gestures, even in challenging environments. It also offers a comprehensive set of gestures for various actions and functions.