Virtual Mouse And Keyboard For Computer Interaction

Abstract

Mouse and keyboard are the wonderful inventions of Human-Computer Interaction (HCI) technology. Currently, wireless mouse or a Bluetooth mouse still uses devices and is not free of devices completely since it uses a battery for power and a dongle to connect it to the PC. In the proposed virtual mouse and keyboard system, this limitation can be overcome by employing webcam or a built-in camera for capturing of hand gestures and coloured object. Method used for Hand gesture recognition is based on Convolutional Neural Networks (CNNs).The computer can be controlled virtually and can perform left click, right click, scrolling functions,volumecontrol,brightness control and other computer cursor function without the use of a physical mouse.A virtual keyboard is controlled by tracking a coloured object and it is based on image processing technique. The proposed system will mostly can use on the conference to present topics using projector and avoid COVID-19 spread by eliminating the human intervention and dependency of devices to control the computer.Main goal is to make the interaction between human and computer as natural as the interactionbetween humans.