Facial Landmark-based Cursor Control and Speechto-Text System for Paralyzed Individuals

Abstract

Computers are crucial in today’s world, but disabled individuals, particularly those who are paralyzed, may face challenges in using them. Paralysis can limit movement to just the eyes, head, and voice, making computer usability difficult without others assistance or help. Few techniques have been developed to improve cursor control systems, such as voice control and gesture control. However, some users have found these methods to be inconvenient or challenging to use. A new model has been proposed that eliminates the need for assistance. It identifies specific facial characteristics, or landmarks, that allow for the control of cursor movement and clicking events without requiring direct physical contact with the user. The system uses eye gaze and facial movements to achieve this. An Integrated Speech-to-Text system is also incorporated into the cursor control system to enable textual interpretation. The system features a user-friendly interface that makes it easy to use and provides a better user experience.