Intelligent Writing System for Patients with Upper Limb Disabilities

Abstract

Subjects with neurological problems and neurological disorders can be recovered in the dedicated recovery centers and at home. The paper presents a smart writing system that uses dedicated movements to recover specific problems of the hands. The system is based on a smart pen equipped with vibration, acceleration, and gyroscope sensors that give remote data to a computer via an ESP Arduino board via Bluetooth. The purpose of the system design is to serve in applications such as recognizing the writing, drawings, or emotional and physiological states of the writer. The data is preprocessed by extracting the characteristics. They will be used in a prediction and classification system using machine learning (ML) algorithms. The paper proposes a new method of using the dynamic processing of certain geometric shapes that are recognized and analyzed to diagnose the mobility of the subjects’ hands. Using methods of clustering data as K-means and classification as support vector machine (SVM), the results obtained from the data analysis using the TensorFlow platform have an accuracy of over 70%. Due to the adaptation algorithms used, the system can be customized, learning the hand movement of the subject.