Abstract
This study designed a finger-worn device-named the Chinese FingerReader-that can be practically applied by visually impaired users for recognizing traditional Chinese characters on the micro internet of things (IoT) processor. The device is portable, easy to operate, and designed to be worn on the index finger. The Chinese FingerReader on the index finger contains a small camera and buttons. The small camera captures images by identifying the relative position of the index finger to the printed text, and the buttons are applied to capture an image by visually impaired users and provide the audio output of the corresponding Chinese character by a voice prompt. To recognize Chinese characters, English letters, and numbers, a robust Chinese optical character recognition (OCR) system was developed according to the training strategy of an augmented convolution neural network algorithm. The proposed Chinese OCR system can segment a single character from the captured image, and the system can accurately recognize rotated Chinese characters. The experimental results revealed that compared with the OCR application programming interfaces of Google and Microsoft, the proposed OCR system obtains 95% accuracy rate in dealing with rotated character images where the Google and Microsoft OCR APIs only obtain 65% and 34% accuracy rates. These results illustrate that the proposed OCR system was more suitable for the needs of visually impaired people in actual use. Finally, three usage scenarios were simulated, and the accuracy and operational performance of the system were tested. Field tests of this system were conducted for visually impaired users to verify its feasibility.
Highlights
Reading text is unavoidable in daily life
OF SYSTEM HARDWARE AND FUNCTIONS To assist visually impaired people in their daily lives, a wearable device, namely a Chinese FingerReader, was designed to read Chinese printed text. The hardware of this device consists of the FingerReader that can be worn on the index finger and a micro internet of things (IoT) processor to be worn on the arm (Fig. 1(a))
In this study, the Chinese FingerReader is developed for visually impaired people to recognize Chinese printed text
Summary
OF SYSTEM HARDWARE AND FUNCTIONS To assist visually impaired people in their daily lives, a wearable device, namely a Chinese FingerReader, was designed to read Chinese printed text. SINGLE-CHARACTER READING MODE The single-character reading mode is the best solution for dealing with situations that lack obvious horizontal information of the text line; examples of such situations include those in which the text is printed on a medicine bottle (Fig. 4) or the text is printed under complex background For such usage scenarios, this study designed a guide label to guide visually impaired users to place their index finger at the correct reading position (Fig. 4). Small vertical marks were placed directly under the guide label corresponding to individual characters These marks can direct visually impaired users to place their index finger at the correct reading position. Our Chinese OCR system analyzes the captured image to recognize the content of the corresponding character at this reading position
Sign-in/Register to view highlights & summary Sign-in/Register to access full text options 
Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have
Schedule a callDisclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.
