Abstract

Visual impairment is a major crisis for visually impaired people (VIP) and consequently, VIP require keen guidance to perform their regular activities. This paper develops a smartphone-based object (e.g. currency note, staircase, etc.) recognition system that can alleviate the monetary transactions, mobility issues, etc. for VIP. Due to the usage of a singular smartphone, the design of the system remains straightforward, and it requires no extra hardware. Alongside, it is convenient to adapt to the human body. Then, to recognize the object in real-time, it exploits Single Shot Detector (SSD), Convolutional Neural Network (CNN), and Tensorflow-lite (tflite) that classifies, train as well as test the object, and supports the platform, respectively for this purpose. First, it creates a dataset in the format of the COCO dataset. Then, it labels the recognized object by a text to speech conversion method and sends it to the VIP via Bluetooth technology. The experimental results show that for object recognition and detection, the accuracy of the developed system is 94.25% and 98.23%, respectively that outperforming the existing systems. Moreover, it uploads all processed data to a remote server. Overall, the proposed system uses audio messages to guide the VIP in recognizing currency notes and avoiding obstacles in their surroundings.

Full Text
Paper version not known

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call

Disclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.