THIRD EYE 360° Object Detection and Assistance for Visually Impaired People

Abstract

Visual disability is a global issue. Visually impaired people confront several challenges every day. Many times, blindness affects a person’s ability to self-navigate in known or unknown environments. The difficulties faced by them and how they deal with themare largely known and explored. The system we developed is an idea to overcome the challenges of detecting objects in a known environment or room environment with the help of Artificial Intelligence. The idea is based on the approach to aid visually impaired people with voice assistance to detect objects of the surrounding using 360° view cameras. The proposed system uses a 360° view camera of the mobile phone to assist the user for detecting desired objects in the room environment and provide localization. Using this system, users can search for the desired objects by giving voice commands and can be assisted to the object location. When the user wants to search any object, he/she simply gives a voice command using NLP to the system. The system then identifies commands and extracts the object name to be searched. With the help of imageprocessing, first identifies and locates the object in surrounding and navigates the user to that object using a voice assistant.