Ar Color Grab A Coloring Experience for Autistic Children

Abstract

Augmented Reality (AR) brings together a hub of technologies together, thus allowing us to visualize computer generated data over reality. AR enhances the view by adding digital components to the view. Computer added elements are placed over a real environment indirectly by the use of AR, which increases the impact on the viewer. Various forms of elements like audio, video, animation or data may be added on the scene. The gap between the real environment and digital enhancements is bridged by Augmented Reality by creating an exciting situation. Therefore, a colouring book app, which leverages the use of Augmented Reality is presented, the app allows children to colour the characters of the colouring book, which can then be verified by a mobile device. The detection and tracking of the drawing are done using the application, and a 3-D view of the character is animated via a video stream. This video stream is developed according to the colouring done by a child. The visible and omitted regions of the 3D character are projected from the 2-D view using a process which is then presented in reality. A new outlier rejection algorithm is implemented to track a deformable surface for coloured drawings. Real time tracking and surface deformation recovery are provided. A pipeline that creates 2-D and 3- D content is effectively presented. The principal idea behind this project is to come up with an enhanced colouring experience for autistic children using AR, and also enable them to learn something out of it via a video option given by the application.