Abstract

In this paper, the integration of face segments detection and extraction, and facial expression recognition and Sonification are discussed. In this paper, we propose an algorithm that utilizes haar classifiers detecting face followed by dividing face into Regions of interest (ROI) to extract facial segments. Furthermore, in this project, we propose a statistical approach to process the optical flow data to obtain the overall value for the respective feature region in the face. This approach has eliminated the requirement of accurate identification of the feature boundary. Optical flow computations are utilized to identify the directions and the amount of motions in image sequences that are caused by human facial expressions. These calculated values are then compared with the values from table to estimate the expression .Furthermore after getting the expression; these are then converted to sound by mapping functions. Sounds are generated by simple MIDI tunes based on instruments assigned to each region.

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call

Disclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.