Sonification of Face

Abstract

In this paper, the integration of face segments detection and extraction, and facial expression recognition and Sonification are discussed. In this paper, we propose an algorithm that utilizes haar classifiers detecting face followed by dividing face into Regions of interest (ROI) to extract facial segments. Furthermore, in this project, we propose a statistical approach to process the optical flow data to obtain the overall value for the respective feature region in the face. This approach has eliminated the requirement of accurate identification of the feature boundary. Optical flow computations are utilized to identify the directions and the amount of motions in image sequences that are caused by human facial expressions. These calculated values are then compared with the values from table to estimate the expression .Furthermore after getting the expression; these are then converted to sound by mapping functions. Sounds are generated by simple MIDI tunes based on instruments assigned to each region.