Text-Driven Talking Head Using Dynamic Viseme and DFFD for SIBI

Abstract

This research aims to build an android application that is able to help a deaf person in learning the Indonesian Sign Language System (SIBI). The application is packaged in the form of a 3D animated talking head. This research, the development of a talking head uses the dynamic viseme method. Dynamic viseme has the advantage of creating a more natural animation movement because it uses the original human model in the building process. By using the Dirichlet Free-Form Deformation (DFFD) method as control, the concatenative method is able to produce animated movements that are easily understood by the deaf person. In its build, linear interpolation was also used so that the displacement in the speaker becomes more natural. To build animated movements, four different human models were used. Experimental testing was carried out using surveys and calculations were carried out using the Mean Opinion Score (MOS) method. The number of surveys carried out was five. The purpose of the survey is to determine a model that is easier to understand by mouth movements. The test results on the Indonesian sentence show a value of 4.25. These results indicate that the 3D talking head has the potential to be developed so that it can be understood by a deaf person.