Lips Reading Spoken Arabic Word Based on The Geometric Shape Features of The Lip

Abstract

This research aims to determine how to guess individual Arabic words based on visual cues such as lip movement and form extraction. A three-step process was developed to accomplish this goal, the first of which is the identification of the face. Second, the lip region is targeted, and finally, the movement of the speaking lips is analyzed to determine what is being said. This research proposes an alternative approach that uses biometric engineering features extracted from the changing shapes of the lips to make the best guess at the word being spoken. This method uses a set of 20 landmarks around the mouth's outer and inner edges, the high point of an open mouth, and the point where the upper and lower lips meet. The proposed study took a different approach by looking at the shape of the lips and how the points on the upper and lower lips move, as well as figuring out what was being said (the outer and the inner).