Abstract

This paper proposes a real-time 3D face tracking system. This system uses a stereo active appearance model fitting (STAAM) algorithm that uses multiple calibrated perspective cameras to compute the 3D shape and rigid motion parameters. The use of calibration information reduces the number of model parameters, restricts the degree of freedom in the model parameters, and increases the accuracy and speed of fitting. The real-time face tracking system works alternating two different modes: the detection mode detects the face and eyes in an image and the tracking mode tracks the detected face using the STAAM. In addition, it utilizes a histogram matching to make the system robust to lighting conditions, and uses the motion information to compensate the temporal fluctuation of the captured images. The experimental results show that the proposed system operates robustly under varying lighting conditions and fast in the real-time manner at above 8 frames/sec.

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call

Disclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.