Abstract
In this paper, we consider the problem of mutual reconstruction of face image pairs. We addressed this problem in our previous article, where the proposed solutions were discussed in connection with Heterogeneous Face Recognition and Cross-Modal Multimedia Retrieval problems. Those solutions are based on one-dimensional and two-dimensional Principal Component Analysis performed over two original face images followed by their projection on independent eigenspaces, estimation of a transformation matrix and mutual reconstruction of the face image by means of one-dimensional and two-dimensional Karhunen-Loeve Transform. In this article, we propose new approaches and solutions, which are based solely on the two-dimensional eigenspace projection methods, and two regression models — Multiple Linear Regression and Partial Least Squares regression. We present the experiments on mutual reconstruction of face images in sketch/photo pairs, in pairs of face images with age-related changes, and in pairs of 2D/3D face images. In order to conduct the experiments, we selected two variants of the proposed approach. First one is based on two-dimensional Principal Component Analysis and Partial Least Squares regression, and the second one is based on two-dimensional Partial Least Squares and Multiple Linear Regression. Both variants showed acceptable performance for practical applications involving the mutual reconstruction of face images. Furthermore, we consider the method to improve the quality of reconstructed face images in the case of mixed datasets. This method involves classification of the dataset by means of two-dimensional Linear Discriminant Analysis and fitting of a separate regression model for each class. In addition, we show that generally, mutual reconstruction of face images is also achievable in conditions when original images are not a part of training sets of face images.
Highlights
We consider the problem of mutual reconstruction of face image pairs
We addressed this problem in our previous article, where the proposed solutions were discussed in connection with Heterogeneous Face Recognition and Cross-Modal Multimedia Retrieval problems
Those solutions are based on one-dimensional and two-dimensional Principal Component Analysis performed over two original face images followed by their projection on independent eigenspaces, estimation of a transformation matrix and mutual reconstruction of the face image by means of onedimensional and two-dimensional Karhunen-Loève Transform
Summary
Алгоритмы взаимной реконструкции изображений лиц на основе методов проекции в собственные подпространства. Ниже представим краткий обзор научной литературы по применению одномерных и двумерных методов проекции в собственные подпространства для решения задач обработки ИЛ различной физической природы. Что именно методы проекции в подпространства применяются наиболее часто для решения задач совместной обработки ИЛ, представленных совершенно различными способами и при условии полного неподобия в парах. Использование двумерных проекционных методов позволяет эффективно решать задачи обработки, распознавания и преобразования изображений, так как в этом случае не требуется векторизация В таком случае двумерный анализ главных компонент может оказаться предпочтительным, так как с его помощью достаточно вычислить матрицы проекции для каждого набора ИЛ, а не для каждой связанной пары наборов.
Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have
Disclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.