Facial Makeup Transfer Combining Illumination Transfer

Xin Jin,Ning Ning,Xiaodong Li,Rui Han,Xiaokun Zhang

doi:10.1109/access.2019.2923116

Abstract

To meet the women appearance needs, we present a novel virtual experience approach of facial makeup transfer, developed into windows platform application software. The makeup effects could present on the user's input image in real time, with an only single reference image. The input image and reference image are divided into three layers by facial feature points landmarked: facial structure layer, facial color layer, and facial detail layer. Except for the above layers are processed by different algorithms to generate output image, we also add illumination transfer, so that the illumination effect of the reference image is automatically transferred to the input image. Our approach has the following three advantages: (1) Black or dark and white facial makeup could be effectively transferred by introducing illumination transfer; (2) Efficiently transfer facial makeup within seconds compared to those methods based on deep learning frameworks; (3) Reference images with the air-bangs could transfer makeup perfectly.

Highlights

Facial makeup transfer is a new application requirement of virtual reality technology in the image
How to see the virtual makeup effect on the image is the need of many young women
If any shadow or specularity exists, they would be transferred to the input image

Summary

Introduction

Facial makeup transfer is a new application requirement of virtual reality technology in the image. The method uses the intrinsic image decomposition method to directly decompose the input facial image into the illumination layer and the reflectance layer, and edits the makeup information of the facial image in the reflectivity layer, rather than need reference image, and decomposes the previous image.

Results

Conclusion