Sketch-based warping of RGBN images

Abstract

While current image deformation methods are careful in making the new geometry seem right, little attention has been given to the photometric aspects. We introduce a deformation method that results in coherently illuminated objects. For this task, we use RGBN images to support a relighting step integrated in a sketch-based deformation method. We warp not only colors but also normals. Normal warping requires smooth warping fields. We use sketches to specify sparse warping samples and impose additional constraints for region of interest control. To satisfy these new constraints, we present a novel image warping method based on Hermite–Birkhoff interpolation with radial basis functions that results in a smooth warping field. We also use sketches to help the system identify both lighting conditions and material from single images. We present results with RGBN images from different sources, including photometric stereo, synthetic images, and photographs.