Local Color Transfer Research Articles

High reflectivity surface highlight removal technology based on light field polarization imaging.

This paper proposes an imaging technique to remove strong reflections from specular surfaces using polarization characteristics combined with light field imaging. Firstly, the correct strong reflection region is found by studying the reflected light characteristics, and the strong reflection region highlights are filtered out using Stokes parameters based on polarization information. Then, a system of microlens arrays with different transmittances was built for imaging, and the system was image-corrected to enable more information about the scene to be captured. Finally, the color statistics are corrected according to the color characteristics, and then the color adjustment is performed to enhance the local color transfer results to obtain a high-quality true color image. The results of the experiment suggest that the method proposed in this paper is effective in restoring the actual texture contours of large highlight regions on strongly reflective surfaces.

Visual Sensing Technology for Digital Image-Oriented Public Art Design

With the development of computer software technology, computer image processing software has become increasingly significant in the public art design process. It can help with graphic design inventiveness and color presentation, as well as improve the aesthetics of public art design. This study aims to analyze the use of digital image synthesis and visual sensing techniques in public art design, as well as to use Dongba paintings, which reflects Chinese culture, as image fusion research objects. The Dongba painting’s line drawing is modeled and drawn, and an element library is created. The characteristic information of Dongba paintings is extracted using line integration convolution (LIC) algorithm. The background texture elements of the image are fused using image quilting texture’s improved synthesis algorithm. To improve the image effect of the linked Dongba paintings, a local color transfer algorithm based on color transfer rights is presented. The results show that the optimized synthesis algorithm of image quilting textures can achieve the same texture synthesis effect as the original algorithm. The method can meet the needs of real-world applications while also significantly improving the original technique’s performance. The synthesis time is reduced by 87.67%, and the image recognition accuracy of the local color transfer algorithm reaches 88.9%. Compared with other algorithms, the recognition accuracy is improved by 6.4%. The proposed digital image synthesis technique can create good images with different foreground and backdrop combinations and can provide a diverse visual expression. This contributes to public art’s visual production.

Shadow Compensation from UAV Images Based on Texture-Preserving Local Color Transfer

The lack of color information and texture information in the shadow region seriously affect the recognition and interpretation of remote sensing image information. The commonly used methods focus on the restoration of texture information, but it is often easy to overcompensate, resulting in color distortion of the shadow region. However, some methods only ensure accurate correction of color information, and tend to cause texture blurring. In order to not lose the texture information and to accurately compensate the color information in the shadow region of the image, we propose a shadow compensation method from UAV images based on texture-preserving local color transfer in this paper. Firstly, homogeneous regions are extracted from UAV images and homogeneous subregion segmentation is performed on the basis of homogeneous regions using the mean shift method. Secondly, in combination with the shadow mask, each shadow subregion is matched with the corresponding non-shadow subregion based on its texture features and spatial distance. Then, the matched non-shadow subregion is used as the reference region, and the color transfer based on preserving texture is performed on the shadow subregion. Finally, pixel-by-pixel width shadow compensation is applied to the penumbra region. The results of the qualitative and quantitative analysis validate the accuracy and effectiveness of the proposed methodology to compensate for the color and texture details of the shadow regions.

Image recoloring of printed fabric based on the salient map and local color transfer

Factories must proof different colors on fabric in order to verify the feasibility of the color scheme. This proofing process is time-consuming and laborious. To recolor printed fabric images, a novel image recoloring method was proposed in this paper. This method can provide convenience for printed fabric designers and can be used to simulate printed fabric proofing. The relative total variation model was implemented to remove the fabric image texture and noise. Next, in the CIE1976 L* a* b* color space, the mean-shift clustering algorithm was utilized to segment the reference image and the target image to obtain the separated color regions. Then, the color regions of the reference image and the target image were matched based on the salient map and the values of the L* a* b* channels. Finally, local color transfer was performed between the matched color regions based on the matching results. Experiments were conducted on 100 printed fabrics with different color schemes. Results indicated that the proposed method can transfer the color appearance of the reference printed fabric image to the target printed fabric image and realize printed fabric image recoloring.

Efficient and Accurate Stitching for 360° Dual-Fisheye Images and Videos.

Back-to-back dual-fisheye cameras are the most cost-effective devices to capture 360° visual content. However, image and video stitching for such cameras often suffer from the effect of fisheye distortion, photometric inconsistency between the two views, and non-collocated optical centers. In this paper, we present algorithms for geometric calibration, photometric compensation, and seamless stitching to address these issues for back-to-back dual-fisheye cameras. Specifically, we develop a co-centric trajectory model for geometric calibration to characterize both intrinsic and extrinsic parameters of the fisheye camera to fifth-order precision, a photometric correction model for intensity and color compensation to provide efficient and accurate local color transfer, and a mesh deformation model along with an adaptive seam carving method for image stitching to reduce geometric distortion and ensure optimal spatiotemporal alignment. The stitching algorithm and the compensation algorithm can run efficiently for 1920×960 images. Quantitative evaluation of geometric distortion, color discontinuity, jitter, and ghost artifact of the resulting image and video shows that our solution outperforms the state-of-the-art techniques.

A Novel Shadow Removal Method Based upon Color Transfer and Color Tuning in UAV Imaging

Through the increasing use of unmanned aerial vehicles as remote sensing tools, shadows become evident in aerial imaging; this fact, alongside the higher spatial resolution obtained by high-resolution mounted cameras, presents a challenging issue when performing different image processing tasks related to urban areas monitoring. Accordingly, the state-of-the-art reported works can correct the shadow regions, but the heterogeneity between the corrected shadow and non-shadow areas is still evident and especially noticeable in concrete and asphalt regions. The present work introduces a local color transfer methodology to shadow removal which is based on the CIE L*a*b (Lightness, a and b) color space that considers chromatic differences in urban regions, and it is followed by a color tuning using the HSV color space. The quantitative comparison was executed by using the shadow standard deviation index (SSDI), where the proposed work provided low values that improve up to 19 units regarding other tested methods. The qualitative comparison was visually realized and proved that the proposed method enhances the color correspondence without losing texture information. Quantitative and qualitative results validate the results of color correction and texture preservation accuracy of the proposed method against other published methodologies.

Directive local color transfer based on dynamic look-up table

Color transfer in image processing usually suffers from misleading color mapping and loss of details. This paper presents a novel directive local color transfer method based on dynamic look-up table (D-DLT) to solve these problems in two steps. First, a directive mapping between the source and the reference image is established based on the salient detection and the color clusters to obtain directive color transfer intention. Then, dynamic look-up tables are created according to the color clusters to preserve the details, which can suppress pseudo contours and avoid detail loss. Subjective and objective assessments are presented to verify the feasibility and the availability of the proposed approach. Experimental results demonstrate that our proposed method has better performance on natural color images than classical color transfer algorithms. Furthermore, the reference image can be extended to color blocks instead of images.

Fast color transfer from multiple images

Color transfer between images uses the statistics information of image effectively. We present a novel approach of local color transfer between images based on the simple statistics and locally linear embedding. A sketching interface is proposed for quickly and easily specifying the color correspondences between target and source image. The user can specify the correspondences of local region using scribes, which more accurately transfers the target color to the source image while smoothly preserving the boundaries, and exhibits more natural output results. Our algorithm is not restricted to one-to-one image color transfer and can make use of more than one target images to transfer the color in different regions in the source image. Moreover, our algorithm does not require to choose the same color style and image size between source and target images. We propose the sub-sampling to reduce the computational load. Comparing with other approaches, our algorithm is much better in color blending in the input data. Our approach preserves the other color details in the source image. Various experimental results show that our approach specifies the correspondences of local color region in source and target images. And it expresses the intention of users and generates more actual and natural results of visual effect.

Local texture-based color transfer and colorization

This paper targets two related color manipulation problems: Color transfer for modifying an image׳s colors and colorization for adding colors to a grayscale image. Automatic methods for these two applications propose to modify the input image using a reference that contains the desired colors. Previous approaches usually do not target both applications and suffer from two main limitations: possible misleading associations between input and reference regions and poor spatial coherence around image structures. In this paper, we propose a unified framework that uses the textural content of the images to guide the color transfer and colorization. Our method introduces an edge-aware texture descriptor based on region covariance, allowing for local color transformations. We show that our approach is able to produce results comparable or better than state-of-the-art methods in both applications.

Color Improvement Based on Local Color Transfer in Digital Intermediate of Digital Cinema

Color Improvement Based on Local Color Transfer in Digital Intermediate of Digital Cinema

A Novel Video Stitching Method for Multi-Camera Surveillance Systems

This paper proposes a novel video stitching method that improves real-time performance and visual quality of a multi-camera video surveillance system. A two-stage seam searching algorithm based on enhanced dynamic programming is proposed. It can obtain satisfactory result and achieve better real-time performance than traditional seam-searching methods. The experiments show that the computing time is reduced by 66.4% using the proposed algorithm compared with enhanced dynamic programming, while the seam-searching accuracy is maintained. A real-time local update scheme reduces the deformation effect caused by moving objects passing through the seam, and a seam-based local color transfer model is constructed and applied to achieve smooth transition in the overlapped area, and overcome the traditional pixel blending methods. The effectiveness of the proposed method is proved in the experiements.

Multi-Source Local Color Transfer Based on Texture Similarity

Multi-Source Local Color Transfer Based on Texture Similarity

Color correction with blind image restoration based on multiple images using a low-rank model

We present a method that can handle the color correction of multiple photographs with blind image restoration simultaneously and automatically. We prove that the local colors of a set of images of the same scene exhibit the low-rank property locally both before and after a color-correction operation. This property allows us to correct all kinds of errors in an image under a low-rank matrix model without particular priors or assumptions. The possible errors may be caused by changes of viewpoint, large illumination variations, gross pixel corruptions, partial occlusions, etc. Furthermore, a new iterative soft-segmentation method is proposed for local color transfer using color influence maps. Due to the fact that the correct color information and the spatial information of images can be recovered using the low-rank model, more precise color correction and many other image-restoration tasks—including image denoising, image deblurring, and gray-scale image colorizing—can be performed simultaneously. Experiments have verified that our method can achieve consistent and promising results on uncontrolled real photographs acquired from the Internet and that it outperforms current state-of-the-art methods.

Local color transfer between images using dominant colors

A color-transfer method that can transfer colors of an image to another for the local regions using their dominant colors is proposed. In order to naturally transfer the colors and moods of a target image to a source image, we need to find the local regions of colors that need to be modified in the image. Since the dominant colors of each image can be used for the estimation of color regions, we develop a grid-based mode detection, which can efficiently estimate dominant colors of an image. Based on these dominant colors, our proposed method performs a consistent segmentation of source and target images by using the cost-volume filtering. Through the segmentation procedure, we can estimate complex color characteristics and transfer colors to the local regions of an image. For an intuitive and natural color transfer, region matching is also crucial. Therefore, we use the visually prominent colors in the image to meaningfully connect each segmented region in which modified color-transfer method is applied to balance the overall luminance of the final result. In the Experimental Result section, various convincing results are demonstrated through the proposed method.

Local Color Transfer Algorithm Based on CTWC and the Application in Styled Rendering of Yunnan Heavy Color Painting

Local Color Transfer Algorithm Based on CTWC and the Application in Styled Rendering of Yunnan Heavy Color Painting

Local Color Transfer Algorithm Based on CTWC and the Application in Styled Rendering of Yunnan Heavy Color Painting

Local Color Transfer Algorithm Based on CTWC and the Application in Styled Rendering of Yunnan Heavy Color Painting

Gradient‐Preserving Color Transfer

AbstractColor transfer is an image processing technique which can produce a new image combining one source image's contents with another image's color style. While being able to produce convincing results, however, Reinhard et al.'s pioneering work has two problems—mixing up of colors in different regions and the fidelity problem. Many local color transfer algorithms have been proposed to resolve the first problem, but the second problem was paid few attentions.In this paper, a novel color transfer algorithm is presented to resolve the fidelity problem of color transfer in terms of scene details and colors. It's well known that human visual system is more sensitive to local intensity differences than to intensity itself. We thus consider that preserving the color gradient is necessary for scene fidelity. We formulate the color transfer problem as an optimization problem and solve it in two steps—histogram matching and a gradient‐preserving optimization. Following the idea of the fidelity in terms of color and gradient, we also propose a metric for objectively evaluating the performance of example‐based color transfer algorithms. The experimental results show the validity and high fidelity of our algorithm and that it can be used to deal with local color transfer.

Example‐based Multiple Local Color Transfer by Strokes

AbstractThis paper investigates a new approach for color transfer. Rather than transferring color from one image to another globally, we propose a system with a stroke‐based user interface to provide a direct indication mechanism. We further present a multiple local color transfer method. Through our system the user can easily enhance a defect (source) photo by referring to some other good quality (target) images by simply drawing some strokes. Then, the system will perform the multiple local color transfer automatically. The system consists of two major steps. First, the user draws some strokes on the source and target images to indicate corresponding regions and also the regions he or she wants to preserve. The regions to be preserved which will be masked out based on an improved graph cuts algorithm. Second, a multiple local color transfer method is presented to transfer the color from the target image(s) to the source image through gradient‐guided pixel‐wise color transfer functions. Finally, the defect (source) image can be enhanced seamlessly by multiple local color transfer based on some good quality (target) examples through an interactive and intuitive stroke‐based user interface.