Color Fringe Research Articles

Color Fringe Correction by the Color Difference Prediction Using the Logistic Function.

This paper proposes a new color fringe correction method that preserves the object color well by the color difference prediction using the logistic function. We observe two characteristics between normal edge (NE) and degraded edge (DE) due to color fringe: 1) the DE has relatively smaller R-G and B-G correlations than the NE and 2) the color difference in the NE can be fitted by the logistic function. The proposed method adjusts the color difference of the DE to the logistic function by maximizing the R-G and B-G correlations in the corrected color fringe image. The generalized logistic function with four parameters requires a high computational load to select the optimal parameters. In experiments, a one-parameter optimization can correct color fringe gracefully with a reduced computational load. Experimental results show that the proposed method restores well the original object color in the DE, whereas existing methods give monochromatic or distorted color.

Real-time tricolor phase measuring profilometry based on CCD sensitivity calibration

A real-time tricolor phase measuring profilometry (RTPMP) based on charge coupled device (CCD) sensitivity calibration is proposed. Only one colour fringe pattern whose red (R), green (G) and blue (B) components are, respectively, coded as three sinusoidal phase-shifting gratings with an equivalent shifting phase of 2π/3 is needed and sent to an appointed flash memory on a specialized digital light projector (SDLP). A specialized time-division multiplexing timing sequence actively controls the SDLP to project the fringe patterns in R, G and B channels sequentially onto the measured object in one over seventy-two of a second and meanwhile actively controls a high frame rate monochrome CCD camera to capture the corresponding deformed patterns synchronously with the SDLP. So the sufficient information for reconstructing the three-dimensional (3D) shape in one over twenty-four of a second is obtained. Due to the different spectral sensitivity of the CCD camera to RGB lights, the captured deformed patterns from R, G and B channels cannot share the same peak and valley, which will lead to lower accuracy or even failing to reconstruct the 3D shape. So a deformed pattern amending method based on CCD sensitivity calibration is developed to guarantee the accurate 3D reconstruction. The experimental results verify the feasibility of the proposed RTPMP method. The proposed RTPMP method can obtain the 3D shape at over the video frame rate of 24 frames per second, avoid the colour crosstalk completely and be effective for measuring real-time changing object.

Applying innovative stripes adaptive detection to three-dimensional measurement of color fringe profilometry

This study developed a 3D software and hardware measurement system, and proposes an innovative stripes adaptive detection algorithm. The fringe intensity is regulated automatically according to the reflection coefficient of different analytes, in order to avoid overexposure. For the measurement of the object in discontinuously changing height, a novel intensity difference coding unwrapping phase technology is used, thus overcoming the technological bottleneck of traditional phase unwrapping. In order to increase the measurement efficiency, the stripe pattern is combined with intensity coding pattern by three-channel color information, in order to generate an adaptive compound color stripe pattern. The measurement efficiency is increased by approximately two times compared with traditional gray stripe pattern. In order to increase the measurement accuracy, the uneven brightness is corrected by using brightness gain function. The three-channel intensity nonlinear response is corrected by cubic spline interpolation system response inverse function. The three-channel image is corrected by color cross-talk correction technology. The experiment proved that the system repeatability is 20µm. The traditional phase-shifting profilometry is improved successfully, overcoming the technical measurement bottleneck of discontinuous change in the analyte height, so as to attain low cost, high measurement accuracy, efficiency and measurement reliability.

Grayscale imbalance correction in real-time phase measuring profilometry

Grayscale imbalance correction in real-time phase measuring profilometry (RPMP) is proposed. In the RPMP, the sufficient information is obtained to reconstruct the 3D shape of the measured object in one over twenty-four of a second. Only one color fringe pattern whose R, G and B channels are coded as three sinusoidal phase-shifting gratings with an equivalent shifting phase of 2π/3 is sent to a flash memory on a specialized digital light projector (SDLP). And then the SDLP projects the fringe patterns in R, G and B channels sequentially onto the measured object in one over seventy-two of a second and meanwhile a monochrome CCD camera captures the corresponding deformed patterns synchronously with the SDLP. Because the deformed patterns from three color channels are captured at different time, the color crosstalk is avoided completely. But due to the monochrome CCD camera's different spectral sensitivity to R, G and B tricolor, there will be grayscale imbalance among these deformed patterns captured at R, G and B channels respectively which may result in increasing measuring errors or even failing to reconstruct the 3D shape. So a new grayscale imbalance correction method based on least square method is developed. The experimental results verify the feasibility of the proposed method.

Grayscale imbalance correcting method based on fringe normalization in RGB tricolor real-time three-dimensional measurement

In real-time phase measuring profilometry based on color-encoded sinusoidal three-step phase-shifting algorithm, three frames of red (R), green (G), and blue (B) individual channel color-encoded sinusoidal gratings with an equivalent shifting phase of 2π/3 are combined to be a color fringe pattern. While this color fringe pattern is projected onto the measured object rapidly and sequentially by a special digital light projector, a high-speed monochrome camera synchronized with the projector signal is used to capture the corresponding deformed patterns in R, G, and B channels. Due to the monochrome camera’s different sensitivity to R, G, and B light, there will be a grayscale imbalance among the captured phase-shifting deformed patterns from R, G, and B channels. So, a grayscale imbalance correcting method based on fringe normalization is proposed. The experimental results verify the feasibility of the proposed method. The three-dimensional (3-D) shape information can be obtained in real-time. It is suitable for real-time 3-D measurement.

An online triple-frequency color-encoded fringe projection profilometry for discontinuous object

An online triple-frequency color-encoded fringe projection profilometry is proposed to measure the complex and discontinuous object at straight-line movement. N frames of color fringe patterns are specially designed. Three grayscale sinusoidal grating patterns with geometric progression frequency growth are encoded into red (R), green (G), and blue (B) channels separately to compose a color-encoded fringe pattern. If these three grayscale sinusoidal grating patterns are phase-shifted N steps with an equivalent shift phase of 2π/N, they can compose the corresponding N frames of color-encoded fringe patterns as above respectively. In order to avoid the movement’s interference to the phase shifting, position adjustment should be done to guarantee the phase-shifting direction to be perpendicular to the moving direction. While these N frames of specially designed color-encoded fringe patterns are projected onto the moving object one by one, the corresponding deformed color patterns are captured by a CCD camera in real time. By color separating, color crosstalk compensation, pixel matching, and phase calculation, three wrapped phase at different frequencies can be extracted. The unwrapped phase can be solved by a simplified algorithm based on temporal phase unwrapping method from the relationship of the three wrapped phase at the same pixel. Thus, it is very suitable to measure the online complex and discontinuous objects at straight-line movement. The experimental results show the feasibility and the validity of the proposed method.

High resolution LED display using a new rendering method with color sub-pixel architecture

We have developed a novel LED display with RGGB color architecture with 4sub-pixels rendering. Sub-pixel rendering is known as a method of the perceptual enhancement of conventional display resolution higher than normal pixel rendering. In this paper, LED light control filter algorithm is proposed in order to reduce the color fringe artifact by sub-pixel rendering. A new LED display which has RGGB 4 sub-pixel structure with filtered sub-pixel rendering is evaluated by comparing the simulated MTF and visual test of the displayed wedge pattern. The results show that it has 2 times higher perceptual resolution without color fringe artifact and it is possible to be about 30% cost cutting.

Angular and spatial color mixing using mixing rods with the geometry of a chaotic-dispersive billiard system

Abstract For mixing light from different colored LEDs, an optical color mixing system is required to avoid colored shadows and color fringes. Concerning the different color mixing systems, mixing rods are widespread as they provide very good spatial color mixing with high efficiency. The essential disadvantage of mixing rods, so far, is the lack of angular color mixing. The solution presented in this publication is the application of a chaotic-dispersive billiard’s geometry on the cross section of the mixing rod. To show both the spatial and the angular mixing properties of a square and a chaotic-dispersive mixing rod, simulations generated by the raytracing software ASAP are provided. All results are validated with prototype measurements.

Color calibration and correction applying linear interpolation technique for color fringe projection system

We presents an efficient color calibration approach by establishing color correspondence between source (design) color and measured color, and color correspondence is used to correct the recorded color obtained by camera. The proposed technique is applied to improve the accuracy of color fringe projection system, which combines color image segmentation and color intensity linear interpolation technique. In our approach, only 24 color patterns are projected and are recorded to set up color correspondence, the total number of projected patterns is fewer than many previous reported methods; we deduce that the relation between source color and measured color meets a linear expression within a small local color space, and the linear expression is regarded as the base of succedent color correction. That means: for a given measured color, the initial source color is first searched based on the rule of a minimum color distance, and then linear interpolation is applied to the local adjacent color space of the initial source color point to implement color correction. Experiment results validate the correctness of the proposed approach.

Neural network based color decoupling technique for color fringe profilometry

Abstract A color decoupling algorithm based on neural network is proposed to improve the performance of color fringe projection system which suffers from the complicated color coupling effect. We exploit the generalization and interpolation capabilities of a feed-forward backpropagation neural network to map from coupled color data to decoupled color data. The advantage of this algorithm is that the coupling effect is regarded as a nonlinear function which is a rational description of the color CCD camera׳s imaging principle. Theoretical analysis and the neural network training process are introduced comprehensively. Sufficient experiments are carried out to prove that the proposed method can effectively compensate for both the stripe sinusoidal property and the phase quality.

High-speed, high-accuracy 3D shape measurement based on binary color fringe defocused projection

A widely used method in high-speed 3D shape measurement, color-code fringe projection requires the projection of only one image. In traditional color-code method, the projected fringe is compounded by sinusoidal fringes, grayscale value distribution ranges from 0–255, and projection speed is limited to 120 frames/s. Consequently, measurement speed is restricted, and a nonlinear gamma of the projector exists, as well as high harmonics, which have a great influence on measurement accuracy. Binary color-code fringe defocused projection is proposed to solve the abovementioned problems. With the proposed method, projection speed can switch to tens of K frames/s because it only has two grayscale values (0 and 255). A standard sinusoidal color-code fringe can be generated by properly defocusing the binary color-code fringe, thereby overcoming the influence of nonlinear gamma and ultimately improving measurement accuracy. Experiment results verify the feasibility and superiority of the proposed method.

The visibility of color breakup and a means to reduce it.

Color breakup is an artifact seen on displays that present colors sequentially. When the eye tracks a moving object on such a display, different colors land on different places on the retina, and this gives rise to visible color fringes at the object's leading and trailing edges. Interestingly, color breakup is also observed when the eye is stationary and an object moves by. Using a novel psychophysical procedure, we measured breakup both when viewers tracked and did not track a moving object. Breakup was somewhat more visible in the tracking than in the non-tracking condition. The video frames contained three subframes, one each for red, green, and blue. We spatially offset the green and blue stimuli in the second and third subframes, respectively, to find the values that minimized breakup. In the tracking and non-tracking conditions, spatial offsets of Δx/3 in the second subframe (where Δx is the displacement of the object in one frame) and 2Δx/3 in the third eliminated breakup. Thus, this method offers a way to minimize or even eliminate breakup whether the viewer is tracking or not. We suggest ways to implement the method with real video content. We also developed a color-breakup model based on spatiotemporal filtering in color-opponent pathways in early vision. We found close agreement between the model's predictions and the experimental results. The model can be used to predict breakup for a wide variety of conditions.

3D shape measurement for moving scenes using an interlaced scanning colour camera

A Fourier transform deinterlacing algorithm (FTDA) is proposed to eliminate the blurring and dislocation of the fringe patterns on a moving object captured by an interlaced scanning colour camera in phase measuring profilometry (PMP). Every frame greyscale fringe from three colour channels of every colour fringe is divided into even and odd field fringes respectively, each of which is respectively processed by FTDA. All of the six frames deinterlaced fringes from one colour fringe form two sets of three-step phase-shifted greyscale fringes, with which two 3D shapes corresponding to two different moments are reconstructed by PMP within a frame period. The deinterlaced fringe is identical with the exact frame fringe at the same moment theoretically. The simulation and experiments show its feasibility and validity. The method doubles the time resolution, maintains the precision of the traditional phase measurement profilometry, and has potential applications in the moving and online object’s 3D shape measurements.

An improved stair phase encoding method for absolute phase retrieval

An improved phase unwrapping method is proposed to reduce the projection fringes in three-dimensional (3D) surface measurement. Color fringe patterns are generated by encoding with sinusoidal fringe and stair phase fringe patterns in red and blue channels. These color fringe patterns are projected onto the tested objects and then captured by a color CCD camera. The recorded fringe patterns are separated into their RGB components. Two groups of four-step phase-shifting fringe patterns are obtained. One group of the stripes are four sinusoidal patterns, which are used to determine the wrapped phase. The other group of stripes are four sinusoidal patterns with the codeword embedded into stair phase, whose stair changes are perfectly aligned with the 2π discontinuities of sinusoidal fringe phase, which are used to determine the fringe order for the phase unwrapping. The experimental results are analyzed and compared with those of the method in Zheng and Da (2012. Opt Express 20(22):24139–24150). The results show that the proposed method needs only four fringe patterns while having less error. It can effectively reduce the number of projection fringes and improve the measuring speed.

Color deflectometry for phase retrieval using phase-shifting methods

In this paper, we propose a technique based on a color fringe pattern used on deflectometry experiment. The advantages of using color fringe patterns together with phase shifting techniques on deflectometry experiment are presented. An experimental wavefront reconstruction of a progressive lens shows the accuracy and simplicity of these techniques used to process the deflection measurements.

Camera processing with chromatic aberration.

Since the refractive index of materials commonly used for lens depends on the wavelengths of light, practical camera optics fail to converge light to a single point on an image plane. Known as chromatic aberration, this phenomenon distorts image details by introducing magnification error, defocus blur, and color fringes. Though achromatic and apochromatic lens designs reduce chromatic aberration to a degree, they are complex and expensive and they do not offer a perfect correction. In this paper, we propose a new postcapture processing scheme designed to overcome these problems computationally. Specifically, the proposed solution is comprised of chromatic aberration-tolerant demosaicking algorithm and post-demosaicking chromatic aberration correction. Experiments with simulated and real sensor data verify that the chromatic aberration is effectively corrected.

Three-dimensional measurement of object surfaces with complex shape and color distribution based on projection of color fringe patterns

A challenging issue associated with three-dimensional (3D) fringe patterns profilometry (FPP) is the unwrapping of phase maps resulting from color object surfaces. This paper proposes a new color-projection-based 3D FPP, making use of the three primary color channels [i.e., red, green, and blue (RGB)] associated with digital projectors. One channel (e.g., red) is used for projecting sinusoidal fringes required by phase shift profilometry (PSP); the other two channels are employed for generating binary stripe patterns. In order to achieve reliable phase unwrapping, each fringe of the sinusoidal patterns is identified by a unique binary sequence. These sequences are then encoded by a channel-encoding scheme used in the area of communication. The encoded sequences are embedded in the binary coding stripe images, which are projected together with the sinusoidal patterns. The three image patterns are reflected by the object surface and captured by an RGB 3-CCD camera. The reflected sinusoidal patterns are employed to yield a wrapped phase map, and the binary stripe patterns are used to retrieve the encoded sequences, which are then decoded to yield the original binary sequences for phase unwrapping. Compared with existing color-encoded algorithms, the proposed approach uses binary codes instead of fringe color to identify the fringes, which are less sensitive to the disturbances caused by object surface color and illumination noises. Furthermore, use of the channel-coding scheme provides extra resistance to the disturbances caused by object surface color and illumination noises. Experimental results are presented to confirm the effectiveness of the proposed technique.

High-quality computational imaging through simple lenses

Modern imaging optics are highly complex systems consisting of up to two dozen individual optical elements. This complexity is required in order to compensate for the geometric and chromatic aberrations of a single lens, including geometric distortion, field curvature, wavelength-dependent blur, and color fringing. In this article, we propose a set of computational photography techniques that remove these artifacts, and thus allow for postcapture correction of images captured through uncompensated, simple optics which are lighter and significantly less expensive. Specifically, we estimate per-channel, spatially varying point spread functions, and perform nonblind deconvolution with a novel cross-channel term that is designed to specifically eliminate color fringing.

3D palmprint and hand imaging system based on full-field composite color sinusoidal fringe projection technique

Palmprint and hand shape, as two kinds of important biometric characteristics, have been widely studied and applied to human identity recognition. The existing research is based mainly on 2D images, which lose the third-dimensional information. The biological features extracted from 2D images are distorted by pressure and rolling, so the subsequent feature matching and recognition are inaccurate. This paper presents a method to acquire accurate 3D shapes of palmprint and hand by projecting full-field composite color sinusoidal fringe patterns and the corresponding color texture information. A 3D imaging system is designed to capture and process the full-field composite color fringe patterns on hand surface. Composite color fringe patterns having the optimum three fringe numbers are generated by software and projected onto the surface of human hand by a digital light processing projector. From another viewpoint, a color CCD camera captures the deformed fringe patterns and saves them for postprocessing. After compensating for the cross talk and chromatic aberration between color channels, three fringe patterns are extracted from three color channels of a captured composite color image. Wrapped phase information can be calculated from the sinusoidal fringe patterns with high precision. At the same time, the absolute phase of each pixel is determined by the optimum three-fringe selection method. After building up the relationship between absolute phase map and 3D shape data, the 3D palmprint and hand are obtained. Color texture information can be directly captured or demodulated from the captured composite fringe pattern images. Experimental results show that the proposed method and system can yield accurate 3D shape and color texture information of the palmprint and hand shape.

Colour fringe detection and correction in YC b C r colour space

Colour fringe is an artefact that mainly appears at the boundary of an object in an image, where colours change abruptly and luminance value is large. Thus, colour fringe should be corrected in a colour digital image. This study proposes a method for detection and correction of colour fringe in YC b C r colour space. The luminance value as well as gradient magnitudes/directions of YC b C r are used to detect colour fringed region. Then, chrominance values in colour fringed regions are corrected using those of pixels in the neighbouring regions along the colour fringe direction. The experimental results show the effectiveness of the proposed colour fringe detection and correction method.