Scene-based Nonuniformity Correction Algorithms Research Articles

Strong non-uniformity correction algorithm based on spectral shaping statistics and LMS.

The existence of non-uniformity in infrared detector output images is a widespread problem that significantly degrades image quality. Existing scene-based non-uniformity correction algorithms typically struggle to balance strong non-uniformity correction with scene adaptability. To address this issue, we propose a novel scene-based algorithm that leverages the frequency characteristics of the non-uniformity, combine and improve single-frame stripe removal, multi-scale statistics, and least mean square (LMS) methods. Following the "coarse-to-fine" correction process, the coarse correction stage introduces an adaptive progressive correction strategy based on Laplacian pyramids. By improving 1-D guided filtering and high-pass filtering to shape high-frequency sub-bands, non-uniformity can be well separated from the scene, effectively suppressing ghosting. In the fine correction stage, we optimize the expected image estimation and spatio-temporal adaptive learning rates based on guided filtering LMS method. To validate the efficacy of our algorithm, we conduct extensive simulation and real experiments, demonstrating its adaptability to various scene conditions and its effectiveness in correcting strong non-uniformity.

The On-Orbit Non-Uniformity Correction Method with Modulated Internal Calibration Sources for Infrared Remote Sensing Systems

The scanning infrared focal plane array (IRFPA) suffers from stripe-like non-uniformity due to the usage of many detectors, especially when working with a large time scale. Typical calibration systems tend to block the sensor aperture and expose the detectors to an on-board blackbody calibration source. They may also point at deep space. Full aperture calibration sources of this type tend to be large and expensive. To address these problems, a dynamic non-uniformity correction (NUC) method is proposed based on a modulated internal calibration device. By employing the on-board calibration device to generate a dynamic scene and fully integrating the system characteristics of the scanning IRFPA into the scene-based non-uniformity correction (SBNUC) algorithm, on-orbit high dynamic range NUC is achieved without blocking the field of view. Here we simulate an internal calibration system alternative, where a dynamic calibration signal is superimposed on the normal imagery, thus requiring no mechanisms and a smaller size. This method using this type of calibrator shows that when the sensor is pointing at deep space for calibration, it provides an effective non-uniformity correction of the imagery. After performing the proposed method, the NU of the two evaluation images was reduced from the initial 12.99% and 8.72% to less than 2%. Compared to other on-board NUC methods that require an extended reference blackbody source, this proposed approach has the advantages of miniaturization, a short calibration time, and strong adaptability.

An improved non-uniformity correction algorithm and its hardware implementation on FPGA

The Non-uniformity of Infrared Focal Plane Arrays (IRFPA) severely degrades the infrared image quality. An effective non-uniformity correction (NUC) algorithm is necessary for an IRFPA imaging and application system. However traditional scene-based NUC algorithm suffers the image blurring and artificial ghosting. In addition, few effective hardware platforms have been proposed to implement corresponding NUC algorithms. Thus, this paper proposed an improved neural-network based NUC algorithm by the guided image filter and the projection-based motion detection algorithm. First, the guided image filter is utilized to achieve the accurate desired image to decrease the artificial ghosting. Then a projection-based moving detection algorithm is utilized to determine whether the correction coefficients should be updated or not. In this way the problem of image blurring can be overcome. At last, an FPGA-based hardware design is introduced to realize the proposed NUC algorithm. A real and a simulated infrared image sequences are utilized to verify the performance of the proposed algorithm. Experimental results indicated that the proposed NUC algorithm can effectively eliminate the fix pattern noise with less image blurring and artificial ghosting. The proposed hardware design takes less logic elements in FPGA and spends less clock cycles to process one frame of image.

Survey on Some Scene Based Nonuniformity Correction Algorithms for Infrared Images

Survey on Some Scene Based Nonuniformity Correction Algorithms for Infrared Images

An evaluation method based on absolute difference to validate the performance of SBNUC algorithms

Scene-based non-uniformity correction (SBNUC) algorithms are an important part of infrared image processing; however, SBNUC algorithms usually cause two defects: (1) ghosting artifacts and (2) over-correction. In this paper, we use the absolute difference based on guided image filter (AD-GF) method to validate the performance of SBNUC algorithms. We obtain a self-separation source using the improved guided image filter to process the input image, and use the self-separation source to obtain the space-high-frequency parts of the input image and the corrected image. Finally, we use the absolute difference between the two space-high-frequency parts as the evaluation result. Based on experimental results, the AD-GF method has better robustness and can validate the performance of SBNUC algorithms even if ghosting artifacts or over-correction occur. Also the AD-GF method can measure how SBNUC algorithms perform in the time domain, it’s an effective evaluation method for SBNUC algorithm.

Nonuniformity correction for an infrared focal plane array based on diamond search block matching.

In scene-based nonuniformity correction algorithms, artificial ghosting and image blurring degrade the correction quality severely. In this paper, an improved algorithm based on the diamond search block matching algorithm and the adaptive learning rate is proposed. First, accurate transform pairs between two adjacent frames are estimated by the diamond search block matching algorithm. Then, based on the error between the corresponding transform pairs, the gradient descent algorithm is applied to update correction parameters. During the process of gradient descent, the local standard deviation and a threshold are utilized to control the learning rate to avoid the accumulation of matching error. Finally, the nonuniformity correction would be realized by a linear model with updated correction parameters. The performance of the proposed algorithm is thoroughly studied with four real infrared image sequences. Experimental results indicate that the proposed algorithm can reduce the nonuniformity with less ghosting artifacts in moving areas and can also overcome the problem of image blurring in static areas.

Scene-based correction of fixed pattern noise in hyperspectral image data using temporal reordering

Hyperspectral image data suffer from pixel-to-pixel response nonuniformity that degrades the imagery in the form of columnated striping noise. This nonuniformity, or fixed pattern noise (FPN), is typically compensated for through flat-field calibration procedures. FPN is a particularly challenging problem because the detector responsivities drift relative to one another in time, requiring that the sensor be periodically recalibrated. Both the rate and severity of the drift depend on a host of factors that result in varying levels of residual calibration error being present within the data at all times. Scene-based nonuniformity correction (SBNUC) algorithms estimate and remove FPN by exploiting content within the scene data and are often necessary to acceptably remove sensor artifacts for subpixel target detection applications. We present results from two SBNUC techniques that reduce residual FPN and improve target signal-to-clutter ratio. We make the observation that temporally reordering the data in conjunction with the use of spatial ratios or differentials results in algorithms that require a low number of temporal data samples to reliably correct for FPN with minimal introduction of image artifacts. Additionally, application of the algorithms within the principal components domain can further improve their correction ability.

A scene-based nonuniformity correction algorithm based on fuzzy logic

Scene-based nonuniformity correction algorithms based on the LMS adaptive filter are quite efficient to reduce the fixed pattern noise in infrared images. They are famous for their low cost of computation and storage recourses. Unfortunately, ghosting artifacts can be easily introduced in edge areas when the inter-frame motion slows. In this paper, a gated scene-based nonuniformity correction algorithm is proposed. A novel low-pass filter based on the fuzzy logic is proposed to estimate the true scene radiation as the desired signal in the LMS adaptive filter. The fuzzy logic can also evaluate the probability that a pixel and its locals belong to edge areas. Then the update of the correction parameters for the pixels in edge areas can be gated. The experiment results show that our method is reliable and the ghosting artifacts are reduced.

Improving feedback-integrated scene cancellation nonuniformity correction through optimal selection of available camera motion

Scene-based nonuniformity correction (SBNUC) techniques provide a means of identifying and correcting focal plane array nonuniformity (NU) through algorithmic analysis of the camera output. SBNUC techniques rely almost universally on camera motion to provide a means of separating the scene from the NU pattern. A simulation is developed that is used to explore the role and effect of camera motion on two representative registration-based SBNUC algorithms: interframe registration-based least mean square (IRLMS) by Zuo et al. and feedback-integrated scene-cancellation (FiSC) by Black and Tyo. The effect of camera motion velocity and direction between frames is examined. The high spatial frequency portion of NU is shown to be corrected by both IRLMS and FiSC, and this correction is relatively indifferent to nonzero camera motion parameters. The FiSC algorithm was specifically designed to incorporate the low spatial frequency component into registration-based SBNUC, but demonstrates a strong dependency on camera motion. Techniques for mitigation of camera motion parameter effects through tradespace and buffering are presented and tested. With proper mitigation and camera motion, FiSC is shown to correct most high and low spatial frequency NU with fewer than 100 framepairs repeatedly processed using techniques suitable for real-time processing implementation.

Fast iterative adaptive nonuniformity correction with gradient minimization for infrared focal plane arrays

A fast scene-based nonuniformity correction algorithm is proposed for fixed-pattern noise removal in infrared focal plane array imagery. Based on minimization of L0 gradient of the estimated irradiance, the correction function is optimized through correction parameters estimation via iterative optimization strategy. When applied to different real IR data, the proposed method provides enhanced results with good visual effect, making a good balance between nonuniformity correction and details preservation. Comparing with other excellent approaches, this algorithm can accurately estimate the irradiance rapidly with fewer ghosting artifacts.

Feedback-integrated scene cancellation scene-based nonuniformity correction algorithm

A new registration-based scene-based nonuniformity correction (SBNUC) technique called the feedback-integrated scene cancellation (FiSC) method is introduced, which demonstrates an ability to correct both high- and low-spatial frequency nonuniformity (NU) in infrared focal plane arrays. The theory of scene-cancellation is further developed to include a referencing mechanism that allows spatially correlated NU to be corrected, and a practical method of application is developed. The algorithm is suitable for implementation in a real-time processing environment such as a digital signal processor. A new metric called normalized root mean-squared error for quantifying SBNUC performance is introduced and applied. When applied to real data from a cooled HgTeCd focal plane, the FiSC algorithm outperforms other SBNUC algorithms considered when provided with accurate frame-to-frame image registration. An SBNUC simulation is described and applied to several SBNUC algorithms. When the most realistic case including both high- and low-spatial frequency NU is simulated, the FiSC algorithm outperforms all others tested.

基于扩展全变分的红外焦平面阵列非均匀性校正方法

Traditional scene-based nonuniformity correction algorithms for infrared focal plane array suffer from two major drawbacks: slow convergence rate and low correction accuracy. Aiming at these problems, a new method based on extended total variation is proposed to correct the nonuniformity for infrared focal plane arrays. Based on the analysis of total variation-based de-noising performance, the scope of total variation is extended for motional infrared image sequences. By minimizing the total variation of corrected images, iterative formula to compute the gain and offset factors is obtained using steepest descent method. For eliminating the ghosting effect, an adaptive threshold method is designed. The experiments show that compared with the existing methods, this method can effectively remove the noise in original infrared images and largely retain image information at the same time. The image quality is therefore improved.

Scene-based Nonuniformity Correction Algorithm Based on Temporal Median Filter

Scene-based nonuniformity correction techniques for infrared focal-plane arrays have been widely considered as a key technology, and various algorithms have been proposed to compensate for fixed-pattern noise. However, the existed algorithms' capability is always restricted by the problems of convergence speed and ghosting artifacts. In this paper, an effective scene-based nonuniformity correction method is proposed to solve these problems. The algorithm is an improvement over the constant statistics method and a temporal median is utilized with the Gaussian kernel to estimate the nonuniformity parameters. Also theoretical analysis is conducted to demonstrate that effective ghosting artifacts elimination and superior convergence speed can be obtained with the proposed method. Finally, the performance of the proposed technique is tested with infrared image sequences with simulated nonuniformity and with infrared imagery with real nonuniformity. The results show the proposed method is able to estimate each detector's gain and to offset reliably and that it performs better in increasing convergence speed and reducing ghosting artifacts compared with the conventional techniques.

Integrations of both high resolution reconstruction and non-uniformity correction of infrared image sequence based on regularized maximum a posteriori

During thermal imaging, it is vital importance to obtain high-performance images that non-uniformity noise in infrared focal plane array (IRFPA) should be eliminatined and the imaging spatial resolution should be improved as far as possible. Processing algorithms related to both of them have been hot topics, and attracted more and more attention of researchers. Considering that both high-resolution restoration algorithm of image sequences and scene-based non-uniformity correction (NUC) algorithm require multi-frame image sequences of target scene with micro-displacement, an integrated processing algorithm of high-resolution image reconstruction and NUC of infrared image sequences based on regularized maximum a posteriori (MAP) is proposed. Results of simulated and experimental thermal image suggested that this algorithm can suppress random noise and eliminate non-uniformity noise effectively, and high-resolution thermal imaging can be achieved.

Scene-based nonuniformity correction algorithm based on interframe registration

In this paper, we present a simple and effective scene-based nonuniformity correction (NUC) method for infrared focal plane arrays based on interframe registration. This method estimates the global translation between two adjacent frames and minimizes the mean square error between the two properly registered images to make any two detectors with the same scene produce the same output value. In this way, the accumulation of the registration error can be avoided and the NUC can be achieved. The advantages of the proposed algorithm lie in its low computational complexity and storage requirements and ability to capture temporal drifts in the nonuniformity parameters. The performance of the proposed technique is thoroughly studied with infrared image sequences with simulated nonuniformity and infrared imagery with real nonuniformity. It shows a significantly fast and reliable fixed-pattern noise reduction and obtains an effective frame-by-frame adaptive estimation of each detector's gain and offset.

Minimum mean square error method for stripe nonuniformity correction

Stripe nonuniformity is very typical in line infrared focal plane (IRFPA) and uncooled starring IRFPA. We develop the minimum mean square error (MMSE) method for stripe nonuniformity correction (NUC). The goal of the MMSE method is to determine the optimal NUC parameters for making the corrected image the closest to the ideal image. Moreover, this method can be achieved in one frame, making it more competitive than other scene-based NUC algorithms. We also demonstrate the calibration results of our algorithm using real and virtual infrared image sequences. The experiments verify the positive effect of our algorithm.

Adaptive convergence nonuniformity correction algorithm

Nowadays, convergence and ghosting artifacts are common problems in scene-based nonuniformity correction (NUC) algorithms. In this study, we introduce the idea of space frequency to the scene-based NUC. Then the convergence speed factor is presented, which can adaptively change the convergence speed by a change of the scene dynamic range. In fact, the convergence speed factor role is to decrease the statistical data standard deviation. The nonuniformity space relativity characteristic was summarized by plenty of experimental statistical data. The space relativity characteristic was used to correct the convergence speed factor, which can make it more stable. Finally, real and simulated infrared image sequences were applied to demonstrate the positive effect of our algorithm.

Ghosting reduction in scene-based nonuniformity correction of infrared image sequences

Scene-based adaptive nonuniformity correction (NUC) is currently being applied to achieve higher performance in infrared imaging systems. However, almost all scene-based NUC algorithms cause the production of ghosting artifacts over output images. Based on constant-statistics theory, we propose a novel threshold self-adaptive ghosting reduction algorithm to improve the space low-pass and temporal high-pass (SLPTHP) NUC technique. The correction parameters of the previous frame are regarded as thresholds to compute new correction parameters. Experimental results show that the proposed algorithm can obtain a satisfactory performance in reducing unwanted ghosting artifacts.

Space low-pass and temporal high-pass nonuniformity correction algorithm

Nowadays, almost all scene-based nonuniformity correction (NUC) algorithms have the same shortcoming: a low convergence speed. This shortcoming produces ghosting artifacts. In this paper, we will start by discussing the traditional temporal high-pass NUC algorithm, and then combine the space frequency and temporal frequency. This combination will produce a new algorithm called the space low-pass and temporal high-pass NUC algorithm. The kernel idea of this algorithm is to eliminate the nonuniformity’s high-space-frequency part and retain the nonuniformity’s low-space-frequency part. Moreover, the high-space-frequency part’s processing is controllable, which markedly increases convergence speed. These features make our algorithm’s convergence speed so high that processed images have almost no ghosting artifacts.

Scene-based nonuniformity correction technique for infrared focal-plane arrays

A scene-based nonuniformity correction algorithm is presented to compensate for the gain and bias nonuniformity in infrared focal-plane array sensors, which can be separated into three parts. First, an interframe-prediction method is used to estimate the true scene, since nonuniformity correction is a typical blind-estimation problem and both scene values and detector parameters are unavailable. Second, the estimated scene, along with its corresponding observed data obtained by detectors, is employed to update the gain and the bias by means of a line-fitting technique. Finally, with these nonuniformity parameters, the compensated output of each detector is obtained by computing a very simple formula. The advantages of the proposed algorithm lie in its low computational complexity and storage requirements and ability to capture temporal drifts in the nonuniformity parameters. The performance of every module is demonstrated with simulated and real infrared image sequences. Experimental results indicate that the proposed algorithm exhibits a superior correction effect.