Structure Tensor Total Variation Research Articles

Weighted structure tensor total variation for image denoising

Weighted structure tensor total variation for image denoising

Joint image pansharpening and registration via structure tensor total variation regularization

Joint image pansharpening and registration via structure tensor total variation regularization

Structure-Awareness SAR Imagery by Exploiting Structure Tensor TV Regularization Under Multitask Learning Framework

Conventional sparsity-driven synthetic aperture radar (SAR) imagery often encounters the problem of loss of structural features in weak scattering. Although there are algorithms that focus on structure enhancement, no proper balance between accuracy and efficiency can be achieved. In this article, a novel feature enhancement algorithm, named structure-awareness SAR (SA-SAR), is proposed by exploiting an emerging regularizer of structure tensor total variation (STV). By imposing the STV norm onto the prior of the scenes or targets to be imaged, the intended structure feature can be analytically solved under the proximal algorithm. More specifically, the regularization method is developed within the alternating direction method of multipliers (ADMM) framework, where closed-form proximity operators can be derived. Due to the ADMM framework, it facilitates to incorporate with more features to be enhanced in a fully synergistic way. Therefore, the <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <tex-math notation="LaTeX">$\ell _{1}$ </tex-math></inline-formula> and entropy norms are involved so that the sparse and focusing features can be enhanced accordingly. Considering the coherence of the SAR data, a linear proximal operator is developed within the multitask learning framework. The unavoidable error propagations can be alleviated in a great extent. In such cases, the proposed algorithm is superior in terms of convergence and efficiency. To facilitate the implementation and computation, the STV proximal mapping is optimized under the Vieta theorem. Finally, both simulated and raw SAR data are applied to verify the effectiveness of the proposed algorithm. Comparisons with conventional algorithms are carried out to show the superiority of the proposed algorithm.

Adaptive direction-guided structure tensor total variation

Direction-guided structure tensor total variation (DSTV) is a recently proposed regularization term that aims at increasing the sensitivity of the structure tensor total variation (STV) to the changes towards a predetermined direction. Despite of the plausible results obtained on the uni-directional images, the DSTV model is not applicable to the arbitrary (multi-directional and/or partly nondirectional) images. In this study, we build a two-stage denoising framework that brings adaptivity to the DSTV based denoising. We design a DSTV-like alternative to STV, which encodes the first-order information within a local neighborhood under the guidance of spatially varying directional descriptors (i.e., orientation and the dose of anisotropy). In order to estimate those descriptors, we propose an efficient preprocessor that captures the local geometry based on the structure tensor. Through the extensive experiments, we demonstrate how beneficial the involvement of the directional information in STV is, by comparing the proposed method with the state-of-the-art analysis-based denoising models, both in terms of quality and computational efficiency.

Robust Multi-Frame Super-Resolution Based on Adaptive Half-Quadratic Function and Local Structure Tensor Weighted BTV.

It is difficult to improve image resolution in hardware due to the limitations of technology and too high costs, but most application fields need high resolution images, so super-resolution technology has been produced. This paper mainly uses information redundancy to realize multi-frame super-resolution. In recent years, many researchers have proposed a variety of multi-frame super-resolution methods, but it is very difficult to preserve the image edge and texture details and remove the influence of noise effectively in practical applications. In this paper, a minimum variance method is proposed to select the low resolution images with appropriate quality quickly for super-resolution. The half-quadratic function is used as the loss function to minimize the observation error between the estimated high resolution image and low-resolution images. The function parameter is determined adaptively according to observation errors of each low-resolution image. The combination of a local structure tensor and Bilateral Total Variation (BTV) as image prior knowledge preserves the details of the image and suppresses the noise simultaneously. The experimental results on synthetic data and real data show that our proposed method can better preserve the details of the image than the existing methods.

Nonlocal adaptive direction-guided structure tensor total variation for image recovery

A common strategy in variational image recovery is utilizing the nonlocal self-similarity property, when designing energy functionals. One such contribution is nonlocal structure tensor total variation (NLSTV), which lies at the core of this study. This paper is concerned with boosting the NLSTV regularization term through the use of directional priors. More specifically, NLSTV is leveraged so that, at each image point, it gains more sensitivity in the direction that is presumed to have the minimum local variation. The actual difficulty here is capturing this directional information from the corrupted image. In this regard, we propose a method that employs anisotropic Gaussian kernels to estimate directional features to be later used by our proposed model. The experiments validate that our entire two-stage framework achieves better results than the NLSTV model and two other competing local models, in terms of visual and quantitative evaluation.

Low Dose CT Image Reconstruction Based on Structure Tensor Total Variation Using Accelerated Fast Iterative Shrinkage Thresholding Algorithm.

Low dose computed tomography (CT) has drawn much attention in the medical imaging field because of its ability to reduce the radiation dose. Recently, statistical iterative reconstruction (SIR) with total variation (TV) penalty has been developed to low dose CT image reconstruction. Nevertheless, the TV penalty has the drawback of creating blocky effects in the reconstructed images. To overcome the limitations of TV, in this paper we firstly introduce the structure tensor total variation (STV1) penalty into SIR framework for low dose CT image reconstruction. Then, an accelerated fast iterative shrinkage thresholding algorithm (AFISTA) is developed to minimize the objective function. The proposed AFISTA reconstruction algorithm was evaluated using numerical simulated low dose projection based on two CT images and realistic low dose projection data of a sheep lung CT perfusion. The experimental results demonstrated that our proposed STV1-based algorithm outperform FBP and TV-based algorithm in terms of removing noise and restraining blocky effects.

Structure tensor total variation for CBCT reconstruction

The total variation (TV) regularization has been widely used in statistically iterative cone-beam computed tomography (CBCT) reconstruction, showing ability to preserve object edges. However, the TV regularization can also produce staircase effect and tend to over-smooth the reconstructed images due to its piecewise constant assumption. In this study, we proposed to use the structure tensor total variation (STV) that penalizes the eigenvalues of the structure tensor for CBCT reconstruction. The STV penalty extends the TV penalty, with many important properties maintained such as convexity and rotation and translation invariance. The STV penalty utilizes gradient information more effectively and has a stronger ability to capture local image structural variation. The objective function was constructed with the penalized weighted least-square (PWLS) strategy and the gradient descent (GD) method was used to optimize the objective function. Besides, we investigated whether the norms involved in the STV penalty affected the reconstruction performance and found that the l1-norm gave the better performance than the l2-norm and l∞-norm. We also examined performance of the STV penalties constructed using different kernel functions and found that the STV with the Gaussian kernel had the best performance, and the STVs with Uniform, Logistic, and Sigmoid kernels had similar performance to each other. We evaluated our reconstruction method with the STV penalty on computer simulated phantoms and physical phantoms. The results demonstrated that STV led to better reconstruction performance than TV, both visually and quantitatively. For the Catphan 600 physical phantom, the STV1 penalty was 175% and 623% better than the low-dose FDK and the high-dose FDK, and 14% better than the TV penalty at the matched noise level, according to the average contrast-to-noise ratio (CNR); while for the Compressed Sensing simulation phantom, the peak signal to noise ratio (PSNR) of reconstructed results using STV1, STV2, and STV∞ were 40.67 dB, 38.72 dB, and 37.40 dB, respectively, all being significantly better than 36.84 dB using TV.

Low-dose dynamic myocardial perfusion CT image reconstruction using pre-contrast normal-dose CT scan induced structure tensor total variation regularization

Dynamic myocardial perfusion CT (DMP-CT) imaging provides quantitative functional information for diagnosis and risk stratification of coronary artery disease by calculating myocardial perfusion hemodynamic parameter (MPHP) maps. However, the level of radiation delivered by dynamic sequential scan protocol can be potentially high. The purpose of this work is to develop a pre-contrast normal-dose scan induced structure tensor total variation regularization based on the penalized weighted least-squares (PWLS) criteria to improve the image quality of DMP-CT with a low-mAs CT acquisition. For simplicity, the present approach was termed as ‘PWLS-ndiSTV’. Specifically, the ndiSTV regularization takes into account the spatial-temporal structure information of DMP-CT data and further exploits the higher order derivatives of the objective images to enhance denoising performance. Subsequently, an effective optimization algorithm based on the split-Bregman approach was adopted to minimize the associative objective function. Evaluations with modified dynamic XCAT phantom and preclinical porcine datasets have demonstrated that the proposed PWLS-ndiSTV approach can achieve promising gains over other existing approaches in terms of noise-induced artifacts mitigation, edge details preservation, and accurate MPHP maps calculation.

A nonconvex nonsmooth regularization method with structure tensor total variation

In this paper, a novel regularization method for image restoration and reconstruction is introduced which is accomplished by adopting a nonconvex nonsmooth penalty that depends on the eigenvalues of structure tensor of the underlying image. At first, an alternating minimization scheme is developed in which the problem can be decomposed into three subproblems, two of them are convex and the remaining one is smooth. Then, the convergence of the sequence which generate by the alternating minimization algorithm is proved. Finally, the efficient performance of the proposed method is demonstrated through experimental results for both grayscale and vector-value images.

Structure tensor total variation-regularized weighted nuclear norm minimization for hyperspectral image mixed denoising

Several band-by-band TV-regularized low rank based models have been proposed for Hyperspectral image (HSI) mixed denoising, which can exploit the spectral and spatial information simultaneously. However, these methods may lead to large fluctuations due to the noise and also create oil painting effects. Moreover, they only exploit the spatial information in a separated manner, which may negatively affect the performance of removing the noise with obvious structure, e.g., the deadline noise. To cope with the above problems, a novel Structure tensor Total Variation (STV)-regularized Weighted Nuclear Norm Minimization (STWNNM) model is proposed. To obtain the desired performance, three issues are included. First, the Weighted Nuclear Norm Minimization (WNNM) is adopted to utilize the spectral information by shrinking different eigenvalues with different weights. Second, the structure tensor is used to exploit the global spatial structure information within all bands simultaneously. Third, a convolution kernel is incorporated to obtain more local structure information from neighborhood pixels. Then, two different optimization strategies are proposed to solve the derived optimization problem. Both simulated and real data experiments illustrate the higher performance of the proposed STWNNM for HSI mixed denoising, by comparing with other state-of-the-art TV-regularized low rank based methods.

Penalized weighted least-squares approach for multienergy computed tomography image reconstruction via structure tensor total variation regularization

Multienergy computed tomography (MECT) allows identifying and differentiating different materials through simultaneous capture of multiple sets of energy-selective data belonging to specific energy windows. However, because sufficient photon counts are not available in each energy window compared with that in the whole energy window, the MECT images reconstructed by the analytical approach often suffer from poor signal-to-noise and strong streak artifacts. To address the particular challenge, this work presents a penalized weighted least-squares (PWLS) scheme by incorporating the new concept of structure tensor total variation (STV) regularization, which is henceforth referred to as ‘PWLS-STV’ for simplicity. Specifically, the STV regularization is derived by penalizing higher-order derivatives of the desired MECT images. Thus it could provide more robust measures of image variation, which can eliminate the patchy artifacts often observed in total variation (TV) regularization. Subsequently, an alternating optimization algorithm was adopted to minimize the objective function. Extensive experiments with a digital XCAT phantom and meat specimen clearly demonstrate that the present PWLS-STV algorithm can achieve more gains than the existing TV-based algorithms and the conventional filtered backpeojection (FBP) algorithm in terms of both quantitative and visual quality evaluations.

Cerebral perfusion computed tomography deconvolution via structure tensor total variation regularization.

Cerebral perfusion computed tomography (PCT) imaging as an accurate and fast acute ischemic stroke examination has been widely used in clinic. Meanwhile, a major drawback of PCT imaging is the high radiation dose due to its dynamic scan protocol. The purpose of this work is to develop a robust perfusion deconvolution approach via structure tensor total variation (STV) regularization (PD-STV) for estimating an accurate residue function in PCT imaging with the low-milliampere-seconds (low-mAs) data acquisition. Besides modeling the spatio-temporal structure information of PCT data, the STV regularization of the present PD-STV approach can utilize the higher order derivatives of the residue function to enhance denoising performance. To minimize the objective function, the authors propose an effective iterative algorithm with a shrinkage/thresholding scheme. A simulation study on a digital brain perfusion phantom and a clinical study on an old infarction patient were conducted to validate and evaluate the performance of the present PD-STV approach. In the digital phantom study, visual inspection and quantitative metrics (i.e., the normalized mean square error, the peak signal-to-noise ratio, and the universal quality index) assessments demonstrated that the PD-STV approach outperformed other existing approaches in terms of the performance of noise-induced artifacts reduction and accurate perfusion hemodynamic maps (PHM) estimation. In the patient data study, the present PD-STV approach could yield accurate PHM estimation with several noticeable gains over other existing approaches in terms of visual inspection and correlation analysis. This study demonstrated the feasibility and efficacy of the present PD-STV approach in utilizing STV regularization to improve the accuracy of residue function estimation of cerebral PCT imaging in the case of low-mAs.

Structure Tensor Total Variation

We introduce a novel generic energy functional that we employ to solve inverse imaging problems within a variational framework. The proposed regularization family, termed as structure tensor total variation (STV), penalizes the eigenvalues of the structure tensor and is suitable for both grayscale and vector-valued images. It generalizes several existing variational penalties, including the total variation seminorm and vectorial extensions of it. Meanwhile, thanks to the structure tensor's ability to capture first-order information around a local neighborhood, the STV functionals can provide more robust measures of image variation. Further, we prove that the STV regularizers are convex while they also satisfy several invariance properties w.r.t. image transformations. These properties qualify them as ideal candidates for imaging applications. In addition, for the discrete version of the STV functionals we derive an equivalent definition that is based on the patch-based Jacobian operator, a novel linear operator which extends the Jacobian matrix. This alternative definition allow us to derive a dual problem formulation. The duality of the problem paves the way for employing robust tools from convex optimization and enables us to design an efficient and parallelizable optimization algorithm. Finally, we present extensive experiments on various inverse imaging problems, where we compare our regularizers with other competing regularization approaches. Our results are shown to be systematically superior, both quantitatively and visually.