A new image multi-level-inpainting method

  • Abstract
  • Literature Map
  • Similar Papers
Abstract
Translate article icon Translate Article Star icon

Although the Total Variation (TV) model has good performance in the image inpainting including both maintaining damaged images' edge and reducing numerical calculation, it should be improved in the inpainting domain with rich texture. In this paper, an image multi-level-inpainting method based on TV model and texture synthesis scheme is proposed. It is the main research topic to improve the visual result of inpainted images with scratches including rich texture. At the first inpainting level, damaged images are calculated following the TV model, and then the patch-based texture synthesis scheme is used to improve the inpainted results of rich texture domain in the first level. Experimental results prove that the method has better performance in restoring an incomplete 2-D image in every detail that it looks more `complete' and `natural'.

Similar Papers
  • Research Article
  • Cite Count Icon 3
  • 10.1007/s11265-010-0451-3
Total Variation for Image Restoration with Smooth Area Protection
  • Feb 16, 2010
  • Journal of Signal Processing Systems
  • Chuangxin Wang + 1 more

The problem for image restoration is usually reduced to a constraint optimization problem. Different choice of optimization operator leads to various restoration models, e.g. least squares model and original total variation (TV) model. The TV model and its modified version can efficiently preserve the edge of the restored image well, but there exist obvious staircases in smooth area of the restored image. To reduce those staircases, we propose a new modified TV model, by adding a constraint term for smooth area protection as a penalty function. The numerical experiment shows our model can not only preserve the edge as well as TV model, but also efficiently reduce the staircase appearing in the smooth areas. Furthermore, It is shown that the restored image by our model has higher signal-to-noise ratio, less mean square error and better visual effect than those by the least squares model and by the TV models.

  • Research Article
  • Cite Count Icon 53
  • 10.1109/jstsp.2021.3058503
Tensor Low-Rank Constraint and $l_0$ Total Variation for Hyperspectral Image Mixed Noise Removal
  • Feb 13, 2021
  • IEEE Journal of Selected Topics in Signal Processing
  • Minghua Wang + 2 more

Several methods based on Total Variation (TV) have been proposed for Hyperspectral Image (HSI) denoising. However, the TV terms of these methods just use various l <sub xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">1</sub> norms and penalize image gradient magnitudes, having a negative influence on the preprocessing of HSI denoising and further HSI classification task. In this paper, a novel l <sub xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">0</sub> Total Variation (l <sub xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">0</sub> TV) is first introduced and analyzed for the HSI noise removal framework to preserve more information for classification. We propose a novel Tensor low-rank constraint and l <sub xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">0</sub> Total Variation (TLR-l <sub xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">0</sub> TV) model in this paper. l <sub xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">0</sub> TV directly controls the number of non-zero gradients and focuses on recovering the sharp image edges. The spectral-spatial information among all bands is exploited uniformly for removing mixed noise, which facilitates the subsequent classification after denoising. Including the Weighted Sum of Weighted Nuclear Norm (WSWNN) and the Weighted Sum of Weighted Tensor Nuclear Norm (WSWTNN), we propose two TLR-l <sub xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">0</sub> TV-based algorithms, namely WSWNN-l <sub xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">0</sub> TV and WSWTNN-l <sub xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">0</sub> TV. The Alternating Direction Method of Multipliers (ADMM) and the Augmented Lagrange Multiplier (ALM) are employed to solve the l <sub xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">0</sub> TV model and TLR-l <sub xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">0</sub> TV model, respectively. In both simulated and real data, the proposed models achieve superior performances in mixed noise removal of HSI. Especially, HSI classification accuracy is improved more effectively after denoising by the proposed TLR-l <sub xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">0</sub> TV method.

  • Research Article
  • 10.4028/www.scientific.net/amm.278-280.1383
A New Denoising Approach for Optical Coherence Tomography Image Based on the Total Variational Model
  • Jan 1, 2013
  • Applied Mechanics and Materials
  • Jing Liu + 2 more

The traditional total variational (TV) model performs well for most noise image. However, the method will lose some information and details for the image which has rich texture and tiny boundary. Therefore, according to the requirements of the OCT pearl image, a novel denoising approach based on the TV model is proposed in this paper. This method combined the adaptive image denoising model and the novel fidelity term. Numerical experiments show that the proposed method can remove the noise while preserving significant image details. At pearl OCT image the method achieves at least 0.1dB gain over other existing denoising methods for Signal-Noise Ratio (SNR) measurement and Peak Signal-Noise Ratio (PSNR) measurement.

  • PDF Download Icon
  • Research Article
  • Cite Count Icon 12
  • 10.3390/fractalfract6090508
A Study of Adaptive Fractional-Order Total Variational Medical Image Denoising
  • Sep 11, 2022
  • Fractal and Fractional
  • Yanzhu Zhang + 3 more

Following the traditional total variational denoising model in removing medical image noise with blurred image texture details, among other problems, an adaptive medical image fractional-order total variational denoising model with an improved sparrow search algorithm is proposed in this study. This algorithm combines the characteristics of fractional-order differential operators and total variational models. The model preserves the weak texture region of the image improvement based on the unique amplitude-frequency characteristics of the fractional-order differential operator. The order of the fractional-order differential operator is adaptively determined by the improved sparrow search algorithm using both the sine search strategy and the diversity variation processing strategy, which can greatly improve the denoising ability of the fractional-order differential operator. The experimental results reveal that the model not only achieves the adaptivity of fractional-order total variable differential order, but also can effectively remove noise, preserve the texture structure of the image to the maximum extent, and improve the peak signal-to-noise ratio of the image; it also displays favorable prospects for applications in medical image denoising.

  • Research Article
  • Cite Count Icon 1
  • 10.1155/2020/3936975
Speckle Noise Removal by Energy Models with New Regularization Setting
  • Jul 20, 2020
  • Journal of Function Spaces
  • Bo Chen + 2 more

In this paper, we introduce two novel total variation models to deal with speckle noise in ultrasound image in order to retain the fine details more effectively and to improve the speed of energy diffusion during the process. Firstly, two new convex functions are introduced as regularization term in the adaptive total variation model, and then, the diffusion performances of Hypersurface Total Variation (HYPTV) model and Logarithmic Total Variation (LOGTV) model are analyzed mathematically through the physical characteristics of local coordinates. We have shown that the larger positive parameter in the model is set, the greater energy diffusion speed appears to be, but it will cause the image to be too smooth that required adequate attention. Numerical experimental results show that our proposed LOGTV model for speckle noise removal is superior to traditional models, not only in visual effect but also in quantitative measures.

  • Conference Article
  • 10.1117/12.2587811
Maximum entropy method for imaging through turbid medium
  • Mar 12, 2021
  • Seventh Symposium on Novel Photoelectronic Detection Technology and Applications
  • Huang Mingwei + 2 more

Imaging through turbid medium has many potential applications such as looking through clouds, seeing into seawater and observing through biological tissues. The transmission matrix (TM) method is one of the main imaging technologies that has potential in imaging of large targets. With aid of pre-measured TM, several optimization models are proposed to recover targets from speckle patterns, including &ell;<sub>2</sub> norm optimization model, sparse representation (SR) framework and total variation (TV) model. However, the solution of &ell;<sub>2</sub> norm optimization model contains large reconstruction noise, while the SR framework and TV model are two kinds of compressive sensing strategies, which require that the targets are sparse. In this paper, in order to image non-sparse targets and suppress the reconstruction noise, we apply the maximum entropy method (MEM) model to recover the target images from speckle patterns. Simulation results show that, for non-sparse target, the MEM model has better reconstruction performance under different noise levels compared with the TV model. For example, peak signal-to-noise ratio (PSNR) and correlation coefficient (CC) of images reconstructed by MEM model at SNR=15 dB are comparable with those by TV model at SNR=35 dB.

  • Book Chapter
  • Cite Count Icon 1
  • 10.1007/978-981-10-0539-8_16
An Algorithm for Image Denoising Based on Adaptive Total Variation
  • Jan 1, 2016
  • Guo Xiaoling + 2 more

Although the traditional TV (Total Variation) model owns excellent image denoising ability, there are staircase effect problems for TV model. In this article, two detection operators for staircase effect problem are proposed. The staircase effect problem can be solved effectively by introducing two operators into traditional TV model. On the basis, it proposes an adaptive total variation model for image denoising. When dealing with image edge, it can still use the traditional TV model. Its purpose is to maintain the advantages in edge protection for TV model. When it is in the smooth area of image, linear diffusion is used to avoid the staircase effect.

  • Research Article
  • Cite Count Icon 1
  • 10.3233/xst-221326
Truncated total variation in fractional B-spline wavelet transform for micro-CT image denoising.
  • May 11, 2023
  • Journal of X-Ray Science and Technology
  • Dongjiang Ji + 2 more

In medical applications, computed tomography (CT) is widely used to evaluate various sample characteristics. However, image quality of CT reconstruction can be degraded due to artifacts. To propose and test a truncated total variation (truncation TV) model to solve the problem of large penalties for the total variation (TV) model. In this study, a truncated TV image denoising model in the fractional B-spline wavelet domain is developed to obtain the best solution. The method is validated by the analysis of CT reconstructed images of actual biological Pigeons samples. For this purpose, several indices including the peak signal-to-noise ratio (PSNR), structural similarity index (SSIM) and mean square error (MSE) are used to evaluate the quality of images. Comparing to the conventional truncated TV model that yields 22.55, 0.688 and 361.17 in PSNR, SSIM and MSE, respectively, using the proposed fractional B-spline-truncated TV model, the computed values of these evaluation indices change to 24.24, 0.898 and 244.98, respectively, indicating substantial reduction of image noise with higher PSNR and SSIM, and lower MSE. Study results demonstrate that compared with many classic image denoising methods, the new denoising algorithm proposed in this study can more effectively suppresses the reconstructed CT image artifacts while maintaining the detailed image structure.

  • PDF Download Icon
  • Research Article
  • Cite Count Icon 6
  • 10.1155/2020/5382106
A Doubly Constrained TV Algorithm for Image Reconstruction
  • Jan 20, 2020
  • Mathematical Problems in Engineering
  • Zhiwei Qiao + 3 more

Purpose. The total variation (TV) minimization algorithm is an effective image reconstruction algorithm capable of accurately reconstructing images from sparse and/or noisy data. The TV model consists of two terms: a data fidelity term and a TV regularization term. Two constrained TV models, data divergence-constrained TV minimization (DDcTV) and TV-constrained data divergence minimization (TVcDM), have been successfully applied to computed tomography (CT) and electron paramagnetic resonance imaging (EPRI). In this work, we propose a new constrained TV model, a doubly constrained TV (dcTV) model, which has the potential to further improve the reconstruction accuracy for the two terms which are both of constraint forms. Methods. We perform an inverse crime study to validate the model and its Chambolle-Pock (CP) solver and characterize the performance of the dcTV-CP algorithm in the context of CT. To demonstrate the superiority of the dcTV model, we compare the convergence rate and the reconstruction accuracy with the DDcTV and TVcDM models via simulated data. Results and Conclusions. The performance-characterizing study shows that the dcTV-CP algorithm is an accurate and convergent algorithm, with the model parameters impacting the reconstruction accuracy and the algorithm parameters impacting the convergence path and rate. The comparison studies show that the dcTV-CP algorithm has a relatively fast convergence rate and can achieve higher reconstruction accuracy from sparse projections or noisy projections relative to the other two single-constrained TV models. The knowledge and insights gained in the work may be utilized in the application of the new model in other imaging modalities including divergence-beam CT, magnetic resonance imaging (MRI), positron emission tomography (PET), and EPRI.

  • Conference Article
  • Cite Count Icon 10
  • 10.1109/igarss.2014.6947126
Remote sensing image super-resolution via regional spatially adaptive total variation model
  • Jul 1, 2014
  • Qiangqiang Yuan + 3 more

Total variation has been used as a popular and effective image prior model in the regularization-based image processing fields. However, as the total variation model favors a piecewise constant solution, the processing result under high noise intensity in the flat regions of the image is often poor, and some “pseudo-edges” are produced. In this paper, we develop a regional spatially adaptive total variation (RSATV) model. Firstly, the spatial information is extracted based on each pixel, and then two filtering processes are respectively added to suppress the effect of “pseudo-edges”. After that, the spatial information weight is constructed and classified with kmeans clustering, and the regularization strength in each region is controlled by the clustering center value. The experimental results, on both simulated and real datasets, show that the proposed approach can effectively reduce the “pseudo-edges” of the total variation regularization in the flat regions, and maintain the partial smoothness of the highresolution image. More importantly, compared with the traditional pixel-based spatial information adaptive approach, the proposed region-based spatial information adaptive total variation model can better avoid the effect of noise on the spatial information extraction, and maintains robustness with changes in the noise intensity in the super-resolution process. Index Terms—Super-resolution, total variation, regional spatially adaptive, majorization-minimization

  • Conference Article
  • 10.1117/12.2286818
Research on compressive sensing reconstruction algorithm based on total variation model
  • Dec 18, 2017
  • Yuxuan Gao + 3 more

Compressed sensing for breakthrough Nyquist sampling theorem provides a strong theoretical , making compressive sampling for image signals be carried out simultaneously. In traditional imaging procedures using compressed sensing theory, not only can it reduces the storage space, but also can reduce the demand for detector resolution greatly. Using the sparsity of image signal, by solving the mathematical model of inverse reconfiguration, realize the super-resolution imaging. Reconstruction algorithm is the most critical part of compression perception, to a large extent determine the accuracy of the reconstruction of the image.The reconstruction algorithm based on the total variation (TV) model is more suitable for the compression reconstruction of the two-dimensional image, and the better edge information can be obtained. In order to verify the performance of the algorithm, Simulation Analysis the reconstruction result in different coding mode of the reconstruction algorithm based on the TV reconstruction algorithm. The reconstruction effect of the reconfigurable algorithm based on TV based on the different coding methods is analyzed to verify the stability of the algorithm. This paper compares and analyzes the typical reconstruction algorithm in the same coding mode. On the basis of the minimum total variation algorithm, the Augmented Lagrangian function term is added and the optimal value is solved by the alternating direction method.Experimental results show that the reconstruction algorithm is compared with the traditional classical algorithm based on TV has great advantages, under the low measurement rate can be quickly and accurately recovers target image.

  • Research Article
  • Cite Count Icon 216
  • 10.1137/110860185
Constrained Total Variation Deblurring Models and Fast Algorithms Based on Alternating Direction Method of Multipliers
  • Jan 1, 2013
  • SIAM Journal on Imaging Sciences
  • Raymond H Chan + 2 more

The total variation (TV) model is attractive in that it is able to preserve sharp attributes in images. However, the restored images from TV-based methods do not usually stay in a given dynamic range, and hence projection is required to bring them back into the dynamic range for visual presentation or for storage in digital media. This will affect the accuracy of the restoration as the projected image will no longer be the minimizer of the given TV model. In this paper, we show that one can get much more accurate solutions by imposing box constraints on the TV models and solving the resulting constrained models. Our numerical results show that for some images where there are many pixels with values lying on the boundary of the dynamic range, the gain can be as great as 10.28 decibel in the peak signal-to-noise ratio. One traditional hindrance using the constrained model is that it is difficult to solve. However, in this paper, we propose using the alternating direction method of multipliers (ADMM) to solv...

  • PDF Download Icon
  • Research Article
  • 10.1155/2021/6547350
Denoising of Tourist Street Scene Image Based on ROF Model of Second-Order Partial Differential Equation
  • Oct 31, 2021
  • Advances in Mathematical Physics
  • Xiaofeng Yang

The noise pollution in tourist street view images is caused by various reasons. A major challenge that researchers have been facing is to find a way to effectively remove noise. Although in the past few decades people have proposed many methods of denoising tourist street scene images, the research on denoising technology of tourist street scene images is still not outdated. There is no doubt that it has become a basic and important research topic in the field of digital image processing. The evolutionary diffusion method based on partial differential equations is helpful to improve the quality of noisy tourist street scene images. This method can process tourist street scene images according to people’s expected diffusion behavior. The adaptive total variation model proposed in this paper is improved on the basis of the total variation model and the Gaussian thermal diffusion model. We analyze the classic variational PDE-based denoising model and get a unified variational PDE energy functional model. We also give a detailed analysis of the diffusion performance of the total variational model and then propose an adaptive total variational diffusion model. By improving the diffusion coefficient and introducing a curvature operator that can distinguish details such as edges, it can effectively denoise the tourist street scene image, and it also has a good effect on avoiding the step effect. Through the improvement of the ROF model, the loyalty term and regular term of the model are parameterized, the adaptive total variation denoising model of this paper is established, and a detailed analysis is carried out. The experimental results show that compared with some traditional denoising models, the model in this paper can effectively suppress the step effect in the denoising process, while protecting the texture details of the edge area of the tourist street scene image. In addition, the model in this paper is superior to traditional denoising models in terms of denoising performance and texture structure protection.

  • Research Article
  • Cite Count Icon 5
  • 10.1016/j.image.2019.06.005
New discretization of total variation functional for image processing tasks
  • Jun 18, 2019
  • Signal Processing: Image Communication
  • Alireza Hosseini

New discretization of total variation functional for image processing tasks

  • Conference Article
  • Cite Count Icon 2
  • 10.1109/icnc.2013.6818078
An adaptive TV model for image denoising
  • Jul 1, 2013
  • Leifu Gao + 1 more

By analyzing three important denoising models: the harmonical model, the TV (total variation) model and the generalized TV model, we have proposed an adaptive one which is named `adaptive TV image denoising model'. On the basis of SNR of noisy images, this model can pretreat them with Gaussian filter, so as to overcome the staircase effect in the TV model. Then by utilizing the gradient information of every pixel point of the image, we can adaptively select the most appropriate denoising scheme. The results of numerical experiments show that this method can preserve significant image details while removing the noise. Compared with other variational denoising methods, especially at high noise levels, the method achieves at least about 1.0dB gain for Peak Signal to the Noise Ratio (as PSNR for short) measurement.

Save Icon
Up Arrow
Open/Close
Notes

Save Important notes in documents

Highlight text to save as a note, or write notes directly

You can also access these Documents in Paperpal, our AI writing tool

Powered by our AI Writing Assistant