Remote sensing image super-resolution via regional spatially adaptive total variation model
This paper introduces a regional spatially adaptive total variation model for remote sensing image super-resolution, effectively reducing pseudo-edges and maintaining image smoothness under high noise conditions. Experiments show it outperforms traditional pixel-based methods in robustness and quality, especially in noisy environments.
Total variation has been used as a popular and effective image prior model in the regularization-based image processing fields. However, as the total variation model favors a piecewise constant solution, the processing result under high noise intensity in the flat regions of the image is often poor, and some “pseudo-edges” are produced. In this paper, we develop a regional spatially adaptive total variation (RSATV) model. Firstly, the spatial information is extracted based on each pixel, and then two filtering processes are respectively added to suppress the effect of “pseudo-edges”. After that, the spatial information weight is constructed and classified with kmeans clustering, and the regularization strength in each region is controlled by the clustering center value. The experimental results, on both simulated and real datasets, show that the proposed approach can effectively reduce the “pseudo-edges” of the total variation regularization in the flat regions, and maintain the partial smoothness of the highresolution image. More importantly, compared with the traditional pixel-based spatial information adaptive approach, the proposed region-based spatial information adaptive total variation model can better avoid the effect of noise on the spatial information extraction, and maintains robustness with changes in the noise intensity in the super-resolution process. Index Terms—Super-resolution, total variation, regional spatially adaptive, majorization-minimization
- Research Article
68
- 10.1109/tip.2013.2251648
- Jun 1, 2013
- IEEE Transactions on Image Processing
Total variation is used as a popular and effective image prior model in the regularization-based image processing fields. However, as the total variation model favors a piecewise constant solution, the processing result under high noise intensity in the flat regions of the image is often poor, and some pseudoedges are produced. In this paper, we develop a regional spatially adaptive total variation model. Initially, the spatial information is extracted based on each pixel, and then two filtering processes are added to suppress the effect of pseudoedges. In addition, the spatial information weight is constructed and classified with k-means clustering, and the regularization strength in each region is controlled by the clustering center value. The experimental results, on both simulated and real datasets, show that the proposed approach can effectively reduce the pseudoedges of the total variation regularization in the flat regions, and maintain the partial smoothness of the high-resolution image. More importantly, compared with the traditional pixel-based spatial information adaptive approach, the proposed region-based spatial information adaptive total variation model can better avoid the effect of noise on the spatial information extraction, and maintains robustness with changes in the noise intensity in the super-resolution process.
- Conference Article
50
- 10.1109/icb.2012.6199807
- Mar 1, 2012
Image segmentation is an important step in automatic fingerprint identification systems. While tremendous progress has been made in rolled and plain fingerprint segmentation, the segmentation of latent fingerprints is still a difficult problem. Features used for rolled and plain fingerprint images fail to work properly on latent images due to the poor quality in ridge information and the presence of multiple types of strong structured noise. In this work, we present an adaptive total variation (TV) model to achieve effective latent fingerprint segmentation. The proposed solution can remove various types of structured noise existing in a single latent image and automatically locate the region of interest (ROI), which contains primarily the latent fingerprint. Then, the following tasks such as fingerprint feature extraction and matching can be conducted in the ROI only. In the proposed TV-based image model, one can adaptively adjust the weight coefficient of the fidelity term in L1-norm depending on the background noise level, which is estimated via TV-based texture analysis. We apply the proposed TV-based segmentation algorithm to the NIST SD27 latent fingerprint database to demonstrate its superior performance.
- Research Article
2
- 10.11873/j.issn.1004-0323.2010.4.560
- Oct 21, 2010
- Remote Sensing Technology and Application
The adaptive fidelity model and adaptive total variation(ATV) model are analyzed,and the strongpoint and disadvantage of the variational method models are compared according to experiments.The ATV model and texture preserving adaptive fidelity model are combined to deduce a gradient descent flow,and the result proved that it can remove noise effectively applying to remote sensing images,at the same time,the textures of the images are preserved.Finally,improved research tasks needed by remote sensing image noise removal based on partial differential equation are discussed.
- Research Article
1
- 10.1155/2020/3936975
- Jul 20, 2020
- Journal of Function Spaces
In this paper, we introduce two novel total variation models to deal with speckle noise in ultrasound image in order to retain the fine details more effectively and to improve the speed of energy diffusion during the process. Firstly, two new convex functions are introduced as regularization term in the adaptive total variation model, and then, the diffusion performances of Hypersurface Total Variation (HYPTV) model and Logarithmic Total Variation (LOGTV) model are analyzed mathematically through the physical characteristics of local coordinates. We have shown that the larger positive parameter in the model is set, the greater energy diffusion speed appears to be, but it will cause the image to be too smooth that required adequate attention. Numerical experimental results show that our proposed LOGTV model for speckle noise removal is superior to traditional models, not only in visual effect but also in quantitative measures.
- Research Article
21
- 10.3389/fams.2022.918357
- Jun 14, 2022
- Frontiers in Applied Mathematics and Statistics
The traditional median filter can handle the image salt and pepper noise better. However, when the noise intensity is large, it is often necessary to enlarge the filter window to ensure the denoising effect, but the enlarged window may also cause excessive smoothing of the image, loss of texture details, and blurred edges. In view of the strong edge preservation characteristics of variational model denoising, we propose a salt and pepper noise removal method based on the edge-adaptive total variational model. Firstly, the image is segmented into edge regions and non-edge regions by edge detection operators. Secondly, the salt and pepper noise of the image is processed using the median filter and adaptive total variation model, respectively. Lastly, the non-edge regions processed by the median filter and the edge regions processed by the adaptive total variation model are extracted for splicing. The experimental results show that the method cannot only effectively remove salt and pepper noise, but also effectively protect the main edge details of the image.
- Research Article
- 10.1155/2021/6547350
- Oct 31, 2021
- Advances in Mathematical Physics
The noise pollution in tourist street view images is caused by various reasons. A major challenge that researchers have been facing is to find a way to effectively remove noise. Although in the past few decades people have proposed many methods of denoising tourist street scene images, the research on denoising technology of tourist street scene images is still not outdated. There is no doubt that it has become a basic and important research topic in the field of digital image processing. The evolutionary diffusion method based on partial differential equations is helpful to improve the quality of noisy tourist street scene images. This method can process tourist street scene images according to people’s expected diffusion behavior. The adaptive total variation model proposed in this paper is improved on the basis of the total variation model and the Gaussian thermal diffusion model. We analyze the classic variational PDE-based denoising model and get a unified variational PDE energy functional model. We also give a detailed analysis of the diffusion performance of the total variational model and then propose an adaptive total variational diffusion model. By improving the diffusion coefficient and introducing a curvature operator that can distinguish details such as edges, it can effectively denoise the tourist street scene image, and it also has a good effect on avoiding the step effect. Through the improvement of the ROF model, the loyalty term and regular term of the model are parameterized, the adaptive total variation denoising model of this paper is established, and a detailed analysis is carried out. The experimental results show that compared with some traditional denoising models, the model in this paper can effectively suppress the step effect in the denoising process, while protecting the texture details of the edge area of the tourist street scene image. In addition, the model in this paper is superior to traditional denoising models in terms of denoising performance and texture structure protection.
- Research Article
1
- 10.32628/ijsrst52310687
- Jan 1, 2024
- International Journal of Scientific Research in Science and Technology
In this paper Total variation is utilized as a prominent and effectual image prior model in the regularization based image processing fields. Nonetheless, as the total variation model supports a piecewise steady solution, this process comes under high intensity noise in the level areas of the picture is often poor, and a few pseudo edges are formed. In this work we develop a spatially adaptive total variation model. At first, the spatial information is extracted supported each and every pixel, and at that point 2 filtering process are added to restrain the impact of pseudo edges. In addition of this, the spatial info weight is built and classified with k-means clustering, and also the regularization strength in every region is controlled by center value of the cluster. The exploratory results, on both simulated and genuine datasets, demonstrate that the proposed methodology can adequately diminish the pseudo edges of the total variation regularization in the flat areas, and keep up the partial smoothness of the HR images. If we compare the traditional pixel based spatial information adaptive methodology, the proposed region based spatial information adaptive variation model can effectively reduce the effect of noise on the spatial data extraction and maintain strength with changes in the noise intensity in the SR process.
- Conference Article
4
- 10.1109/cisp-bmei48845.2019.8966060
- Oct 1, 2019
Total variation model of image denoising is easy to influence the gradient and lose the details of image. Due to these weaknesses, many adaptive total variation (ATV) models of image denoising have been proposed to eliminate the Gaussian noisy additive in the image. This paper implements the model through a numerical solution, where the gradient descent method is used to derive the partial differential equation (PDE) corresponding to the ATV model. First, based on Euler-Lagrange equation, a detailed derivation process for Partial Differential Equation is used to calculate the ATV model. Then, based on gradient descent method, a numerical calculation of the model is derived from the PDE using the Direct Difference Method. Finally, several different λ parameters are compared to produce different image denoising effects and the appropriate parameter λ value is determined. Experimental results prove that our proposed numerical calculation can effectively realize the ATV denoising model.
- Research Article
- 10.1007/s12204-018-2016-8
- Dec 1, 2018
- Journal of Shanghai Jiaotong University (Science)
Confocal laser scanning microscopy (CLSM) has emerged as one of the most advanced fluorescence cell imaging techniques in the field of biomedicine. However, fluorescence cell imaging is limited by spatial blur and additive white noise induced by the excitation light. In this paper, a spatially adaptive high-order total variation (SA-HOTV) model for weak fluorescence image restoration is proposed to conduct image restoration. The method consists of two steps: optimizing the deconvolution model of the fluorescence image by the generalized Lagrange equation and alternating direction method of multipliers (ADMM); using spatially adaptive parameters to balance the image fidelity and the staircase effect. Finally, an comparison of SA-HOTV model and Richardson-Lucy model with total variation (RL-TV model) indicates that the proposed method can preserve the image details ultimately, reduce the staircase effect substantially and further upgrade the quality of the restored weak fluorescence image.
- Conference Article
5
- 10.1109/icdma.2010.97
- Dec 1, 2010
Traditional total variation model leads to an undesirable staircase effect and is hard to eliminate high frequency noises in image restoration. In this paper, to solve this problem, a novel image restoration model based on adaptive total variation is proposed. A gradient fidelity term is coupled with adaptive total variation model. In order to choose proper parameters, the parameter selection criteria are analyzed theoretically, and a simple scheme to demonstrate its validity is adopted experimentally. To make fair comparisons of performances of three models, the same numerical algorithm is used to solve partial differential equations. Experimental results illustrate that the new model not only preserves the edge and important details but also alleviates the staircase effect effectively.
- Book Chapter
1
- 10.1007/978-981-10-0539-8_16
- Jan 1, 2016
Although the traditional TV (Total Variation) model owns excellent image denoising ability, there are staircase effect problems for TV model. In this article, two detection operators for staircase effect problem are proposed. The staircase effect problem can be solved effectively by introducing two operators into traditional TV model. On the basis, it proposes an adaptive total variation model for image denoising. When dealing with image edge, it can still use the traditional TV model. Its purpose is to maintain the advantages in edge protection for TV model. When it is in the smooth area of image, linear diffusion is used to avoid the staircase effect.
- Conference Article
1
- 10.1117/12.913494
- Oct 1, 2011
- Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE
Denoising algorithms such as Total Variation model modify smooth areas in images into piecewise constant patches and small scale details and textures present in the original image are not preserved satisfactorily by these processes. In this paper, we present an algorithm based on an adaptive Total Variation norm of the gradient of the image, with a family of local constraints for efficient denoising of natural images. In fact, natural images consist of smooth and textured regions. Staircase effect is reduced in smooth areas by using a modified Total Variation functional. The set of local constraints, one for each pixel in the image are able to preserve most of the fine details and textures in the images. Visual and quantitative results of proposed method are presented and are compared with results of existing methods.
- Research Article
15
- 10.1155/2014/423761
- Jan 1, 2014
- Mathematical Problems in Engineering
We propose an adaptive total variation (TV) model by introducing the steerable filter into the TV‐based diffusion process for image filtering. The local energy measured by the steerable filter can effectively characterize the object edges and ramp regions and guide the TV‐based diffusion process so that the new model behaves like the TV model at edges and leads to linear diffusion in flat and ramp regions. This way, the proposed model can provide a better image processing tool which enables noise removal, edge‐preserving, and staircase suppression.
- Research Article
601
- 10.1109/tgrs.2012.2185054
- Oct 1, 2012
- IEEE Transactions on Geoscience and Remote Sensing
The amount of noise included in a hyperspectral image limits its application and has a negative impact on hyperspectral image classification, unmixing, target detection, and so on. In hyperspectral images, because the noise intensity in different bands is different, to better suppress the noise in the high-noise-intensity bands and preserve the detailed information in the low-noise-intensity bands, the denoising strength should be adaptively adjusted with the noise intensity in the different bands. Meanwhile, in the same band, there exist different spatial property regions, such as homogeneous regions and edge or texture regions; to better reduce the noise in the homogeneous regions and preserve the edge and texture information, the denoising strength applied to pixels in different spatial property regions should also be different. Therefore, in this paper, we propose a hyperspectral image denoising algorithm employing a spectral-spatial adaptive total variation (TV) model, in which the spectral noise differences and spatial information differences are both considered in the process of noise reduction. To reduce the computational load in the denoising process, the split Bregman iteration algorithm is employed to optimize the spectral-spatial hyperspectral TV model and accelerate the speed of hyperspectral image denoising. A number of experiments illustrate that the proposed approach can satisfactorily realize the spectral-spatial adaptive mechanism in the denoising process, and superior denoising results are produced.
- Research Article
4
- 10.3724/sp.j.1146.2008.01830
- Feb 19, 2010
- JOURNAL OF ELECTRONICS INFORMATION & TECHNOLOGY
该文提出了一种新的结合非下采样Contourlet变换(NSCT)和自适应全变差模型的图像去噪方法。首先通过NSCT对含噪图像进行分解,根据高斯比例混合(GSM)模型建立图像模型;然后利用贝叶斯估计进行图像去噪,重构后得到初次去噪图像;最后,结合自适应全变差模型对初次去噪图像进行重构滤波,得到最终的去噪图像。实验结果表明,该方法可以有效地消除图像中的Gibbs伪影及噪声,在去噪图像峰值信噪比(PSNR)和边缘保持性能上都优于已有的算法。