Non-subsampled Shearlet Transform Research Articles

Enhancement of X-Ray Images by Gradient Domain Guided Filtering and Non Sub Sampled Shearlet Transform

Abstract: In order to address the issues of low resolution, noise amplification, missing details, and weak edge gradient retention in the X-ray image improvement process, we propose in this study an image enhancement technique that combines nonSubsampled Shearlet transform with gradient-domain guided filtering. We start by breaking down the non Subsampled Shearlet transform and histogram equalization into the original image. We receive multiple high-frequency sub-bands as well as a lowfrequency sub-band. To enhance the overall contrast of the image and bring out the contour information in the low-frequency sub-band, adaptive gamma correction with weighting distribution is applied. To reduce image noise and emphasize edge information and detail, gradient-domain guided filtering is applied to the high-frequency sub-bands. In order to generate the final enhanced image, we use the inverse non-Subsampled Shearlet transform to reconstruct all of the sub-bands that were successfully processed. The experimental findings demonstrate the effectiveness of the suggested algorithm in improving X-ray images, as well as the clear advantages its objective index provides over certain conventional algorithms.

Multi-modal medical image fusion using improved dual-channel PCNN.

This paper proposes a medical image fusion method in the non-subsampled shearlet transform (NSST) domain to combine a gray-scale image with the respective pseudo-color image obtained through different imaging modalities. The proposed method applies a novel improved dual-channel pulse-coupled neural network (IDPCNN) model to fuse the high-pass sub-images, whereas the Prewitt operator is combined with maximum regional energy (MRE) to construct the fused low-pass sub-image. First, the gray-scale image and luminance of the pseudo-color image are decomposed using NSST to find the respective sub-images. Second, the low-pass sub-images are fused by the Prewitt operator and MRE-based rule. Third, the proposed IDPCNN is utilized to get the fused high-pass sub-images from the respective high-pass sub-images. Fourth, the luminance of the fused image is obtained by applying inverse NSST on the fused sub-images, which is combined with the chrominance components of the pseudo-color image to construct the fused image. A total of 28 diverse medical image pairs, 11 existing methods, and nine objective metrics are used in the experiment. Qualitative and quantitative fusion results show that the proposed method is competitive with and even outpaces some of the existing medical fusion approaches. It is also shown that the proposed method efficiently combines two gray-scale images.

Novel fusion strategy for image fusion using rescue hunt optimization-based modified guidance model

ABSTRACT A new method for image fusion introduces an inventive strategy for amalgamating data from multiple images, resulting in the creation of a single, improved output image. This approach aims to address the limitations and challenges associated with conventional fusion techniques, paving the way for improved results in various applications. In this research, a novel approach for image fusion is presented, featuring a rescue hunt optimisation-based modified guidance model (RHO-based MG model). The methodology leverages the non-subsampled contourlet transform (NSCT) and non-subsampled shear let transform (NSST) to construct the fusion transform using two input images, typically infrared and visual images. By hybridising high-frequency (HF) and low-frequency (LF) bands from both types of images, the fusion model generates the final HF and LF bands. A distinctive modified guidance strategy is employed in the development of these bands. The proposed approach utilises a rescue hunt algorithm developed through the combination of search and rescue optimisation (SARO) and grey wolf optimisation (GWO) behaviours. In image fusion, optimisation fine-tunes VGG-19 and RESNET 18 models to improve their ability to combine multiple images effectively. This process involves adjusting the models’ internal parameters using optimisation techniques. By analysing the features in different input images, these models learn to extract meaningful information and create a fused image that retains the important details from each source. This strategy is further enhanced by integrating the VGG-19 and RESNET 18 models. The fused image is composed of combined HF and LF bands, with the final result obtained through an inverse hybrid transform. Experimental results, conducted on a dataset of 25 images, demonstrate the effectiveness of the approach with metrics average gradient (AG), edge intensity (EI), PSNR, RMSE, SSIM, and variance attained the values of 24.71, 236.67, 54.96 dB, 0.22, 63.16, and 0.11, respectively. This innovative method offers a promising direction for enhancing image fusion quality and is highlighted by its unique integration of optimisation and guidance strategies.

Self-attention-based generative adversarial network optimized with color harmony algorithm for brain tumor classification

ABSTRACT This paper proposes a novel approach, BTC-SAGAN-CHA-MRI, for the classification of brain tumors using a SAGAN optimized with a Color Harmony Algorithm. Brain cancer, with its high fatality rate worldwide, especially in the case of brain tumors, necessitates more accurate and efficient classification methods. While existing deep learning approaches for brain tumor classification have been suggested, they often lack precision and require substantial computational time.The proposed method begins by gathering input brain MR images from the BRATS dataset, followed by a pre-processing step using a Mean Curvature Flow-based approach to eliminate noise. The pre-processed images then undergo the Improved Non-Sub sampled Shearlet Transform (INSST) for extracting radiomic features. These features are fed into the SAGAN, which is optimized with a Color Harmony Algorithm to categorize the brain images into different tumor types, including Gliomas, Meningioma, and Pituitary tumors. This innovative approach shows promise in enhancing the precision and efficiency of brain tumor classification, holding potential for improved diagnostic outcomes in the field of medical imaging. The accuracy acquired for the brain tumor identification from the proposed method is 99.29%. The proposed BTC-SAGAN-CHA-MRI technique achieves 18.29%, 14.09% and 7.34% higher accuracy and 67.92%,54.04%, and 59.08% less Computation Time when analyzed to the existing models, like Brain tumor diagnosis utilizing deep learning convolutional neural network with transfer learning approach (BTC-KNN-SVM-MRI); M3BTCNet: multi model brain tumor categorization under metaheuristic deep neural network features optimization (BTC-CNN-DEMFOA-MRI), and efficient method depending upon hierarchical deep learning neural network classifier for brain tumour categorization (BTC-Hie DNN-MRI) respectively.

A Novel Hybrid Multimodal Medical Image Fusion Scheme Based on Non-subsampled Shearlet Transform

A Novel Hybrid Multimodal Medical Image Fusion Scheme Based on Non-subsampled Shearlet Transform

Blind image watermark decoder in NSST-FPCET domain using Weibull Mixtures-HMT

Balancing imperceptibility, robustness, and data payload is a key topic in digital watermarking technology. Many contributions point to statistical modeling as an effective solution to this problem. On the basis of this, in this paper, we devise a hybrid domain image watermark decoder based on Weibull mixtures based hidden Markov tree (Weibull Mixtures-HMT) model. In the embedding phase, Otsu-Canny edge detection method is used to map the positions of high entropy blocks to the target subband obtained by non-subsampled shearlet transform (NSST), and fast polar complex exponential transform (FPCET) is computed in the target blocks to obtain the NSST-FPCET domain. The watermark signals are embedded into NSST-FPCET magnitudes by a linear method. In the extraction phase, NSST-FPCET magnitude coefficients are modeled by Weibull Mixtures-HMT model, which describes the distribution characteristics as well as the dependencies of NSST-FPCET magnitudes. The efficient variance reduced stochastic expectation maximization method is employed for estimating the parameters of Weibull Mixtures-HMT model. A statistical image watermark decoder in NSST-FPCET domain is finally achieved by the maximum likelihood decision. Massive experiments are performed so as to confirm the superiority of the designed scheme in trade-off among the data payload, imperceptibility, and robustness.

A dual fusion deep convolutional network for blind universal image denoising

Blind image denoising and edge-preserving are two primary challenges to recover an image from low-level vision to high-level vision. Blind denoising requires a single denoiser can denoise images with any intensity of noise, and it has practical utility since accurate noise levels cannot be acquired from realistic images. On the other hand, edge preservation can provide more image features for subsequent processing which is also important for the denoising. In this paper, we propose a novel blind universal image denoiser to remove synthesis and realistic noise while preserving the image texture. The denoiser consists of noise network and prior network parallelly, and then a fusion block is used to give the weight between these two networks to balance computation cost and denoising performance. We also use the Non-subsampled Shearlet Transform (NSST) to enlarge the size of receptive field to obtain more detailed information. Extensive denoising experiments on synthetic images and realistic images show the effectiveness of our denoiser.

A novel framework of multimodal medical image fusion using adaptive NSST and optimized deep learning approach

ABSTRACT Multimodal medical image fusion plays a pivotal role in the medical and imaging industry. Existing works of deep learning method suffers from blurred texture characteristics and computing efficiency. Thus, a novel deep learning model is proposed for multimodal medical image fusion. Initially, an Adaptive Non-Subsampled Shearlet Transform (ANSST) approach is developed for decomposing the images, where the filter coefficient is optimized by Hybrid Water Strider-Dingo Optimization (HWS-DOX). The fusion of the high sub-bands of source image 1 and high sub-bands of source image 2 is done by an Optimized Deep Neural Network (ODNN). Then, the lower sub-bands of source image 1 and lower sub-bands of source image 2 will be fused through a weighted averaging scheme. Finally, the final fused images are attained by applying the inverse ANSST. Thus, the performance of recommended module is compared over classical heuristics and various transform methods.

TDFusion: When Tensor Decomposition Meets Medical Image Fusion in the Nonsubsampled Shearlet Transform Domain.

In this paper, a unified optimization model for medical image fusion based on tensor decomposition and the non-subsampled shearlet transform (NSST) is proposed. The model is based on the NSST method and the tensor decomposition method to fuse the high-frequency (HF) and low-frequency (LF) parts of two source images to obtain a mixed-frequency fused image. In general, we integrate low-frequency and high-frequency information from the perspective of tensor decomposition (TD) fusion. Due to the structural differences between the high-frequency and low-frequency representations, potential information loss may occur in the fused images. To address this issue, we introduce a joint static and dynamic guidance (JSDG) technique to complement the HF/LF information. To improve the result of the fused images, we combine the alternating direction method of multipliers (ADMM) algorithm with the gradient descent method for parameter optimization. Finally, the fused images are reconstructed by applying the inverse NSST to the fused high-frequency and low-frequency bands. Extensive experiments confirm the superiority of our proposed TDFusion over other comparison methods.

A pansharpening method combining iterative filtering and NSST-NSML-PAPCNN to optimize spatial detail extraction and injection

ABSTRACT Spatial injection-based pansharpening methods are prone to spatial or spectral distortions in pansharpening images due to insufficient extraction of spatial details and a mismatch between the amount of spatial detail information injected and the required amount. To this end, this paper proposes a pansharpening method that optimizes spatial detail extraction and injection. Firstly, a method to optimize the amount of spatial detail injection is proposed, that is, to extract the high-frequency information of the image through iterative filtering and determine the optimal number of iterations based on the global analysis of the method. Then, to fully extract and combine the spatial detail information of the source image, the detailed high-frequency image extracted corresponding to the optimal iterative filtering times is decomposed by non-subsampled shearlet transform (NSST), and a new multi-scale sum-modified-Laplacian (NSML) as an external stimulus to a parameter-adaptive pulse-coupled neural network model (PAPCNN). A fusion rule based on multi-scale morphological gradients is designed to extract a small amount of detailed information for the low-frequency subband. The fused spatial detail image can be obtained by combining the fused low-frequency and high-frequency subbands and inverse NSST transformation. Finally, pansharpening can be realized by combining spatial detail image, injection coefficient, and MS image. In this paper, many experiments are carried out on the QuickBird, GeoEye-1, and WorldView-4 datasets, and quantitative and qualitative comparisons are made with eight advanced methods. Experimental results show that the method proposed in this paper can achieve better fusion results.

Multimodal Fusion-Based Image Hiding Algorithm for Secure Healthcare System

The development of artificial intelligence (AI) plays a significant role of multimedia applications, especially in the healthcare domain. However, it has brought about the problem of sensitive information leakage. To address these challenges, an interesting multimodal fusion-based robust image hiding algorithm is proposed in this paper. Firstly, fused image is considered as mark image generated from MRI and CT images using non-subsampled shearlet transform (NSST). Secondly, we employed principal component analysis (PCA) to compute the appropriate coefficients of cover image for embedding purpose. Thirdly, fused mark image is Arnold cat map encoded to address the security issue hidden mark media. Finally, the fusion of fractional dual-tree complex wavelet transform (Fr-DTCWT) and randomized singular value decomposition (RSVD) is utilized to conceal encrypted fused mark media inside host image. Our findings show that the proposed algorithm outperforms some of the recent techniques in terms of high robustness and invisibility.

Multimodal medical image fusion in NSST domain with structural and spectral features enhancement

For the past 25 years, medical imaging has been extensively used for clinical diagnosis. The main difficulties in medicine are accurate disease recognition and improved therapy. Using a single imaging modality to diagnose disease is challenging for clinical personnel. In this paper, a novel structural and spectral feature enhancement method in NSST Domain for multimodal medical image fusion (MMIF) is proposed. Initially, the proposed method uses the Intensity, Hue, Saturation (IHS) method to generate two pairs of images. The input images are then decomposed using the Non-Subsampled Shearlet Transform (NSST) method to obtain low frequency and high frequency sub-bands. Next, a proposed Structural Information (SI) fusion strategy is employed to Low Frequency Sub-bands (LFS's). It will enhance the structural (texture, background) information. Then, Principal Component Analysis (PCA) is employed as a fusion rule to High Frequency Sub-bands (HFS's) to obtain the pixel level information. Finally, the fused final image is obtained by employing inverse NSST and IHS. The proposed algorithm was validated using different modalities containing 120 image pairs. The qualitative and quantitative results demonstrated that the algorithm proposed in this research work outperformed numerous state-of-the-art MMIF approaches.

Gray wolf optimization and image enhancement with NLM Algorithm for multimodal medical fusion imaging system

Multimodal Medical fusion imaging is a significant aspect of image-guided medical diagnosis. A new improved non-sub sampled shearlet transform (NSST) based Multimodal Medical Fusion imaging System based on Gray Wolf Optimization (GWO) and Image Enhancement with NLM Algorithmic computer guided medical procedures. This paper proposes an efficient medical fusion imaging system that is evolved from the concept of Non-Sub sampled Shearlet Transform and the Gray Wolf Optimization algorithm. The initial procedure in this system includes histogram matching among one image and the other to facilitate common dynamic range for both images. Decomposition of multimodal medical images is done by NSST to be fused into their coefficients. Optimum decomposition level is scaled by EGOA with optimal gain parameters. Furthermore, denoising with enhancement procedure is performed to enhance its visual quality. If the images are corrupted by noise, the these traditional fusion methods performance is greatly hampered. Therefore, this is essential to create a fusion approach that can maintain accurate information even while distorting the images.

A New High Quality Focus Measurement Operator Based on Nonsubsampled Shearlet Transform for 3D Shape Reconstruction

3B şekil oluşturulma sürecinde herhangi ek donanım gerektirmeyen Odaktan Şekil (Shape From Focus - SFF) en çok tercih edilen stratejilerdendir. SFF stratejisi, 3B şekil oluşturma sürecinde farklı odaklı 2B görüntü serisi kullanmakta ve üç temel aşamadan oluşmaktadır: (1) Farklı odaklı 2B görüntü serisinin elde edilmesi, (2) Görüntü piksellerinin odaklama değerlerinin hesaplanması ve (3) Maksimum odaklı pikselin seçilmesi. Yüksek doğruluk ve daha düşük gürültü ile 3B şekil oluşturmak için, araştırmacılar SFF'nin ikinci aşamasında yeni odaklama ölçüm operatörü önermek yerine genellikle bir ön veya son işlem algoritmaları geliştirmektedirler. Literatür çalışmalarının aksine, bu çalışmada herhangi bir ön veya son işlem gerektirmeyen Alt Örneklemesiz Shearlet Dönüşümü'ne dayalı yeni ve yüksek kaliteli odaklama ölçüm operatörü önerilmektedir. Önerilen odaklama ölçüm operatörünün etkinliği sentetik görüntü serileri kullanılarak pencere boyutu ve gürültü seviyesi gibi farklı koşullar altında analiz edilmektedir. Elde edilen öznel ve nesnel sonuçlar önerilen odaklama ölçüm operatörünün daha iyi performans sağladığını göstermektedir.

Multimodality Medical Image Fusion Using Clustered Dictionary Learning in Non-Subsampled Shearlet Transform.

Imaging data fusion is becoming a bottleneck in clinical applications and translational research in medical imaging. This study aims to incorporate a novel multimodality medical image fusion technique into the shearlet domain. The proposed method uses the non-subsampled shearlet transform (NSST) to extract both low- and high-frequency image components. A novel approach is proposed for fusing low-frequency components using a modified sum-modified Laplacian (MSML)-based clustered dictionary learning technique. In the NSST domain, directed contrast can be used to fuse high-frequency coefficients. Using the inverse NSST method, a multimodal medical image is obtained. Compared to state-of-the-art fusion techniques, the proposed method provides superior edge preservation. According to performance metrics, the proposed method is shown to be approximately 10% better than existing methods in terms of standard deviation, mutual information, etc. Additionally, the proposed method produces excellent visual results regarding edge preservation, texture preservation, and more information.

Infrared and visible image fusion based on NSST and phase consistency adaptive DUAL channel PCNN

The infrared and visible image fusion has been one of the significant research hotspots in image processing field. This paper presents a new IR and VI image fusion framework, which constructs a parameter adaptive dual channel pulse coupled neural network (PADCPCNN) with phase consistency in the non-subsampled shearlet transform (NSST) domain. Firstly, the original images are decomposed into low-pass and high-pass subbands by adopting NSST. Secondly, the weighted average fusion strategy based on phase consistency is applied to merge the low-pass subbands, and high-pass subbands are fused by the PADCPCNN with phase consistency. Additionally, in order to solve the information difference and edge detail problem of two source images, the phase consistency operator is exploited as the adaptive connection strength. Furthermore, four sets of controlled experiments are designed and fusion comparative experiments are conducted with images of typical datasets, from different backgrounds to make objective and subjective comparison. And their evaluation results show that the proposed algorithm highlights more texture and edge details than other existing main fusion methods.

Research on Multi-Scale Feature Extraction and Working Condition Classification Algorithm of Lead-Zinc Ore Flotation Foam

To address the problems of difficult online monitoring, low recognition efficiency and the subjectivity of work condition identification in mineral flotation processes, a foam flotation performance state recognition method is developed to improve the issues mentioned above. This method combines multi-dimensional CNN (convolutional neural networks) characteristics and improved LBP (local binary patterns) characteristics. We have divided the foam flotation conditions into six categories. First, the multi-directional and multi-scale selectivity and anisotropy of nonsubsampled shearlet transform (NSST) are used to decompose the flotation foam images at multiple frequency scales, and a multi-channel CNN network is designed to extract static features from the images at different frequencies. Then, the flotation video image sequences are rotated and dynamic features are extracted by the LBP-TOP (local binary patterns from three orthogonal planes), and the CNN-extracted static picture features are fused with the LBP dynamic video features. Finally, classification decisions are made by a PSO-RVFLNs (particle swarm optimization-random vector functional link networks) algorithm to accurately identify the foam flotation performance states. Experimental results show that the detection accuracy of the new method is significantly improved by 4.97% and 6.55%, respectively, compared to the single CNN algorithm and the traditional LBP algorithm, respectively. The accuracy of flotation performance state classification was as high as 95.17%, and the method reduced manual intervention, thus improving production efficiency.

Classification of Mineral Foam Flotation Conditions Based on Multi-Modality Image Fusion

Accurate and rapid identification of mineral foam flotation states can increase mineral utilization and reduce the consumption of reagents. The traditional flotation process concentrates on extracting foam features from a single-modality foam image, and the accuracy is undesirable once problems such as insufficient image clarity or poor foam boundaries are encountered. In this work, a classification method based on multi-modality image fusion and CNN-PCA-SVM is proposed for work condition recognition of visible and infrared gray foam images. Specifically, the visible and infrared gray images are fused in the non-subsampled shearlet transform (NSST) domain using the parameter adaptive pulse coupled neural network (PAPCNN) method and the image quality detection method for high and low frequencies, respectively. The convolution neural network (CNN) is used as a trainable feature extractor to process the fused foam images, the principal component analysis (PCA) reduces feature data, and the support vector machine (SVM) is used as a recognizer to classify the foam flotation condition. After experiments, this model can fuse the foam images and recognize the flotation condition classification with high accuracy.

Infrared and visible image fusion based on Multi-State contextual hidden Markov Model

In this paper, we propose a novel multi-state contextual hidden Markov model (MCHMM) in the non-subsampled Shearlet transform (NSST) domain for image fusion. The traditional two-state hidden Markov model divides the multi-scale coefficients only into large and small states, which can lead to an inaccurate statistical model and reduce the quality of the fusion result. Our method improves upon this by developing a multi-state model and a soft context variable to provide a fine-grained representation of the high-frequency subbands, resulting in improved fusion results. Additionally, the fusion of low-frequency subbands is performed on the difference of regional energy to ensure visual quality. Our experimental results on several datasets demonstrate that the proposed method outperforms other fusion methods in both subjective and objective evaluations.

Parameter adaptive unit-linking pulse coupled neural network based MRI–PET/SPECT image fusion

Medical image fusion has many applications to healthcare that is accomplished by extracting and then combining the complementary information from multiple medical images into a single image. The pulse coupled neural network (PCNN) is greatly applied to image fusion due to its efficient coupling of surrounding neurons, but suffers from network complexity and manual parameter settings. This paper proposes a novel parameter adaptive unit-linking PCNN (PAULPCNN) model, whose parameters are automatically obtained from the external stimulus and exhibits a simpler structure than the original PCNN. The multi-scale decomposition-based methods, particularly based on the non-subsampled shearlet transform (NSST), are widely employed by researchers to perform medical image fusion due to their efficient separation of spatial details at different scales. Motivated by the advantages of the PCNN and multi-scale decomposition-based methods, a hybrid medical image fusion method based on the PAULPCNN model is introduced in the NSST domain that merges the salient complementary details from a gray-scale and the corresponding pseudo-color medical image captured at different modalities to produce a more informative image that is more useful to medical experts in computer-aided diagnosis of diseases. The proposed method first employs NSST to transform the source images into a low-pass and several high-pass sub-bands, respectively. The high-pass sub-bands are combined using the firing times of the proposed PAULPCNN model, whereas a new distance-weighted regional energy-based rule is applied to construct the fused low-pass sub-band, which while estimating regional energy, assigns weight to different neighboring pixels depending on their distance from the central pixel. Finally, inverse NSST is applied on the fused sub-bands to construct the fused image. The effectiveness of the proposed technique is shown using the fusion results of eleven state-of-the-art methods on thirty gray-scale and pseudo-color brain medical image pairs comprising mild Alzheimer’s disease, Huntington’s disease, motor neuron disease, sagittal plane, coronal plane, transaxial plane, and glioma image pairs, where eight objective metrics are considered for the quantitative assessment. Experimental results demonstrate that the proposed method is competitive with the state-of-the-art methods, which even outperforms some of these methods by providing fused images with better visual quality and greater objective performance, which are more suitable for specialists to diagnose brain diseases.