PSNR Performance Research Articles

Spectral reconstruction from RGB image to hyperspectral image: Take the detection of glutamic acid index in beef as an example

The use of spectral reconstruction (SR) to recovery RGB images to full-scene hyperspectral image (HSI) is an important measure to achieve real-time and low-cost HSI applications. Taking the detection of glutamic acid index for 360 beef samples as an example, the feasibility of using 11 state-of-the-art reconstruction algorithms to achieve RGB to HSI in complex food systems was investigated. The multivariate correlation analysis was used to prove that RGB is a projection of three-channel comprehensive coverage wide-band information. The comprehensive quality attributes (PSNR-Params-FLOPS) was proposed to determine the optimal reconstruction model (MST++, MST, MIRNet, and MPRNet). Moreover, SSIM values and t-SNE were introduced to evaluate the consistency of the reconstruction results. Finally, Lightweight Transformer was used to establish the detection models of Raw-HSI, RGB and SR-HSI for the prediction of glutamic acid index for beef. The results showed that the MST++ model exhibited the best performance in SR, with RMSE, PSNR, and SSIM values of 0.015, 36.70, and 0.9253, respectively. Meanwhile, the prediction effect of MST++ (R2P = 0.8422 and RPD = 2.46) reconstructed was close to the Raw-HSI (R2P = 0.8526 and RPD = 2.69). The results provide practical application scenarios and detailed analysis ideas for RGB-to-HSI.

Remote sensing image fusion method based on depth feature extraction

Abstract Remote sensing image fusion involves combining data from various remote sensing sensors or merging multiple images acquired by the same sensor but in different spectral bands to create a superior quality composite image, high resolution, multi-band, and multi-temporal remote sensing image through certain algorithms and technologies. By utilizing fusion techniques, remote sensing images of varying bands, resolutions, and phases can be combined to enhance the accuracy of ground object information. This paper introduces a remote sensing image fusion method that leverages deep learning for depth feature extraction. Swin Transformer makes full use of the characteristics of the relationship between adjacent pixels, and adaptively extracts panchromatic image (PAN) and multispectral image (MS) features through two adaptive feature extraction channels. High-quality satellite data is employed to confirm the efficacy of the suggested approach, with the findings demonstrating strong performance in ERGAS, SCC, SSIM, and PSNR, and other evaluation indexes and has good spectral information fidelity and spatial information integration degree.

PCA-Chain: A Novel Medical Image Retrieval Blockchain

For decades data security has remained a challenging task for researchers. The unrivaled immutability of blockchain data and the decentralized nature of its ledger have been put forward as potential solutions to the issue. Blockchain has been proven to be effective in securely storing textual data, however, it is unable to store image files. Researchers are now focusing on implementing blockchain for storing and securing image data as images contain a large amount of sensitive data and are prone to data tampering attacks. The proposed PCA-Chain is a novel approach to providing a secure image- based blockchain using Principal Component Analysis (PCA) to compress digital leukemia images and propagate them on blockchain via simple hash functions and retrieve them back to their original size without major compression losses. Performance evaluation was conducted using MSE, PSNR and SSIMs performance parameters. PCA-Chain provides lossless compression and can be used for the storage of medical images.

Single-image super-resolution based on an improved asymmetric Laplacian pyramid structure

Large-scale factor image super-resolution whose scale factor is greater than 4 is significant in real-world applications for single image super-resolution. The current image super-resolution techniques for large-scale factor, however, frequently upsample low-resolution images in a single pass, leading to edge artifacts in the reconstructed images. In this article, we provide an improved asymmetric Laplacian pyramid network to further realize large-scale factor image super-resolution and fully utilize various size features. A distinct architecture is applied at each layer of the pyramid for improving feature extraction. We extend the first layer of the pyramid with a lightweight transformer design, which enables the model to efficiently collect the contextual information in the sequence by utilizing the multi-headed attention mechanism. Additionally, we combine improved dense skip connections with recursive operations to form a deep dense recursive convolutional neural network that fuses low-level and high-level features while broadening the network's receptive field. The quantitative and qualitative analysis on benchmark dataset's demonstrate that our method provides superior performance in both PSNR and SSIM and is more in line with human visual perception.

Predictive and Adaptive Deep Coding for Wireless Image Transmission in Semantic Communication

Semantic communication is a newly emerged communication paradigm that exploits deep learning (DL) models to realize communication processes like source coding and channel coding. Recent advances have demonstrated that DL-based joint source-channel coding (DeepJSCC) can achieve exciting data compression and noise-resiliency performances for wireless image transmission tasks, especially in environments with low channel signal-to-noises (SNRs). However, existing DeepJSCC-based semantic communication frameworks still cannot achieve adaptive code rates for different channel SNRs and image contents, which reduces its flexibility and bandwidth efficiency. In this paper, we propose a predictive and adaptive deep coding (PADC) framework for realizing flexible code rate optimization with a given target transmission quality requirement. PADC is realized by a variable code length enabled DeepJSCC (DeepJSCC-V) model for realizing flexible code length adjustment, an Oracle Network (OraNet) model for predicting peak-signal-to-noise (PSNR) value for an image transmission task according to its contents, channel signal to noise ratio (SNR) and the compression ratio (CR) value, and a CR optimizer aims at finding the minimal data-level or instance-level CR with a PSNR quality constraint. By using the above three modules, PADC can transmit the image data with minimal CR, which greatly increases bandwidth efficiency. Simulation results demonstrate that the proposed DeepJSCC-V model can achieve similar PSNR performances compared with the state-of-the-art Attention-based DeepJSCC (ADJSCC) model, and the proposed OraNet model is able to predict high-quality PSNR values with an average error lower than 0.5dB. Results also demonstrate that the proposed PADC can use nearly minimal bandwidth consumption for wireless image transmission tasks with different channel SNR and image contents, at the same time guaranteeing the PSNR constraint for each image data.

Video Compression using Neural Weight Step and Huffman Coding Techniques

Video Compression using Neural Weight Step and Huffman Coding Techniques

Improved Preprocessing Strategy under Different Obscure Weather Conditions for Augmenting Automatic License Plate Recognition

Automatic license plate recognition (ALPR) systems are widely used for various applications, including traffic control, law enforcement, and toll collection. However, the performance of ALPR systems is often compromised in challenging weather and lighting conditions. This research aims to improve the effectiveness of ALPR systems in foggy, low-light, and rainy weather conditions using a hybrid preprocessing methodology. The research proposes the combination of dark channel prior (DCP), non-local means denoising (NMD) technique, and adaptive histogram equalization (AHE) algorithms in CIELAB color space. And used the Python programming language comparisons for SSIM and PSNR performance. The results showed that this hybrid approach is not merely robust to a variety of challenging conditions, including challenging weather and lighting conditions but significantly more accurate for existing ALPR systems.

Searching Efficient Model-guided Deep Network for Image Denoising.

Unlike the success of neural architecture search (NAS) in high-level vision tasks, it remains challenging to find computationally efficient and memory-efficient solutions to low-level vision problems such as image restoration through NAS. One of the fundamental barriers to differential NAS-based image restoration is the optimization gap between the super-network and the sub-architectures, causing instability during the searching process. In this paper, we present a novel approach to fill this gap in image denoising application by connecting model-guided design (MoD) with NAS (MoD-NAS). Specifically, we propose to construct a new search space under a model-guided framework and develop more stable and efficient differential search strategies. MoD-NAS employs a highly reusable width search strategy and a densely connected search block to automatically select the operations of each layer as well as network width and depth via gradient descent. During the search process, the proposed MoD-NAS remains stable because of the smoother search space designed under the model-guided framework. Experimental results on several popular datasets show that our MoD-NAS method has achieved at least comparable even better PSNR performance than current state-of-the-art methods with fewer parameters, fewer flops, and less testing time.

Image Denoising Algorithm Based on Gradient Domain Guided Filtering and NSST

Traditional image denoising methods, which do not depend on data training, have good interpretability. However, traditional image denoising methods hardly achieve the denoising effect of deep learning methods. Based on traditional image processing techniques, this paper proposes a new hybrid image denoising model. The block-batching and 3-D filtering (BM3D) algorithm is used to obtain the first denoised image. The weighted kernel norm minimization (WNNM) and non-subsampled shearlet transform (NSST) algorithms are successively adopted to get the second denoised image. By the gradient domain guided filtering, the texture information of the first denoised image is extracted to enhance the details of the second denoised image. Specially, we propose the adaptive iterative NSST algorithm based on the improved soft thresholding, in order to solve the problems about the discontinuity of the hard thresholding and the constant deviation of the soft thresholding. Our approach can not only attenuate excessive smoothing, but also restore the natural appearance of the image. Experiments are conducted to demonstrate that our proposed method enjoys PSNR and SSIM performance gains over several deep learning denoising methods.

Safeguarding Digital Essence: A Sub-band DCT Neural Watermarking Paradigm Leveraging GRNN and CNN for Unyielding Image Protection and Identification

Image watermarking preserves digital content. This study introduces a new watermarking approach employing Sub-Band Discrete Cosine Transform and Deep neural networks, GRNN and CNN. The method embeds robust, invisible watermarks in greyscale photos and compares the two neural network topologies. The watermark is added using sub-band DCT. Watermark embedding in low-frequency sub-bands resists photo processing. The binary watermark modifies sub-band DCT coefficients to determine embedding intensity, resisting signal deterioration, and assaults. GRNN and CNN neural networks extract watermarks accurately. CNN extracts hierarchical features from images, enabling robust watermark recovery even under distortions, whereas non-parametric GRNN stores the whole training data to create predictions. The watermarking approach is tested on several greyscale photos. PSNR, SSIM, MSE, and NCC measure performance. The watermark tests noise addition, compression, and filtering. Compare GRNN and CNN's watermark extraction strengths and shortcomings to assess image watermarking suitability.

A Transfer learning model for high secure image steganography using ResNet-50

Cryptography is commonly employed in data security, but one of the main disadvantages of the scheme would be that it attracts attention to just the perpetrator, which results throughout the exposure of the data. In order to solve these issues, digital image steganography is among the several techniques used to provide protection during data transmission. Capacity embedding and distortion are indeed the two key factors that play a key role when hiding a message in image. Therefore, this paper explores strategies consisting of two steps leading to the creation of that very stable framework with a large embedding ability. The first step determines an arbitrary image by morphing through hybrid discrete wavelet transform (HDWT) in order to produce a cover image that relies on the characteristics of both the chosen image. That second step integrates a text message of adequate duration using the transfer learning based ResNet50 architecture, integrating multi-keys and compound operators into the algorithm to provide robust protection. Simulation results shows that the proposed method resulted in superior PSNR and SSIM performance as compared to state of art approaches.Finally, the robustness and imperceptibility of the proposed method is improved, which reduced the attacks on the system.

Multichannel Cross-Scale Semantic Coherent Attention Network for Image Inpainting

This paper investigates a cross-scale space semantic feature coherent image inpainting approach since it is challenging for the existing image inpainting methods to fuse the semantic feature information effectively. Firstly, we learn the feature semantic relevance step-by-step from the high-level semantic feature map’s attention mechanism and then we apply what we have learned to the preceding low-level feature map. In order to preserve the visual and semantic coherence of image repair, the missing content can be filled by changing attention from deep to shallow in a multiscale manner. A broader receptive field is generated by partial convolution, and semantic feature relevance is achieved using a multiscale cross feature space feature attention mechanism based on semantic attention. This technique improves the extensibility and continuity of the restored images by reconstructing the semantic information of different feature spaces, not only taking into account the reuse of existing semantic space features but also including across feature spaces. The experimental results demonstrated an improvement in PSNR, SSIM, and L1 performance by 10.50%, 0.13%, and 47.09%, respectively, with clear benefits.

Attention based deep convolutional U-Net with CSA optimization for hyperspectral image denoising

Hyperspectral image (HSI) de-noising plays a significant role in HSI quality enhancement because it consists of rich image information. Although, large amounts of information commonly have a lot of noise which will greatly impact HSI processing and application. Deep convolution neural networks (CNNs) have been predominant in image de-noising because of recent advances in deep learning. However, CNNs may result in performance degradation due to plain network depth growth. It leads to face challenges in the shallow image feature fusion and limits the potential of the network to extract HSI features. To overcome these problems, an attention-based deep convolutional U-Net is proposed in this research work. It improves the down-sampling and up-sampling strategies to extract the image features and restore the HSI information, respectively. In order to provide better de-noising performance, the edge information of the image is extracted with the aid of a depthwise and polarized self-attention mechanism. Moreover, the clonal selection optimization algorithm (CSOA) minimizes the loss function obtained from the proposed system by selecting optimal parameters. The dataset used to evaluate the proposed model is the Real-World Hyperspectral Images database and is implemented in the working platform of Python. The experimental result shows that the proposed system performs better than existing state-of-the-art de-noising schemes. The achieved PSNR, SSIM, SAM and ERGAS performance metrics values are: 35.82, 0.94, 3.14 and 19.42, respectively.

Deep Learning-Based Synthesized View Quality Enhancement with DIBR Distortion Mask Prediction Using Synthetic Images.

Recently, deep learning-based image quality enhancement models have been proposed to improve the perceptual quality of distorted synthesized views impaired by compression and the Depth Image-Based Rendering (DIBR) process in a multi-view video system. However, due to the lack of Multi-view Video plus Depth (MVD) data, the training data for quality enhancement models is small, which limits the performance and progress of these models. Augmenting the training data to enhance the synthesized view quality enhancement (SVQE) models is a feasible solution. In this paper, a deep learning-based SVQE model using more synthetic synthesized view images (SVIs) is suggested. To simulate the irregular geometric displacement of DIBR distortion, a random irregular polygon-based SVI synthesis method is proposed based on existing massive RGB/RGBD data, and a synthetic synthesized view database is constructed, which includes synthetic SVIs and the DIBR distortion mask. Moreover, to further guide the SVQE models to focus more precisely on DIBR distortion, a DIBR distortion mask prediction network which could predict the position and variance of DIBR distortion is embedded into the SVQE models. The experimental results on public MVD sequences demonstrate that the PSNR performance of the existing SVQE models, e.g., DnCNN, NAFNet, and TSAN, pre-trained on NYU-based synthetic SVIs could be greatly promoted by 0.51-, 0.36-, and 0.26 dB on average, respectively, while the MPPSNRr performance could also be elevated by 0.86, 0.25, and 0.24 on average, respectively. In addition, by introducing the DIBR distortion mask prediction network, the SVI quality obtained by the DnCNN and NAFNet pre-trained on NYU-based synthetic SVIs could be further enhanced by 0.02- and 0.03 dB on average in terms of the PSNR and 0.004 and 0.121 on average in terms of the MPPSNRr.

A Generative Image Inpainting Model Based on Edge and Feature Self-Arrangement Constraints.

At present, the image inpainting method based on deep learning has achieved a better inpainting effect than traditional methods, but the inpainting results still have problems such as local structure disorder and blurred texture when the images involving a large defect area are processed. This paper proposes a second-order generative image inpainting model based on edge and feature self-arrangement constraints. The model consists of two parts: edge repair network and image repair network. Based on the self-encoder, the edge repair network generates the edges in the defect area according to the known information of the image and improves the edge repair effect by minimizing the adversarial loss and feature matching loss. The image inpainting network fills the defect area with the edge repair result as a priori condition. On the basis of U-Net, the feature self-arrangement module (FSM) is proposed to reconstruct the coding features of a specific scale, and the reconstructed feature skips to connect the decoding layer of the same scale, and it is fused with the upper layer underlying features for decoding. Meanwhile, guide loss, adversarial loss, and reconstruction loss are introduced to narrow the difference between the repaired image and the original image. The experimental results show that the inpainting results of the proposed model have stronger structural connectivity and clearer textures and the performance of PSNR, SSIM, and mean L1 loss in the Celeba, Facade, and Places2 is better than other inpainting methods, indicating that the algorithm can produce an inpainting effect with highly connected structure, reasonable semantics, and fine details.

Graph signal processing and tunicate swarm optimization based image steganography using hybrid chaotic map based image scrambling

This paper put forwards a secure image steganography technique for transmitting sensitive data using a Tunicate swarm optimization algorithm. A hybrid chaotic map-based image scrambling method is proposed with the combination of Tent and Tinkerbell chaotic maps. The scrambling of the secret image provides an added level of security in data hiding. The graph signal processing of cover image using the Meyer wavelet filter is performed to conceal the secret data within the transformed cover image using the alpha blending operation. To discover the optimal value of alpha for alpha blending, the tunicate swarm optimization algorithm is employed. To take the hidden information out at receiver end, the reverse approach is applied. The experimental results revealed that the embedding technique using the tunicate algorithm with a hybrid chaotic map provides better imperceptibility and robustness in comparison to the existing graph signal-based image steganography technique. The investigation is done on PSNR, MSE and SSIM performance parameters for evaluating the proposed technique.

Intraprediction Complexity Control Algorithm Based on Visual Saliency

Intraprediction is one of the most complex parts of High-Efficiency Video Coding (HEVC), because it selects the best prediction mode by calculating the cost of every Coding Unit (CU), which provides higher complexity of intracoding. Visual saliency map can show the attention regions of the human eyes, which is generated by certain static and space-time saliency detection method. By analyzing the percentage of coding time for different size CU, and the relation of visual saliency and CU depth, an intraprediction complexity control algorithm based on visual saliency is proposed in this paper. Based on the feature of the video and the target level, the saliency threshold is adapted to determine whether the current CU in the intraprediction processing should be split into smaller CUs or the division processing should be stopped early. Three samples were compared by the proposed algorithm and other algorithm, and the proposed algorithm has better performance in PSNR, BitRate, and coding time. Experimental results show that this algorithm can effectively control the coding complexity of intraprediction with minimal visual loss and can be applied to a number of scenarios, such as real-time video coding.

Dual-domain sparse-view CT reconstruction with Transformers

Purpose:Computed Tomography (CT) has been widely used in the medical field. Sparse-view CT is an effective and feasible method to reduce the radiation dose. However, the conventional filtered back projection (FBP) algorithm will suffer from severe artifacts in sparse-view CT. Iterative reconstruction algorithms have been adopted to remove artifacts, but they are time-consuming due to repeated projection and back projection and may cause blocky effects. To overcome the difficulty in sparse-view CT, we proposed a dual-domain sparse-view CT algorithm CT Transformer (CTTR) and paid attention to sinogram information. Methods:CTTR treats sinograms as sentences and enhances reconstructed images with sinogram’s characteristics. We qualitatively evaluate the CTTR, an iterative method TVM-POCS, a convolutional neural network based method FBPConvNet in terms of a reduction in artifacts and a preservation of details. Besides, we also quantitatively evaluate these methods in terms of RMSE, PSNR and SSIM. Results:We evaluate our method on the Lung Image Database Consortium image collection with different numbers of projection views and noise levels. Experiment studies show that, compared with other methods, CTTR can reduce more artifacts and preserve more details on various scenarios. Specifically, CTTR improves the FBPConvNet performance of PSNR by 0.76dB with 30 projections. Conclusions:The performance of our proposed CTTR is better than the method based on CNN in the case of extremely sparse views both on visual results and quantitative evaluation. Our proposed method provides a new idea for the application of Transformers to CT image processing.

Ultra high speed SPECT bone imaging enabled by a deep learning enhancement method: a proof of concept

BackgroundTo generate high-quality bone scan SPECT images from only 1/7 scan time SPECT images using deep learning-based enhancement method.Materials and methodsNormal-dose (925–1110 MBq) clinical technetium 99 m-methyl diphosphonate (99mTc-MDP) SPECT/CT images and corresponding SPECT/CT images with 1/7 scan time from 20 adult patients with bone disease and a phantom were collected to develop a lesion-attention weighted U2-Net (Qin et al. in Pattern Recognit 106:107404, 2020), which produces high-quality SPECT images from fast SPECT/CT images. The quality of synthesized SPECT images from different deep learning models was compared using PSNR and SSIM. Clinic evaluation on 5-point Likert scale (5 = excellent) was performed by two experienced nuclear physicians. Average score and Wilcoxon test were constructed to assess the image quality of 1/7 SPECT, DL-enhanced SPECT and the standard SPECT. SUVmax, SUVmean, SSIM and PSNR from each detectable sphere filled with imaging agent were measured and compared for different images.ResultsU2-Net-based model reached the best PSNR (40.8) and SSIM (0.788) performance compared with other advanced deep learning methods. The clinic evaluation showed the quality of the synthesized SPECT images is much higher than that of fast SPECT images (P < 0.05). Compared to the standard SPECT images, enhanced images exhibited the same general image quality (P > 0.999), similar detail of 99mTc-MDP (P = 0.125) and the same diagnostic confidence (P = 0.1875). 4, 5 and 6 spheres could be distinguished on 1/7 SPECT, DL-enhanced SPECT and the standard SPECT, respectively. The DL-enhanced phantom image outperformed 1/7 SPECT in SUVmax, SUVmean, SSIM and PSNR in quantitative assessment.ConclusionsOur proposed method can yield significant image quality improvement in the noise level, details of anatomical structure and SUV accuracy, which enabled applications of ultra fast SPECT bone imaging in real clinic settings.

A Dynamic Convolution Kernel Generation Method Based on Regularized Pattern for Image Super-Resolution.

Image super-resolution aims to reconstruct a high-resolution image from its low-resolution counterparts. Conventional image super-resolution approaches share the same spatial convolution kernel for the whole image in the upscaling modules, which neglect the specificity of content information in different positions of the image. In view of this, this paper proposes a regularized pattern method to represent spatially variant structural features in an image and further exploits a dynamic convolution kernel generation method to match the regularized pattern and improve image reconstruction performance. To be more specific, first, the proposed approach extracts features from low-resolution images using a self-organizing feature mapping network to construct regularized patterns (RP), which describe different contents at different locations. Second, the meta-learning mechanism based on the regularized pattern predicts the weights of the convolution kernels that match the regularized pattern for each different location; therefore, it generates different upscaling functions for images with different content. Extensive experiments are conducted using the benchmark datasets Set5, Set14, B100, Urban100, and Manga109 to demonstrate that the proposed approach outperforms the state-of-the-art super-resolution approaches in terms of both PSNR and SSIM performance.