Quality Evaluation Metrics Research Articles

Efficient Dehazing with Recursive Gated Convolution in U-Net: A Novel Approach for Image Dehazing.

Image dehazing, a fundamental problem in computer vision, involves the recovery of clear visual cues from images marred by haze. Over recent years, deploying deep learning paradigms has spurred significant strides in image dehazing tasks. However, many dehazing networks aim to enhance performance by adopting intricate network architectures, complicating training, inference, and deployment procedures. This study proposes an end-to-end U-Net dehazing network model with recursive gated convolution and attention mechanisms to improve performance while maintaining a lean network structure. In our approach, we leverage an improved recursive gated convolution mechanism to substitute the original U-Net's convolution blocks with residual blocks and apply the SK fusion module to revamp the skip connection method. We designate this novel U-Net variant as the Dehaze Recursive Gated U-Net (DRGNet). Comprehensive testing across public datasets demonstrates the DRGNet's superior performance in dehazing quality, detail retrieval, and objective evaluation metrics. Ablation studies further confirm the effectiveness of the key design elements.

Quantitative Comparison against Experiments Reveals Imperfections in Force Fields' Descriptions of POPC-Cholesterol Interactions.

Cholesterol is a central building block in biomembranes, where it induces orientational order, slows diffusion, renders the membrane stiffer, and drives domain formation. Molecular dynamics (MD) simulations have played a crucial role in resolving these effects at the molecular level; yet, it has recently become evident that different MD force fields predict quantitatively different behavior. Although easily neglected, identifying such limitations is increasingly important as the field rapidly progresses toward simulations of complex membranes mimicking the in vivo conditions: pertinent multicomponent simulations must capture accurately the interactions between their fundamental building blocks, such as phospholipids and cholesterol. Here, we define quantitative quality measures for simulations of binary lipid mixtures in membranes against the C-H bond order parameters and lateral diffusion coefficients from NMR spectroscopy as well as the form factors from X-ray scattering. Based on these measures, we perform a systematic evaluation of the ability of commonly used force fields to describe the structure and dynamics of binary mixtures of palmitoyloleoylphosphatidylcholine (POPC) and cholesterol. None of the tested force fields clearly outperforms the others across the tested properties and conditions. Still, the Slipids parameters provide the best overall performance in our tests, especially when dynamic properties are included in the evaluation. The quality evaluation metrics introduced in this work will, particularly, foster future force field development and refinement for multicomponent membranes using automated approaches.

Intra-block pyramid cross-scale network for thermal radiation effect correction of uncooled infrared images.

Thermal radiation effects can greatly degrade the image quality of uncooled infrared focal plane array detection systems. In this paper, we propose a thermal radiation effect correction network based on intra-block pyramid cross-scale feature extraction and fusion. First, an intra-block pyramid residual attention module is introduced to obtain fine-grained features from long-range IR images by extracting cross-scale local features within the residual block. Second, we propose a cross-scale gated fusion module to efficiently integrate the shallow and abstract features at multiple scales of the encoder and decoder through gated linear units. Finally, to ensure accurate correction of thermal radiation effects, we add double-loss constraints in the spatial-frequency domain and construct a single-input, multi-output network with multiple supervised constraints. The experimental results demonstrate that our proposed method outperforms state-of-the-art correction methods in terms of both visual quality and quantitative evaluation metrics.

Screen content video quality assessment based on spatiotemporal sparse feature

In recent years, the explosive growth of application scenarios have occurred in screen content videos (SCVs), in which the SCVs are unavoidably suffered from the quality degradation and the video quality assessment (VQA) of the SCVs becomes very essential. In view of this, a full-reference VQA algorithm, called the spatiotemporal sparse feature-based model (SSFM) is proposed in this paper, aiming to give a precise and efficient quality evaluation about the distorted SCVs. Note that the SCVs are full of edge information which the human eyes are highly sensitive to, and the sparse coding can provide accurate quantitative predictions which are consistent with the perception resulted from the cerebral cortex in various receptive field models of the visual cortex. With these considerations, three dimensional Difference of Gaussian (3D-DOG) filter and 3D Sparse Dictionary are developed to extract multi-scale spatiotemporal features and obtain spatiotemporal sparse features respectively, from the reference and distorted SCVs. Based on these features, the spatiotemporal sparse feature similarity can be measured and followed by generating the quality scores of the distorted SCVs under evaluation. Compared to other classic and state-of-the-art image/video quality evaluation metrics, the experimental results of the proposed SSFM on the screen content video database (SCVD) are more consistent with the perceived evaluation of SCVs according to the human visual system (HVS).

Low-light image enhancement based on virtual exposure

Under poor illumination, the image information captured by a camera is partially lost, which seriously affects the visual perception of the human. Inspired by the idea that the fusion of multiexposure images can yield one high-quality image, an adaptive enhancement framework for a single low-light image is proposed based on the strategy of virtual exposure. In this framework, the exposure control parameters are adaptively generated through a statistical analysis of the low-light image, and a virtual exposure enhancer constructed by a quadratic function is applied to generate several image frames from a single input image. Then, on the basis of generating weight maps by three factors, i.e., contrast, saturation and saliency, the image sequences and weight images are transformed by a Laplacian pyramid and Gaussian pyramid, respectively, and multiscale fusion is implemented layer by layer. Finally, the enhanced result is obtained by pyramid reconstruction rule. Compared with the experimental results of several state-of-the-art methods on five datasets, the proposed method shows its superiority on several image quality evaluation metrics. This method requires neither image calibration nor camera response function estimation and has a more flexible application range. It can weaken the possibility of overenhancement, effectively avoid the appearance of a halo in the enhancement results, and adaptively improve the visual information fidelity.

Visual Quality Assessment of Point Clouds Compared to Natural Reference Images

This paper proposes a point cloud (PC) visual quality assessment (VQA) framework that reflects the human visual system (HVS). The proposed framework compares natural images acquired using a digital camera and PC images generated via 2D projection in terms of appropriate objective quality evaluation metrics. Humans primarily consume natural images; thus, human knowledge is typically formed from natural images. Thus, natural images can be more reliable reference data than PC data. The proposed framework performs an image alignment process based on feature matching and image warping to use the natural images as a reference which enhances the similarities of the acquired natural and corresponding PC images. The framework facilitates identifying which objective VQA metrics can be used to reflect the HVS effectively. We constructed a database of natural images and three PC image qualities, and objective and subjective VQAs were conducted. The experimental result demonstrates that the acceptable consistency among different PC qualities appears in the metrics that compare the global structural similarity of images. We found that the SSIM, MAD, and GMSD achieved remarkable Spearman rank-order correlation coefficient scores of 0.882, 0.871, and 0.930, respectively. Thus, the proposed framework can reflect the HVS by comparing the global structural similarity between PC and natural reference images.

An integrated image visibility graph and topological data analysis for extracting time series features

A time series can often be characterized using machine learning techniques, which require feature vectors as input. The quality of the feature vectors reflects the accuracy of the utilized machine learning techniques. We propose a method for combining features extracted from two popular techniques, one from the persistence diagram, a summary of topological data analysis, and another from the visibility graph, a popular approach for constructing complex networks. We further present a method for extracting features from time series by transforming the series into a two-dimensional array and applying a 2-dimensional visibility graph. The 2-dimensional visibility graph improves the quality of the features for clustering. The features extracted from the techniques are utilized for clustering 1100 time series samples simulated from 11 classes. The two clustering quality evaluation metrics namely normalized mutual info score and adjusted rand score, which are scores given to clustering algorithms, are used to measure the clustering quality. Inclusion of 2-dimensional visibility graph features increases the values of these metrics for classifying the time series. Therefore, the results confirm the usefulness of including a 2-dimensional visibility graph from time series clustering and analysis.

A benchmark study of convolutional neural networks in fully automatic segmentation of aortic root.

Recent clinical studies have suggested that introducing 3D patient-specific aortic root models into the pre-operative assessment procedure of transcatheter aortic valve replacement (TAVR) would reduce the incident rate of peri-operative complications. Tradition manual segmentation is labor-intensive and low-efficient, which cannot meet the clinical demands of processing large data volumes. Recent developments in machine learning provided a viable way for accurate and efficient medical image segmentation for 3D patient-specific models automatically. This study quantitively evaluated the auto segmentation quality and efficiency of the four popular segmentation-dedicated three-dimensional (3D) convolutional neural network (CNN) architectures, including 3D UNet, VNet, 3D Res-UNet and SegResNet. All the CNNs were implemented in PyTorch platform, and low-dose CTA image sets of 98 anonymized patients were retrospectively selected from the database for training and testing of the CNNs. The results showed that despite all four 3D CNNs having similar recall, Dice similarity coefficient (DSC), and Jaccard index on the segmentation of the aortic root, the Hausdorff distance (HD) of the segmentation results from 3D Res-UNet is 8.56 ± 2.28, which is only 9.8% higher than that of VNet, but 25.5% and 86.4% lower than that of 3D UNet and SegResNet, respectively. In addition, 3D Res-UNet and VNet also performed better in the 3D deviation location of interest analysis focusing on the aortic valve and the bottom of the aortic root. Although 3D Res-UNet and VNet are evenly matched in the aspect of classical segmentation quality evaluation metrics and 3D deviation location of interest analysis, 3D Res-UNet is the most efficient CNN architecture with an average segmentation time of 0.10 ± 0.04 s, which is 91.2%, 95.3% and 64.3% faster than 3D UNet, VNet and SegResNet, respectively. The results from this study suggested that 3D Res-UNet is a suitable candidate for accurate and fast automatic aortic root segmentation for pre-operative assessment of TAVR.

Renal Pathology Images Segmentation Based on Improved Cuckoo Search with Diffusion Mechanism and Adaptive Beta-Hill Climbing.

Lupus Nephritis (LN) is a significant risk factor for morbidity and mortality in systemic lupus erythematosus, and nephropathology is still the gold standard for diagnosing LN. To assist pathologists in evaluating histopathological images of LN, a 2D Rényi entropy multi-threshold image segmentation method is proposed in this research to apply to LN images. This method is based on an improved Cuckoo Search (CS) algorithm that introduces a Diffusion Mechanism (DM) and an Adaptive β-Hill Climbing (AβHC) strategy called the DMCS algorithm. The DMCS algorithm is tested on 30 benchmark functions of the IEEE CEC2017 dataset. In addition, the DMCS-based multi-threshold image segmentation method is also used to segment renal pathological images. Experimental results show that adding these two strategies improves the DMCS algorithm's ability to find the optimal solution. According to the three image quality evaluation metrics: PSNR, FSIM, and SSIM, the proposed image segmentation method performs well in image segmentation experiments. Our research shows that the DMCS algorithm is a helpful image segmentation method for renal pathological images.

Quality and performance evaluation metrics of websites : a systematic literature review

Background - Websites play an important role in government, educational and commercial organizations. In the field of education, using websites of universities has been increased and because of that it has been importance to ensure that the universities have an effective websites. Various metrics have been used to evaluate the quality of websites. All these metrics affect the performance and quality of website .
 Objectives - This paper presented a systematic literature review SLR to get an overview about the current studies of distinct criteria for evaluating the websites and each criteria is explored briefly to give the basic idea behind it. In general, the paper’s objective is to give an up-to-date introduction and short review of these criteria . 
 Methods – A Systematic literature review is implemented according to the guidelines of performing a SLR in software engineering. The study was based on a comprehensive set of papers gathered from the online libraries published within time span 2010 to 2022 .
 Conclusions - The results from this SLR include information about the criteria for evaluating the quality and performance of the multi-level web according to previous research, which was divided into applicable sub-criteria, and then the latter was divided into measurable indicators. within a specific period that can help researchers in this field through providing an overview of the current researches in this area. Furthermore, it may serve as a first step towards a great explanation of the topic with the help of SLR .

Multimodal medical image fusion based on visual saliency map and multichannel dynamic threshold neural P systems in sub-window variance filter domain

As a powerful image enhancement technique, multimodal medical image fusion has been widely used for biomedical diagnosis and surgical navigation. However, the trade-off between efficiency and fusion quality for existing fusion images remains a great challenge. In this study, a robust and efficient medical image fusion method based on a sub-window variance filter (SVF) is proposed to overcome the above problems. First, the input images are decomposed two-layer using SVF, the base layer including rich energy and contour intensity information, and the detail layer containing integral detail features. Then, a contrast function is employed to improve the MRI base layer and a neighbor energy function to refine the detail layer. Next, a novel multichannel dynamic threshold neural P system is proposed to fuse the detail layer, which can provide a comprehensive consideration of the information in the detail layer and compensate well for the defect of the single-channel model. Moreover, a visual saliency map (VSM-based) is designed to fuse the base layer, preserving important energy information and improving image contrast. Finally, the fused result is reconstructed by the inverse SVF. Ten representative current multimodal medical image fusion methods are compared, and six typical quality evaluation metrics are combined to objectively evaluate the fused images. Tremendous experimental results indicate that the proposed model can effectively preserve higher contrast, more complete edge features, and better color than some state-of-the-art algorithms, both visual quality and quantitative evaluations on public datasets.

A joint convolution auto-encoder network for infrared and visible image fusion

Background: Leaning redundant and complementary relationships is a critical step in the human visual system. Inspired by the infrared cognition ability of crotalinae animals, we design a joint convolution auto-encoder (JCAE) network for infrared and visible image fusion. Methods: Our key insight is to feed infrared and visible pair images into the network simultaneously and separate an encoder stream into two private branches and one common branch, the private branch works for complementary features learning and the common branch does for redundant features learning. We also build two fusion rules to integrate redundant and complementary features into their fused feature which are then fed into the decoder layer to produce the final fused image. We detail the structure, fusion rule and explain its multi-task loss function. Results: Our JCAE network achieves good results in terms of both visual quality and objective evaluation metrics.

Transfer learning framework for low-dose CT reconstruction based on marginal distribution adaptation in multi-scale.

With the increasing use of CT in clinical practice, limiting CT radiation exposure to reduce potential cancer risks has become one of the important directions of medical imaging research. As the dose decreases, the reconstructed CT image will be severely degraded by projection noise. As an important method of image processing, supervised deep learning has been widely used in the restoration of low-dose CT(LDCT) in recent years. However, the normal-dose CT (NDCT) corresponding to a specific LDCT (it is regareded as the label of the LDCT, which is necessary for supervised learning) are very difficult to obtain. So that the application of supervised learning methods in LDCT reconstruction is limited. It is necessary to construct a unsupervised deep learning framework for LDCT reconstruction that does not depend on paired LDCT-NDCTdatasets. We presented an unsupervised learning framework for the transferring from the identity mapping to the low-dose recontruction task, called Marginal Distribution Adaptation in Multi-scale (MDAM). For NDCTs as source domain data, MDAM is an identity map with two parts: firstly, it establishes a dimensionality reduction mapping, which can obtain the same feature distribution from NDCTs and LDCTs; and then NDCTs is retrieved by reconstructing the image overview and details from the low-dimensional features. For the purpose of the feature transfer between source domain and target domain (LDCTs), we introduce the multi-scale feature extraction in the MDAM, and then eliminate differences in probability distributions of these multi-scale features between NDCTs and LDCTs through wavelet decomposition and domain adaptationlearning. Image quality evaluation metrics and subjective quality scores show that, as an unsupervised method, the performance of the MDAM approaches or even surpasses some state-of-the-art supervised methods. Especially, MDAM has been favorably evaluated in terms of noise suppression, structural preservation, and lesiondetection. We demonstrated that, the MDAM framework can reconstruct corresponding NDCTs from LDCTs with high accuracy, and without relying on any labeles. Moreover, it is more suitable for clinical application compared with supervised learningmethods. This article is protected by copyright. All rights reserved.

Infrared and Visible Image Fusion Method Based on a Principal Component Analysis Network and Image Pyramid

The aim of infrared (IR) and visible image fusion is to generate a more informative image for human observation or some other computer vision tasks. The activity-level measurement and weight assignment are two key parts in image fusion. In this paper, we propose a novel IR and visible fusion method based on the principal component analysis network (PCANet) and an image pyramid. Firstly, we use the lightweight deep learning network, a PCANet, to obtain the activity-level measurement and weight assignment of IR and visible images. The activity-level measurement obtained by the PCANet has a stronger representation ability for focusing on IR target perception and visible detail description. Secondly, the weights and the source images are decomposed into multiple scales by the image pyramid, and the weighted-average fusion rule is applied at each scale. Finally, the fused image is obtained by reconstruction. The effectiveness of the proposed algorithm was verified by two datasets with more than eighty pairs of test images in total. Compared with nineteen representative methods, the experimental results demonstrate that the proposed method can achieve the state-of-the-art results in both visual quality and objective evaluation metrics.

A Retinex-based variational model for noise suppression and nonuniform illumination correction in corneal confocal microscopy images

Objective. Corneal confocal microscopy (CCM) image analysis is a non-invasive in vivo clinical technique that can quantify corneal nerve fiber damage. However, the acquired CCM images are often accompanied by speckle noise and nonuniform illumination, which seriously affects the analysis and diagnosis of the diseases. Approach. In this paper, first we propose a variational Retinex model for the inhomogeneity correction and noise removal of CCM images. In this model, the Beppo Levi space is introduced to constrain the smoothness of the illumination layer for the first time, and the fractional order differential is adopted as the regularization term to constrain reflectance layer. Then, a denoising regularization term is also constructed with Block Matching 3D (BM3D) to suppress noise. Finally, by adjusting the uneven illumination layer, we obtain the final results. Second, an image quality evaluation metric is proposed to evaluate the illumination uniformity of images objectively. Main results. To demonstrate the effectiveness of our method, the proposed method is tested on 628 low-quality CCM images from the CORN-2 dataset. Extensive experiments show the proposed method outperforms the other four related methods in terms of noise removal and uneven illumination suppression. Significance This demonstrates that the proposed method may be helpful for the diagnostics and analysis of eye diseases.

Fusion of Quality Evaluation Metrics and Convolutional Neural Network Representations for ROI Filtering in LC-MS.

Region of interest (ROI) extraction is a fundamental step in analyzing metabolomic datasets acquired by liquid chromatography-mass spectrometry (LC-MS). However, noises and backgrounds in LC-MS data often affect the quality of extracted ROIs. Therefore, developing effective ROI evaluation algorithms is necessary to eliminate false positives meanwhile keep the false-negative rate as low as possible. In this study, a deep fused filter of ROIs (dffROI) was proposed to improve the accuracy of ROI extraction by combining the handcrafted evaluation metrics with convolutional neural network (CNN)-learned representations. To evaluate the performance of dffROI, dffROI was compared with peakonly (CNN-learned representation) and five handcrafted metrics on three LC-MS datasets and a gas chromatography-mass spectrometry (GC-MS) dataset. Results show that dffROI can achieve higher accuracy, better true-positive rate, and lower false-positive rate. Its accuracy, true-positive rate, and false-positive rate are 0.9841, 0.9869, and 0.0186 on the test set, respectively. The classification error rate of dffROI (1.59%) is significantly reduced compared with peakonly (2.73%). The model-agnostic feature importance demonstrates the necessity of fusing handcrafted evaluation metrics with the convolutional neural network representations. dffROI is an automatic, robust, and universal method for ROI filtering by virtue of information fusion and end-to-end learning. It is implemented in Python programming language and open-sourced at https://github.com/zhanghailiangcsu/dffROI under BSD License. Furthermore, it has been integrated into the KPIC2 framework previously proposed by our group to facilitate real metabolomic LC-MS dataset analysis.

A Non-Reference Evaluation of Underwater Image Enhancement Methods Using a New Underwater Image Dataset

The rise of vision-based environmental, marine, and oceanic exploration research highlights the need for supporting underwater image enhancement techniques to help mitigate water effects on images such as blurriness, low color contrast, and poor quality. This paper presents an evaluation of common underwater image enhancement techniques using our new publicly-available Challenging Dataset for Underwater Image Enhancement (CDUIE). The collected dataset is comprised of 85 images of aquatic plants taken at a shallow depth of up to three meters from three different locations in the Great Lake Superior, USA, via a Remotely Operated Vehicle (ROV) equipped with a high-definition RGB camera. In particular, we use our dataset to benchmark nine state-of-the-art image enhancement models at three different depths using a set of common non-reference image quality evaluation metrics. Then we provide a comparative analysis of the performance of the selected models at different depths and highlight the most prevalent ones. The obtained results show that the selected image enhancement models are capable of producing considerably better-quality images with some models performing better than others at certain depths. The dataset is available at <uri xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">https://www.github.com/ashrafrepo/underwater-image-enhancement</uri> .

Turbid Underwater Image Enhancement Based on Parameter-Tuned Stochastic Resonance

In turbid water, the attenuation and scattering of light caused by scatterers make underwater optical images degraded, blurred, and contrast reduced, limiting the extraction and analysis of information from images. To address such problems, a turbid underwater image enhancement method based on parameter-tuned stochastic resonance (SR) is proposed in this article. First, an SR algorithm framework for underwater image enhancement is constructed, including the dimensionality reduction and normalization of input images, the solution and parameter optimization of the SR system, the dimensionality upgrading of output images, etc. This framework can apply the SR's ability to enhance weak signals to the enhancement of turbid underwater images. Second, to measure the performance of the system, a synthetic turbid underwater image data set (UWCHIC) is constructed using the underwater imaging model and an image set with simulated scatterers. Based on this data set, the relationship between various image quality evaluation metrics and system parameters is analyzed, and then the suitable no-reference (NR) metrics for system performance evaluation are selected and an adaptive parameter tuning strategy of the SR system is proposed to guide the image enhancement. Lastly, the proposed method is evaluated on the UWCHIC, a dataset to evaluate underwater image restoration methods (TURBID), marine underwater environment database (MUED), and underwater image enhancement benchmark (UIEB) data sets and the turbid underwater images captured from natural waters. Different experimental evaluations demonstrated that the proposed method not only effectively enhances the visual quality of turbid underwater images but also improves the performance of downstream vision tasks.

SECURE: A Segmentation Quality Evaluation Metric on SEM Images for Reverse Engineering on Integrated Circuits

SECURE: A Segmentation Quality Evaluation Metric on SEM Images for Reverse Engineering on Integrated Circuits

A Brief Analysis of Multimodal Medical Image Fusion Techniques

Recently, image fusion has become one of the most promising fields in image processing since it plays an essential role in different applications, such as medical diagnosis and clarification of medical images. Multimodal Medical Image Fusion (MMIF) enhances the quality of medical images by combining two or more medical images from different modalities to obtain an improved fused image that is clearer than the original ones. Choosing the best MMIF technique which produces the best quality is one of the important problems in the assessment of image fusion techniques. In this paper, a complete survey on MMIF techniques is presented, along with medical imaging modalities, medical image fusion steps and levels, and the assessment methodology of MMIF. There are several image modalities, such as Computed Tomography (CT), Positron Emission Tomography (PET), Magnetic Resonance Imaging (MRI), and Single Photon Emission Computed Tomography (SPECT). Medical image fusion techniques are categorized into six main categories: spatial domain, transform fusion, fuzzy logic, morphological methods, and sparse representation methods. The MMIF levels are pixel-level, feature-level, and decision-level. The fusion quality evaluation metrics can be categorized as subjective/qualitative and objective/quantitative assessment methods. Furthermore, a detailed comparison between obtained results for significant MMIF techniques is also presented to highlight the pros and cons of each fusion technique.