Multi-scale Structural Similarity Index Research Articles

Generalized 3D registration algorithm for enhancing retinal optical coherence tomography images.

Optical coherence tomography (OCT) has emerged as the standard of care for diagnosing and monitoring the treatment of various ocular disorders due to its noninvasive nature and in vivo volumetric acquisition capability. Despite its widespread applications in ophthalmology, motion artifacts remain a challenge in OCT imaging, adversely impacting image quality. While several multivolume registration algorithms have been developed to address this issue, they are often designed to cater to one specific OCT system or acquisition protocol. We aim to generate an OCT volume free of motion artifacts using a system-agnostic registration algorithm that is independent of system specifications or protocol. We developed a B-scan registration algorithm that removes motion and corrects for both translational eye movements and rotational angle differences between volumes. Tests were carried out on various datasets obtained from two different types of custom-built OCT systems and one commercially available system to determine the reliability of the proposed algorithm. Additionally, different system specifications were used, with variations in axial resolution, lateral resolution, signal-to-noise ratio, and real-time motion tracking. The accuracy of this method has further been evaluated through mean squared error (MSE) and multiscale structural similarity index measure (MS-SSIM). The results demonstrate improvements in the overall contrast of the images, facilitating detailed visualization of retinal vasculatures in both superficial and deep vasculature plexus. Finer features of the inner and outer retina, such as photoreceptors and other pathology-specific features, are discernible after multivolume registration and averaging. Quantitative analyses affirm that increasing the number of averaged registered volumes will decrease MSE and increase MS-SSIM as compared to the reference volume. The multivolume registered data obtained from this algorithm offers significantly improved visualization of the retinal microvascular network as well as retinal morphological features. Furthermore, we have validated that the versatility of our methodology extends beyond specific OCT modalities, thereby enhancing the clinical utility of OCT for the diagnosis and monitoring of ocular pathologies.

Enhancing unsupervised rock CT image super-resolution with non-local attention

Traditional low-resolution rock core images fail to capture the details and features of rocks, limiting the accurate analysis of rock properties. Therefore, researchers have proposed supervised and unsupervised digital rock super-resolution reconstruction methods. Supervised methods require paired data and manual annotation, while unsupervised methods generate high-resolution images through self-learning that are suitable for real-world scenarios with a lack of paired data. However, the current unsupervised methods still face challenges in terms of consistency and feature capturing. To address this problem, a novel unsupervised single-image super-resolution model called NL-CycleGAN is proposed. This model employs a non-local attention-guided CycleGAN framework to effectively capture low-level pixel variations between unpaired source and target images while preserving the overall tone. To evaluate the performance of NL-CycleGAN, we conduct both quantitative and qualitative tests using the DeepRock-SR dataset. In terms of quantitative evaluation, our method achieved the lowest perceptual loss (LPIPS) metric compared to existing methods. Additionally, our model obtained the highest performance in peak signal-to-noise ratio (PSNR), and multi-scale structural similarity index measure (MS-SSIM). In qualitative testing, the comparison images clearly show that our model accurately captures the intricate details of pores in carbonate and sandstone, as well as the complex crack patterns in coal. In conclusion, our model contributes to improving rock resolution and provides more accurate image processing techniques for rock property analysis and geological research.

Noise reduction in low-dose positron emission tomography with adaptive parameter estimation in sinogram domain

Noise reduction in low-dose positron emission tomography (PET) is a well-researched topic aimed at reducing patient radiation doses and improving diagnosis. Software-based noise reduction mainly improves the contrast between regions by reducing the variation of the acquired image. However, it should be performed under appropriate parameters to reduce discrimination. We propose a method that derives optimal noise-reduction parameters using the multi-scale structural similarity index measure and visual information fidelity, which are metrics for image quality assessment. Simulation and experimental studies demonstrated the viability of the proposed algorithm. The contrast-to-noise ratio value of the denoised reconstruction slice, which was used as the optimal parameter, increased approximately three times compared to that of the low-dose slice while preserving the resolution. The results indicate that the proposed method successfully predicted the parameters according to the noise-reduction algorithm and PET system conditions in the sinogram domain. The proposed algorithm should help prevent misdiagnosis and provide standardized medical images for clinical application by performing appropriate noise reduction.

Breaking the limitations with sparse inputs by variational frameworks (BLIss) in terahertz super-resolution 3D reconstruction

Data acquisition, image processing, and image quality are the long-lasting issues for terahertz (THz) 3D reconstructed imaging. Existing methods are primarily designed for 2D scenarios, given the challenges associated with obtaining super-resolution (SR) data and the absence of an efficient SR 3D reconstruction framework in conventional computed tomography (CT). Here, we demonstrate BLIss, a new approach for THz SR 3D reconstruction with sparse 2D data input. BLIss seamlessly integrates conventional CT techniques and variational framework with the core of the adapted Euler-Elastica-based model. The quantitative 3D image evaluation metrics, including the standard deviation of Gaussian, mean curvatures, and the multi-scale structural similarity index measure (MS-SSIM), validate the superior smoothness and fidelity achieved with our variational framework approach compared with conventional THz CT modal. Beyond its contributions to advancing THz SR 3D reconstruction, BLIss demonstrates potential applicability in other imaging modalities, such as X-ray and MRI. This suggests extensive impacts on the broader field of imaging applications.

The Accuracy and Precision of Memory for Natural Scenes: A Walk in the Park.

It is challenging to quantify the accuracy and precision of scene memory because it is unclear what 'space' scenes occupy (how can we quantify error when misremembering a natural scene?). To address this, we exploited the ecologically valid, metric space in which scenes occur and are represented: routes. In a delayed estimation task, participants briefly saw a target scene drawn from a video of an outdoor 'route loop', then used a continuous report wheel of the route to pinpoint the scene. Accuracy was high and unbiased, indicating there was no net boundary extension/contraction. Interestingly, precision was higher for routes that were more self-similar (as characterized by the half-life, in meters, of a route's Multiscale Structural Similarity index), consistent with previous work finding a 'similarity advantage' where memory precision is regulated according to task demands. Overall, scenes were remembered to within a few meters of their actual location.

QoE-Based Performance Comparison of AVC, HEVC, and VP9 on Mobile Devices with Additional Influencing Factors

While current video quality assessment research predominantly revolves around resolutions of 4 K and beyond, targeted at ultra high-definition (UHD) displays, effective video quality for mobile video streaming remains primarily within the range of 480 p to 1080 p. In this study, we conducted a comparative analysis of the quality of experience (QoE) for widely implemented video codecs on mobile devices, specifically Advanced Video Coding (AVC), its successor High-Efficiency Video Coding (HEVC), and Google’s VP9. Our choice of 720 p video sequences from a newly developed database, all with identical bitrates, aimed to maintain a manageable subjective assessment duration, capped at 35–40 min. To mimic real-time network conditions, we generated stimuli by streaming original video clips over a controlled emulated setup, subjecting them to eight different packet-loss scenarios. We evaluated the quality and structural similarity of the distorted video clips using objective metrics, including the Video Quality Metric (VQM), Peak Signal-to-Noise Ratio (PSNR), Video Multi-Method Assessment Fusion (VMAF), and Multi-Scale Structural Similarity Index (MS-SSIM). Subsequently, we collected subjective ratings through a custom mobile application developed for Android devices. Our findings revealed that VMAF accurately represented the degradation in video quality compared to other metrics. Moreover, in most cases, HEVC exhibited an advantage over both AVC and VP9 under low packet-loss scenarios. However, it is noteworthy that in our test cases, AVC outperformed HEVC and VP9 in scenarios with high packet loss, based on both subjective and objective assessments. Our observations further indicate that user preferences for the presented content contributed to video quality ratings, emphasizing the importance of additional factors that influence the perceived video quality of end users.

A Multi-Stage Progressive Network with Feature Transmission and Fusion for Marine Snow Removal.

Improving underwater image quality is crucial for marine detection applications. However, in the marine environment, captured images are often affected by various degradation factors due to the complexity of underwater conditions. In addition to common color distortions, marine snow noise in underwater images is also a significant issue. The backscatter of artificial light on marine snow generates specks in images, thereby affecting image quality, scene perception, and subsequently impacting downstream tasks such as target detection and segmentation. Addressing the issues caused by marine snow noise, we have designed a new network structure. In this work, a novel skip-connection structure called a dual channel multi-scale feature transmitter (DCMFT) is implemented to reduce information loss during downsampling in the feature encoding and decoding section. Additionally, in the feature transfer process for each stage, iterative attentional feature fusion (iAFF) modules are inserted to fully utilize marine snow features extracted at different stages. Finally, to further optimize the network's performance, we incorporate the multi-scale structural similarity index (MS-SSIM) into the loss function to ensure more effective convergence during training. Through experiments conducted on the Marine Snow Removal Benchmark (MSRB) dataset with an augmented sample size, our method has achieved significant results. The experimental results demonstrate that our approach excels in removing marine snow noise, with a peak signal-to-noise ratio reaching 38.9251 dB, significantly outperforming existing methods.

An End-to-End Video Coding Method via Adaptive Vision Transformer

Deep learning-based video coding methods have demonstrated superior performance compared to classical video coding standards in recent years. The vast majority of the existing deep video coding (DVC) networks are based on convolutional neural networks (CNNs), and their main drawback is that since CNNs are affected by the size of the receptive field, they cannot effectively handle long-range dependencies and local detail recovery. Therefore, how to better capture and process the overall structure as well as local texture information in the video coding task is the core issue. Notably, the transformer employs a self-attention mechanism that captures dependencies between any two positions in the input sequence without being constrained by distance limitations. This is an effective solution to the problem described above. In this paper, we propose end-to-end transformer-based adaptive video coding (TAVC). First, we compress the motion vector and residuals through a compression network built on the vision transformer (ViT) and design the motion compensation network based on ViT. Second, based on the requirement of video coding to adapt to different resolution inputs, we introduce a position encoding generator (PEG) as adaptive position encoding (APE) to maintain its translation invariance across different resolution video coding tasks. The experiment shows that for multiscale structural similarity index measurement (MS-SSIM) metrics, this method exhibits significant performance gaps compared to conventional engineering codecs, such as [Formula: see text], [Formula: see text], and VTM-15.2. We also achieved a good performance improvement compared to the CNN-based DVC methods. In the case of peak signal-to-noise ratio (PSNR) evaluation metrics, TAVC also achieves good performance.

Digital twin modeling method of the temperature field of thermo-compression bonding blade based on generative adversarial networks

In this paper, a novel method of using deep learning to construct a digital twin of the thermos-compression bonding blade`s temperature field is presented. Usually, a heat transfer model based on numerical analysis can calculate the heat distribution in the welding process, but its complex modeling process and heavy computational effort are not appropriate for the deployment of the digital twin concept. The approach proposed in this paper is distinctive because it directly converts the collected process sensor data into the bonding blade's temperature field images and the bonding surface's temperature distribution curves for monitoring the welding process. This is achieved by training the generator and discriminator of the conditional depth convolutional generative adversarial network separately. The network is then capable of predicting the bonding blade's heat distribution within a certain range of welding parameters. Compared to methods based on numerical simulation, this approach is far more effective. Training and testing datasets were created to assess the suggested method's efficacy. Multi-scale structural similarity index, structural similarity index, peak signal-to-noise ratio, difference hash and mean absolute error were used to evaluate the simulations' quality. The results show that the simulation's results and the actual data agree quite well. The temperature changes that occur during the welding process may be quickly and accurately simulated using the proposed technology.

MRI motion artifact reduction using a conditional diffusion probabilistic model (MAR-CDPM).

High-resolution magnetic resonance imaging (MRI) with excellent soft-tissue contrast is a valuable tool utilized for diagnosis and prognosis. However, MRI sequences with long acquisition time are susceptible to motion artifacts, which can adversely affect the accuracy of post-processingalgorithms. This study proposes a novel retrospective motion correction method named "motion artifact reduction using conditional diffusion probabilistic model" (MAR-CDPM). The MAR-CDPM aimed to remove motion artifacts from multicenter three-dimensional contrast-enhanced T1 magnetization-prepared rapid acquisition gradient echo (3D ceT1 MPRAGE) brain dataset with different brain tumor types. This study employed two publicly accessible MRI datasets: one containing 3D ceT1 MPRAGE and 2D T2-fluid attenuated inversion recovery (FLAIR) images from 230 patients with diverse brain tumors, and the other comprising 3D T1-weighted (T1W) MRI images of 148 healthy volunteers, which included real motion artifacts. The former was used to train and evaluate the model using the in silico data, and the latter was used to evaluate the model performance to remove real motion artifacts. A motion simulation was performed in k-space domain to generate an in silico dataset with minor, moderate, and heavy distortion levels. The diffusion process of the MAR-CDPM was then implemented in k-space to convert structure data into Gaussian noise by gradually increasing motion artifact levels. A conditional network with a Unet backbone was trained to reverse the diffusion process to convert the distorted images to structured data. The MAR-CDPM was trained in two scenarios: one conditioning on the time step of the diffusion process, and the other conditioning on both and T2-FLAIR images. The MAR-CDPM was quantitatively and qualitatively compared with supervised Unet, Unet conditioned on T2-FLAIR, CycleGAN, Pix2pix, and Pix2pix conditioned on T2-FLAIR models. To quantify the spatial distortions and the level of remaining motion artifacts after applying the models, quantitative metrics were reported including normalized mean squared error (NMSE), structural similarity index (SSIM), multiscale structural similarity index (MS-SSIM), peak signal-to-noise ratio (PSNR), visual information fidelity (VIF), and multiscale gradient magnitude similarity deviation (MS-GMSD). Tukey's Honestly Significant Difference multiple comparison test was employed to quantify the difference between the models where p-value was considered statisticallysignificant. Qualitatively, MAR-CDPM outperformed these methods in preserving soft-tissue contrast and different brain regions. It also successfully preserved tumor boundaries for heavy motion artifacts, like the supervised method. Our MAR-CDPM recovered motion-free in silico images with the highest PSNR and VIF for all distortion levels where the differences were statistically significant (p-values ). In addition, our method conditioned on t and T2-FLAIR outperformed (p-values ) other methods to remove motion artifacts from the in silico dataset in terms of NMSE, MS-SSIM, SSIM, and MS-GMSD. Moreover, our method conditioned on only t outperformed generative models (p-values ) and had comparable performances compared with the supervised model (p-values ) to remove real motionartifacts. The MAR-CDPM could successfully remove motion artifacts from 3D ceT1 MPRAGE. It is particularly beneficial for elderly who may experience involuntary movements during high-resolution MRI imaging with long acquisitiontimes.

Quantitative analysis of deep learning-based denoising model efficacy on optical coherence tomography images with different noise levels

BackgroundTo quantitatively evaluate the effectiveness of the Noise2Noise (N2N) model, a deep learning (DL)-based noise reduction algorithm, on enhanced depth imaging-optical coherence tomography (EDI-OCT) images with different noise levels. MethodsThe study included 30 subfoveal EDI-OCT images averaged with 100 frames from 30 healthy participants. Artificial Gaussian noise at 25.00, 50.00, and 75.00 standard deviations were added to the averaged (original) images, and the images were grouped as 25N, 50N, and 75N. Afterward, noise-added images were denoised with the N2N model and grouped as 25dN, 50dN, and 75dN, according to previous noise levels. The choroidal vascularity index (CVI) and deep choroidal contrast-to-noise ratio (CNR) were calculated for all images, and noise-added and denoised images were compared with the original images. The structural similarity of the noise-added and denoised images to the original images was assessed by the Multi-Scale Structural Similarity Index (MS-SSI). ResultsThe CVI and CNR parameters of the original images (68.08 ± 2.47 %, and 9.71 ± 2.80) did not differ from the only 25dN images (67.97 ± 2.34 % and 8.50 ± 2.43) (p:1.000, and p:0.062, respectively). Noise reduction improved the MS-SSI at each noise level (p < 0.001). However, the highest MS-SSI was achieved in 25dN images. ConclusionsThe DL-based N2N denoising model can be used effectively for images with low noise levels, but at increasing noise levels, this model may be insufficient to provide both the original structural features of the choroid and structural similarity to the original image.

Can Deep Adult Lung Segmentation Models Generalize to the Pediatric Population?

Lung segmentation in chest X-rays (CXRs) is an important prerequisite for improving the specificity of diagnoses of cardiopulmonary diseases in a clinical decision support system. Current deep learning models for lung segmentation are trained and evaluated on CXR datasets in which the radiographic projections are captured predominantly from the adult population. However, the shape of the lungs is reported to be significantly different across the developmental stages from infancy to adulthood. This might result in age-related data domain shifts that would adversely impact lung segmentation performance when the models trained on the adult population are deployed for pediatric lung segmentation. In this work, our goal is to (i) analyze the generalizability of deep adult lung segmentation models to the pediatric population and (ii) improve performance through a stage-wise, systematic approach consisting of CXR modality-specific weight initializations, stacked ensembles, and an ensemble of stacked ensembles. To evaluate segmentation performance and generalizability, novel evaluation metrics consisting of mean lung contour distance (MLCD) and average hash score (AHS) are proposed in addition to the multi-scale structural similarity index measure (MS-SSIM), the intersection of union (IoU), Dice score, 95% Hausdorff distance (HD95), and average symmetric surface distance (ASSD). Our results showed a significant improvement (p < 0.05) in cross-domain generalization through our approach. This study could serve as a paradigm to analyze the cross-domain generalizability of deep segmentation models for other medical imaging modalities and applications.

A deep learning model for generating fundus autofluorescence images from color fundus photography

BackgroundFundus Autofluorescence (FAF) is a valuable imaging technique used to assess metabolic alterations in the retinal pigment epithelium (RPE) associated with various age-related and disease-related changes. The practical uses of FAF are ever-growing. This study aimed to evaluate the effectiveness of a generative deep learning (DL) model in translating color fundus (CF) images into synthetic FAF images and explore its potential for enhancing screening of age-related macular degeneration (AMD). MethodsA generative adversarial network (GAN) model was trained on pairs of CF and FAF images to generate synthetic FAF images. The quality of synthesized FAF images was assessed objectively by common generation metrics. Additionally, the clinical effectiveness of the generated FAF images in AMD classification was evaluated by measuring the area under the curve (AUC), using the LabelMe dataset. ResultsA total of 8410 FAF images from 2586 patients were analyzed. The synthesized FAF images exhibited an impressive objectively assessed quality, achieving a multi-scale structural similarity index (MS-SSIM) of 0.67. When evaluated on the LabelMe dataset, the combination of generated FAF images and CF images resulted in a noteworthy improvement in AMD classification accuracy, with the AUC increasing from 0.931 to 0.968. ConclusionsThis study presents the first attempt to use a generative deep learning model to create authentic and high-quality FAF images from CF images. The incorporation of the translated FAF images on top of CF images improved the accuracy of AMD classification. Overall, this study presents a promising approach to enhance large-scale AMD screening.

Background initialization in video data using singular value decomposition and robust principal component analysis

Background initialization is used in video processing applications to extract a scene without the foreground scene. In recent times, the issue of background initialization has gained researchers’ attention in different fields such as video surveillance, video segmentation, computational photography, and so on. The initialization of the background is affected due to different complex dissimilarities such as shadow, intermittent movement, illumination, camera jitter, and clutter. To overcome the aforementioned issues, this paper proposes a decomposition using the combination of the Singular Value Decomposition (SVD) and Robust Principal Component Analysis (RPCA) for Singular Spectrum Analysis (SSA) to perform an effective background initialization. The incorporation of RPCA in SVD is used to overcome the issues related to non-Gaussian noise and it also uses an effective structural knowledge of the video input i.e. sparse and low rank matrix which improves the Peak-Signal-to-Noise-Ratio (PSNR) of the background image. The SBI dataset was used to analyze the performances of SSA-SVDRPCA. The SSA-SVDRPCA is analyzed using MultiScale Structural Similarity Index (MSSSIM), Average gray-level error (AGE), Percentage of clustered error pixels (pCEPS), Percentage of error pixels (pEPs), and PSNR. The existing approaches such as Background Initialization Singular Spectrum Analysis (BISSA) and Quaternion-based Dynamic Mode Decomposition (Q-DMD) are used to compare with the SSA-SVDRPCA method. The PSNR of the SSA-SVDRPCA for Board class is 30.39 dB which is higher than the BISSA and Q-DMD.

Deep-learning-based radiointerferometric imaging with GAN-aided training

Context. The incomplete coverage of the spatial Fourier space, which leads to imaging artifacts, has been troubling radio interferometry for a long time. The currently best technique is to create an image for which the visibility data are Fourier-transformed and to clean the systematic effects originating from incomplete data in Fourier space. We have shown previously how super-resolution methods based on convolutional neural networks can reconstruct sparse visibility data. Aims. The training data in our previous work were not very realistic. The aim of this work is to build a whole simulation chain for realistic radio sources that then leads to an improved neural net for the reconstruction of missing visibilities. This method offers considerable improvements in terms of speed, automatization, and reproducibility over the standard techniques. Methods. We generated large amounts of training data by creating images of radio galaxies with a generative adversarial network that was trained on radio survey data. Then, we applied the radio interferometer measurement equation in order to simulate the measurement process of a radio interferometer. Results. We show that our neural network can faithfully reconstruct images of realistic radio galaxies. The reconstructed images agree well with the original images in terms of the source area, integrated flux density, peak flux density, and the multiscale structural similarity index. Finally, we show that the neural net can be adapted for estimating the uncertainties in the imaging process.

Single-pixel image reconstruction using coherent nonlinear optics.

We propose and experimentally demonstrate a novel, to the best of our knowledge, hybrid optoelectronic system that utilizes mode-selective frequency upconversion, single-pixel detection, and a deep neural network to achieve the reliable reconstruction of two-dimensional (2D) images from a noise-contaminated database of handwritten digits. Our system is designed to maximize the multi-scale structural similarity index measure (MS-SSIM) and minimize the mean absolute error (MAE) during the training process. Through extensive evaluation, we have observed that the reconstructed images exhibit high-quality results, with a peak signal-to-noise ratio (PSNR) reaching approximately 20 dB and a structural similarity index measure (SSIM) of around 0.85. These impressive metrics demonstrate the effectiveness and fidelity of our image reconstruction technique. The versatility of our approach allows its application in various fields, including Lidar, compressive imaging, volumetric reconstruction, and so on.

A Super-Resolution Algorithm Based on Hybrid Network for Multi-Channel Remote Sensing Images

In recent years, the development of super-resolution (SR) algorithms based on convolutional neural networks has become an important topic in enhancing the resolution of multi-channel remote sensing images. However, most of the existing SR models suffer from the insufficient utilization of spectral information, limiting their SR performance. Here, we derive a novel hybrid SR network (HSRN) which facilitates the acquisition of joint spatial–spectral information to enhance the spatial resolution of multi-channel remote sensing images. The main contributions of this paper are three-fold: (1) in order to sufficiently extract the spatial–spectral information of multi-channel remote sensing images, we designed a hybrid three-dimensional (3D) and two-dimensional (2D) convolution module which can distill the nonlinear spectral and spatial information simultaneously; (2) to enhance the discriminative learning ability, we designed the attention structure, including channel attention, before the upsampling block and spatial attention after the upsampling block, to weigh and rescale the spectral and spatial features; and (3) to acquire fine quality and clear texture for reconstructed SR images, we introduced a multi-scale structural similarity index into our loss function to constrain the HSRN model. The qualitative and quantitative comparisons were carried out in comparison with other SR methods on public remote sensing datasets. It is demonstrated that our HSRN outperforms state-of-the-art methods on multi-channel remote sensing images.

Deep learning-based combination of [18F]-FDG PET and CT images for producing pulmonary perfusion image.

The main application of [18F] FDG-PET (18 FDG-PET) and CT images in oncology is tumor identification and quantification. Combining PET and CT images to mine pulmonary perfusion information for functional lung avoidance radiation therapy (FLART) is desirable but remains challenging. To develop a deep-learning-based (DL) method to combine 18 FDG-PET and CT images for producing pulmonary perfusion images (PPI). Pulmonary technetium-99m-labeled macroaggregated albumin SPECT (PPISPECT ), 18 FDG-PET, and CT images obtained from 53 patients were enrolled. CT and PPISPECT images were rigidly registered, and registration displacement was subsequently used to align 18 FDG-PET and PPISPECT images. The left/right lung was separated and rigidly registered again to improve the registration accuracy. A DL model based on 3D Unet architecture was constructed to directly combine multi-modality 18 FDG-PET and CT images for producing PPI (PPIDLM ). 3D Unet architecture was used as the basic architecture, and the input was expanded from a single-channel to a dual-channel to combine multi-modality images. For comparative evaluation, 18 FDG-PET images were also used alone to generate PPIDLPET . Sixty-seven samples were randomly selected for training and cross-validation, and 36 were used for testing. The Spearman correlation coefficient (rs ) and multi-scale structural similarity index measure (MS-SSIM) between PPIDLM /PPIDLPET and PPISPECT were computed to assess the statistical and perceptual image similarities. The Dice similarity coefficient (DSC) was calculated to determine the similarity between high-/low- functional lung (HFL/LFL) volumes. The voxel-wise rs and MS-SSIM of PPIDLM /PPIDLPET were 0.78 ± 0.04/0.57 ± 0.03, 0.93 ± 0.01/0.89 ± 0.01 for cross-validation and 0.78 ± 0.11/0.55 ± 0.18, 0.93 ± 0.03/0.90 ± 0.04 for testing. PPIDLM /PPIDLPET achieved averaged DSC values of 0.78 ± 0.03/0.64 ± 0.02 for HFL and 0.83 ± 0.01/0.72 ± 0.03 for LFL in the training dataset and 0.77 ± 0.11/0.64 ± 0.12, 0.82 ± 0.05/0.72 ± 0.06 in the testing dataset. PPIDLM yielded a stronger correlation and higher MS-SSIM with PPISPECT than PPIDLPET (p < 0.001). The DL-based method integrates lung metabolic and anatomy information for producing PPI and significantly improved the accuracy over methods based on metabolic information alone. The generated PPIDLM can be applied for pulmonary perfusion volume segmentation, which is potentially beneficial for FLART treatment plan optimization.

SLAAHE: Selective Apex Adaptive Histogram Equalization

Medical imaging enables specialists to make diagnoses our internal body organs for detecting anomalies without being intrusive. Unfortunately, the images produced by various modalities are not only plagued by noises, but the images contrasts are also subpar, making it impossible to use them for a delicate task like diagnosis, which is directly concerned with our health. Pre-processing the image becomes obligatory to ameliorate its medical worth and contrast enhancement is a sacrosanct part of diagnostic image pre-processing. Even though some popular contrast enhancement algorithms, such as Adaptive Histogram Equalization (AHE), Contrast Limited Adaptive Histogram Equalization (CLAHE), and Minimum Mean Brightness Error Bi-Histogram Equalization (MMBEBHE), etc., are widely used, they are insufficient for some medical imaging modalities, such as ultrasound imaging (USG). This paper, named as Selective Apex Adaptive Histogram Equalization (SLAAHE), proposes an effective and efficient contrast enhancement algorithm that dynamically selects the best window size for dividing the low contrast image into image grids and clip limit for clipping the histogram of the low contrast sub-image only. Unique feature of the proposed algorithm is that it clips the image histogram only when it is not well-distributed and ennobles the output image contrast. This makes the algorithm best concerning the contrast enhancement quality, and reduced time and space complexity. Both theoretical analysis and assessment of experimental results with statistical metrics like Universal Image Quality Index (UIQI), Absolute Mean Brightness Error (AMBE), Multi-Scale Structural Similarity Index Measure (MSSSIM), Entropy, and Root Mean Square Error (RMSE) exhibit how the proposed method has gained momentous improvement over existing state-of-the-art methods. For the evaluation metrics UIQI, AMBE, MSSSIM, Entropy, and RMSE, the suggested technique received average scores of 0.79, 0.12, 0.88, 0.92, and 11.52 respectively.

Super-resolution of sodium images from simultaneous 1 H MRF/23 Na MRI acquisition.

In this work, we introduce a super-resolution method that generates a high-resolution (HR) sodium (23 Na) image from simultaneously acquired low-resolution (LR) 23 Na density-weighted MRI and HR proton density, T1 , and T2 maps from proton (1 H) MR fingerprinting in the brain at 7 T. The core of our method is a partial least squares regression between the HR (1 H) images and the LR (23 Na) image. An iterative loop and deconvolution with the point spread function of each acquired image were included in the algorithm to generate a final HR 23 Na image without losing features from the LR 23 Na image. The method was applied to simultaneously acquired HR proton and LR sodium data with in-plane resolution ratios between sodium and proton data of 3.8 and 1.9 and the same slice thickness. Four volunteers were scanned to evaluate the method's performance. For the data with a resolution ratio of 3.8, the mean absolute difference between the generated and ground truth HR 23 Na images was in the range of 1.5%-7.2% of the ground truth with a multiscale structural similarity index (M-SSIM) of 0.93 ± 0.03. For the data with a resolution ratio of 1.9, the mean absolute difference was in the range of 4.8%-6.3% with an M-SSIM of 0.95 ± 0.01.