Higher Structural Similarity Index Research Articles

ACSwinNet: A Deep Learning-Based Rigid Registration Method for Head-Neck CT-CBCT Images in Image-Guided Radiotherapy.

Accurate and precise rigid registration between head-neck computed tomography (CT) and cone-beam computed tomography (CBCT) images is crucial for correcting setup errors in image-guided radiotherapy (IGRT) for head and neck tumors. However, conventional registration methods that treat the head and neck as a single entity may not achieve the necessary accuracy for the head region, which is particularly sensitive to radiation in radiotherapy. We propose ACSwinNet, a deep learning-based method for head-neck CT-CBCT rigid registration, which aims to enhance the registration precision in the head region. Our approach integrates an anatomical constraint encoder with anatomical segmentations of tissues and organs to enhance the accuracy of rigid registration in the head region. We also employ a Swin Transformer-based network for registration in cases with large initial misalignment and a perceptual similarity metric network to address intensity discrepancies and artifacts between the CT and CBCT images. We validate the proposed method using a head-neck CT-CBCT dataset acquired from clinical patients. Compared with the conventional rigid method, our method exhibits lower target registration error (TRE) for landmarks in the head region (reduced from 2.14 ± 0.45 mm to 1.82 ± 0.39 mm), higher dice similarity coefficient (DSC) (increased from 0.743 ± 0.051 to 0.755 ± 0.053), and higher structural similarity index (increased from 0.854 ± 0.044 to 0.870 ± 0.043). Our proposed method effectively addresses the challenge of low registration accuracy in the head region, which has been a limitation of conventional methods. This demonstrates significant potential in improving the accuracy of IGRT for head and neck tumors.

SC-AOF: A Sliding Camera and Asymmetric Optical-Flow-Based Blending Method for Image Stitching.

Parallax processing and structure preservation have long been important and challenging tasks in image stitching. In this paper, an image stitching method based on sliding camera to eliminate perspective deformation and asymmetric optical flow to solve parallax is proposed. By maintaining the viewpoint of two input images in the mosaic non-overlapping area and creating a virtual camera by interpolation in the overlapping area, the viewpoint is gradually transformed from one to another so as to complete the smooth transition of the two image viewpoints and reduce perspective deformation. Two coarsely aligned warped images are generated with the help of a global projection plane. After that, the optical flow propagation and gradient descent method are used to quickly calculate the bidirectional asymmetric optical flow between the two warped images, and the optical-flow-based method is used to further align the two warped images to reduce parallax. In the image blending, the softmax function and registration error are used to adjust the width of the blending area, further eliminating ghosting and reducing parallax. Finally, by comparing our method with APAP, AANAP, SPHP, SPW, TFT, and REW, it has been proven that our method can not only effectively solve perspective deformation, but also gives more natural transitions between images. At the same time, our method can robustly reduce local misalignment in various scenarios, with higher structural similarity index. A scoring method combining subjective and objective evaluations of perspective deformation, local alignment and runtime is defined and used to rate all methods, where our method ranks first.

Integrating Image Perception and Time‐to‐First‐Spike Coding in MoS2 Phototransistors for Spiking Neural Network

AbstractHuman vision system remains alert for dangers and adopts high‐speed and low‐power coding methods to convert the image information to spike signals. To meet the demand for danger alert in machine vision, it is important to design intelligent sensors to integrate the functions of image perception and high‐efficiency coding for high‐priority analysis. Inspired by the human visual system, a MoS2 phototransistor is introduced on SiNx substrate enabling simultaneous image perception and time‐to‐first‐spike (TTFS) coding. The device demonstrates exceptional performance in encoding 3‐bit grayscale images, achieving a low mean squared error of 0.008 and a high structural similarity index of 0.9784. Spiking neural networks (SNN) with TTFS coding achieve high recognition accuracy (98.86%) while reducing spike count by 75%. The device array also perceives motion direction and object states by converting data temporally. This work establishes a hardware foundation to promote the performance of SNNs in efficiently identifying crucial information.

Electronic Information System Signal Noise for Noise Reduction using Variational Bayesian based Robust Adaptive Filter

The most significant issues for a thousand users is the unwanted or loud signals in sound files, it is impossible to eliminate or minimize these noise signals without knowledge their types and ranges. To overcome this issue, present an Electronic Information System Signal Noise for Noise Reduction using Variational Bayesian based Robust Adaptive Filter (EIS-SNR-VBRAF) is proposed. Initially, the data is collected from Adaptive Myriad Filter using Time-Varying Noise and Signal-Dependent Parameters dataset. Then, the data is given for Pre-processing section, Variational Bayesian based Robust Adaptive Filter (VBRAF) is used to reduce the signal noise from Gaussian Noise, Traffic noise and Audio signal back ground noise. The proposed technique is implemented and efficacy of EIS-SNR-VBRAF technique is assessed by support of numerous performances such as BER, Signal-to-Noise-Ratio (SNR), Mean Squared Error, Peak Signal-to-Noise Ratio (PSNR), Root Mean Square Error, Structural Similarity Index, Cross-Correlation and Computational Complexity is analyzed. The proposed EIS-SNR-VBRAF method attains 21.18%, 23.52% and 23.65% lower RMSE, 21.52%, 21.76% and 23.24% higher PSNR, 21.19%, 21.73% and 20.48% higher Structural Similarity Index are compared with existing methods like early detection of mechanical malfunctions in vehicles utilizing sound signal processing (ED-MMV-SSP),noise reduction in infrasound signals based on mask coefficient binary weighting generalized cross correlation non-negative matrix factorization algorithm (NRID-MCWG-NMFA) and Click-event sound detection in automotive industry using machine/deep learning (CE-SDSI-DL) respectively.

Free-breathing abdominal chemical exchange saturation transfer imaging using water presaturation and respiratory gating at 3.0 T.

Free-breathing abdominal chemical exchange saturation transfer (CEST) has great potential for clinical application, but its technical implementation remains challenging. This study aimed to propose and evaluate a free-breathing abdominal CEST sequence. The proposed sequence employed respiratory gating (ResGat) to synchronize the data acquisition with respiratory motion and performed a water presaturation module before the CEST saturation to abolish the influence of respiration-induced repetition time variation. In vivo experiments were performed to compare different respiratory motion-control strategies and B0 offset correction methods, and to evaluate the effectiveness and necessity of the quasi-steady-state (QUASS) approach for correcting the influence of the water presaturation module on CEST signal. ResGat with a target expiratory phase of 0.5 resulted in a higher structural similarity index and a lower coefficient of variation on consecutively acquired CEST S0 images than breath-holding (BH) and respiratory triggering (all p < 0.05). B0 maps derived from the abdominal CEST dataset itself were more stable for B0 correction, compared with the separately acquired B0 maps by a dual-echo time scan and B0 maps derived from the water saturation shift referencing approach. Compared with BH, ResGat yielded more homogeneous magnetization transfer ratio asymmetry maps at 3.5 ppm (standard deviation: 3.96% vs. 3.19%, p = 0.036) and a lower mean squared difference between scan and rescan (27.52‱ vs. 16.82‱, p = 0.004). The QUASS approach could correct the water presaturation-induced CEST signal change, but its necessity for in vivo scanning needs further verification. The proposed free-breathing abdominal CEST sequence using ResGat had an acquisition efficiency of approximately four times that using BH. In conclusion, the proposed free-breathing abdominal CEST sequence using ResGat and water presaturation has a higher acquisition efficiency and image quality than abdominal CEST using BH.

Deep learning model based on multi-scale feature fusion for precipitation nowcasting

Abstract. Forecasting heavy precipitation accurately is a challenging task for most deep learning (DL)-based models. To address this, we present a novel DL architecture called “multi-scale feature fusion” (MFF) that can forecast precipitation with a lead time of up to 3 h. The MFF model uses convolution kernels with varying sizes to create multi-scale receptive fields. This helps to capture the movement features of precipitation systems, such as their shape, movement direction, and speed. Additionally, the architecture utilizes the mechanism of discrete probability to reduce uncertainties and forecast errors, enabling it to predict heavy precipitation even at longer lead times. For model training, we use 4 years of radar echo data from 2018 to 2021 and 1 year of data from 2022 for model testing. We compare the MFF model with three existing extrapolative models: time series residual convolution (TSRC), optical flow (OF), and UNet. The results show that MFF achieves superior forecast skills with high probability of detection (POD), low false alarm rate (FAR), small mean absolute error (MAE), and high structural similarity index (SSIM). Notably, MFF can predict high-intensity precipitation fields at 3 h lead time, while the other three models cannot. Furthermore, MFF shows improvement in the smoothing effect of the forecast field, as observed from the results of radially averaged power spectral (RAPS). Our future work will focus on incorporating multi-source meteorological variables, making structural adjustments to the network, and combining them with numerical models to further improve the forecast skills of heavy precipitations at longer lead times.

Two‐stage diffusion model deriving FDG‐PET from T1 Weighted Magnetic Resonance Images for diagnosis of Alzheimer’s disease

AbstractBackgroundAlzheimer’s Disease (AD) is a neurodegenerative disease which is characterized by cognitive and functional impairment, and defined by triad of Amyloid status, Tau pathology, and Neuroimaging marker of neurodegeneration or neuronal injury. An early diagnosis of AD can be challenging and it can be detected earlier in brain functional imaging than brain structural imaging.MethodWe develop a pipeline for synthesizing FDG‐PET/MRI from source MRI‐T1‐Weighted (MRI‐T1W) images based on denoising diffusion mechanism [1]. The pipeline includes a forward pass which encodes the source MRI‐T1WI images to gaussian noise space, and a backward pass which generates the corresponding FDG‐PET from the derived noises with repeated denoising steps. Furthermore, to validate the effectiveness of the synthesized FDG‐PET images, we also develop multiple types of classifiers and the experiments for both single input of MRI‐T1WI and joint input of MRI‐T1WI and synthesized FDG‐PET.ResultThe experiments are performed on 1036 of FDG‐PET/MRI pairs (286,474, 276 for Cognitive Normal, Mild Cognitive Impaiement and Alzheimer’s Disease each) are obtained from ADNI [2] datasets and display the promising results with low Mean Absolute Error (MAE) and high Structural Similarity Index Measure (SSIM) for the two stage diffusion denoising based FDG‐PET synthesis pipeline. The results for the additional classification experiments also show that in most cases the joint input enhances the classifiers' performance in accuracy and F1‐score. The results also indicate that the synthesized FDG‐PET images are not only visually similar to the ground truth images, but also improve the performance of machine learning based AD diagnosis.ConclusionThis work provides support for the notion that machine learning‐derived image analysis may be a useful approach to improving the diagnosis of AD.Reference:[1] Ho, J., Jain, A., &amp; Abbeel, P. (2020). Denoising diffusion probabilistic models. Advances in Neural Information Processing Systems, 33, 6840‐6851.[2] Petersen, R., Aisen, P. S., Beckett, L. A., Donohue, M. C., Gamst, A. C., Harvey, D. J., … &amp; Toga, A. W. (2010). Alzheimer’s disease neuroimaging initiative (ADNI). Neurology, 74(3), 201‐209.

An efficient deep multi‐task learning structure for covid‐19 disease

AbstractCOVID‐19 has had a profound global impact, necessitating the development of infection detection systems based on machine learning. This paper presents a Multi‐task architecture that addresses the classification and segmentation tasks for COVID‐19 detection. The model comprises an encoder for feature representation, a decoder for segmentation, and a multi‐layer perceptron for classification. Evaluations conducted on two datasets demonstrate the model's performance in both classification and segmentation. To enhance efficiency and diagnosis accuracy, CT‐scan images undergo pre‐processing using image processing algorithms like histogram equalization, median filtering, and mathematical morphology operations. The combination of the median filter pre‐processing and the proposed model yields impressive results in the classification task, achieving high accuracy, sensitivity, and specificity, with values of 0.97, 0.97, and 0.96, respectively, for dataset 1, and 0.96 in mentioned metrics for dataset 2. For segmentation, the proposed model, particularly with the average morphology pre‐processing, exhibits excellent performance with high accuracy, low mean squared error, high peak signal‐to‐noise ratio, high structural similarity index, and a mean dice coefficient of 88.86 ± 0.05 for dataset 1, and 87.97 ± 0.02 for dataset 2. Furthermore, the pre‐trained models consistently demonstrate the superiority of the median filter and proposed model in the classification task on the same datasets. In conclusion, the proposed multi‐task model, incorporating image processing techniques, achieves remarkable results in both classification and segmentation. The utilization of pre‐processing algorithms and the multi‐task framework significantly contribute to superior performance metrics. This study encourages further exploration of combining diverse image processing algorithms to advance infection diagnosis and treatment.

Single-shot quantitative phase contrast imaging based on deep learning.

Quantitative differential phase-contrast (DPC) imaging is one of the commonly used methods for phase retrieval. However, quantitative DPC imaging requires several pairwise intensity measurements, which makes it difficult to monitor living cells in real-time. In this study, we present a single-shot quantitative DPC imaging method based on the combination of deep learning (DL) and color-encoded illumination. Our goal is to train a model that can generate an isotropic quantitative phase image (i.e., target) directly from a single-shot intensity measurement (i.e., input). The target phase image was reconstructed using a linear-gradient pupil with two-axis measurements, and the model input was the measured color intensities obtained from a radially asymmetric color-encoded illumination pattern. The DL-based model was trained, validated, and tested using thirteen different cell lines. The total number of training, validation, and testing images was 264 (10 cells), 10 (1 cell), and 40 (2 cells), respectively. Our results show that the DL-based phase images are visually similar to the ground-truth phase images and have a high structural similarity index (>0.98). Moreover, the phase difference between the ground-truth and DL-based phase images was smaller than 13%. Our study shows the feasibility of using DL to generate quantitative phase imaging from a single-shot intensity measurement.

TouchRoller: A Rolling Optical Tactile Sensor for Rapid Assessment of Textures for Large Surface Areas.

Tactile sensing is important for robots to perceive the world as it captures the physical surface properties of the object with which it is in contact and is robust to illumination and colour variances. However, due to the limited sensing area and the resistance of their fixed surface when they are applied with relative motions to the object, current tactile sensors have to tap the tactile sensor on the target object a great number of times when assessing a large surface, i.e., pressing, lifting up, and shifting to another region. This process is ineffective and time-consuming. It is also undesirable to drag such sensors as this often damages the sensitive membrane of the sensor or the object. To address these problems, we propose a roller-based optical tactile sensor named TouchRoller, which can roll around its centre axis. It maintains being in contact with the assessed surface throughout the entire motion, allowing for efficient and continuous measurement. Extensive experiments showed that the TouchRoller sensor can cover a textured surface of 8 cm × 11 cm in a short time of 10 s, much more effectively than a flat optical tactile sensor (in 196 s). The reconstructed map of the texture from the collected tactile images has a high Structural Similarity Index (SSIM) of 0.31 on average when compared with the visual texture. In addition, the contacts on the sensor can be localised with a low localisation error, 2.63 mm in the centre regions and 7.66 mm on average. The proposed sensor will enable the fast assessment of large surfaces with high-resolution tactile sensing and the effective collection of tactile images.

FFTI: Image inpainting algorithm via features fusion and two-steps inpainting

In view of the faultiness that the existing image inpainting methods fail to make full use of the complete region to predict the missing region features when the object features are seriously missing, resulting in discontinuous features and fuzzy detail texture of the inpainting results, a fine inpainting method of incomplete image based on features fusion and two-steps inpainting (FFTI) is proposed in this paper. Firstly, the dynamic memory networks (DMN+) are used to fuse the external features and internal features of the incomplete image to generate the incomplete image optimization map. Secondly, a generation countermeasure generative network with gradient penalty constraints is constructed to guide the generator to rough repair the optimized incomplete image and obtain the rough repair map of the target to be repaired. Finally, the coarse repair graph is further optimized by the idea of coherence of relevant features to obtain the final fine repair graph. It is verified by simulation on three image data sets with different complexity, and compared with the existing dominant repair model for visual effect and objective data. The experimental results show that the results of the model repair in this paper are more reasonable in texture structure, better than other models in visual effect and objective data, and the Peak Signal-to-Noise Ratio of the proposed algorithm in the most challenging underwater targe dataset is 27.01, the highest Structural Similarity Index is 0.949.

Wind Turbine Crack Inspection Using a Quadrotor With Image Motion Blur Avoided

The camera-equipped quadrotor is a preferable choice for wind turbine blade (WTB) crack inspection applications with the benefits of high portability and low cost. Unfortunately, the high speed of the quadrotor might cause image motion blur which leads to a crack detection failure. Recent works cope with this by adopting the advanced camera systems or image deblurring techniques, which, however, usually require additional hardware or extra computational load. In this paper, the crack detection failure problem caused by image motion blur is handled by means of quadrotor motion control. First, the desired speed range that can avoid the detection failure caused by the image motion blur is experimentally obtained. Then, a speed regulation controller is developed to regulate the quadrotor flying speed within the obtained range. Experimental studies for crack inspection of a WTB using a camera-equipped quadrotor under wind condition are carried out to validate the effectiveness of the proposed strategy. Compared to the traditional approach without image motion blur avoidance, with the same inspection assignment and wind condition, the proposed method can obtain better quality images with 4.08 higher peak signal-to-noise ratio (PSNR) and 0.1 higher structural similarity index (SSIM) on average, where PSNR and SSIM are two typical image quality assessment metrics. As a result, the crack detection failure problem is avoided and a successful WTB crack inspection is achieved.

Evolutionary Computing Model for Finding Breast Cancer Masses using Image Enhancement Procedures with Artificial Intelligent Algorithms

In this research, Particle Swarm Optimization (PSO) based image equalization is projected to enhance the contrast of different breast cancer images. Breast cancer is the highest and another important root of tumor disease in females worldwide. Mass and microcalcification clusters are a significant early signs of breast cancer. The mortality rate can effectively be decreased by early diagnosis and treatment. Most practical approach for the early detection and identification of breast cancer diseases is mammography. Mammographic images contaminated by noise usually involve image enhancement techniques to aid interpretation. Contrast enhancement is divided into two categories: development of direct contrast and enhancement of indirect contrast. Indirect contrast improvement is used in the image histogram update. Histogram Equalization (HE) is the modest enhancement of the indirect contrast approach usually used for contrast enhancement. The proposed method's average entropy is 5.3251 with the highest structural similarity index 0.99725. The best contrast improvement of this method is 1.0404 and PSNR is 46.3803. The MSE value is 2157.08. This paper recommends an innovative method of enhancing digital mammogram image contrast based on different histogram equalization approaches. The performance of the projected method has been related to other prevailing techniques using the parameters, namely, discrete entropy, contrast improvement index, structural similarity index measure, mean square error, and peak signal-to-noise ratio. Investigational findings indicate that the projected strategy is efficient and robust and shows better results than others.

TSRC: A Deep Learning Model for Precipitation Short-Term Forecasting over China Using Radar Echo Data

Currently, most deep learning (DL)-based models for precipitation forecasting face two conspicuous issues: the smoothing effect in the precipitation field and the degenerate effect of forecasting precipitation intensity. Therefore, this study proposes “time series residual convolution (TSRC)”, a DL-based convolutional neural network for precipitation nowcasting over China with a lead time of 3 h. The core idea of TSRC is it compensates the current local cues with previous local cues during convolution processes, so more contextual information and less uncertain features would remain in deep networks. We use four years’ radar echo reflectivity data from 2017 to 2020 for model training and one year’s data from 2021 for model testing and compare it with two commonly used nowcasting models: optical flow model (OF) and UNet. Results show that TSRC obtains better forecasting performances than OF and UNet with a relatively high probability of detection (POD), low false alarm rate (FAR), small mean absolute error (MAE) and high structural similarity index (SSIM), especially at longer lead times. Meanwhile, the results of two case studies suggest that TSRC still introduces smoothing effects and slightly outperforms UNet at longer lead times. The most considerable result is that our model can forecast high-intensity radar echoes even for typhoon rainfall systems, suggesting that the degenerate effect of forecasting precipitation intensity can be improved by our model. Future works will focus on the combination of multi-source data and the design of the model’s architecture to gain further improvements in precipitation short-term forecasting.

4DGolden-Angle Radial MRI at Subsecond Temporal Resolution.

Intraframe motion blurring, as a major challenge in free-breathing dynamic MRI, can be reduced if high temporal resolution can be achieved. To address this challenge, this work proposes a highly accelerated 4D (3D + time) dynamic MRI framework with subsecond temporal resolution that does not require explicit motion compensation. The method combines standard stack-of-stars golden-angle radial sampling and tailored GRASP-Pro (Golden-angle RAdial Sparse Parallel imaging with imProved performance) reconstruction. Specifically, 4D dynamic MRI acquisition is performed continuously without motion gating or sorting. The k-space centers in stack-of-stars radial data are organized to guide estimation of a temporal basis, with which GRASP-Pro reconstruction is employed to enforce joint low-rank subspace and sparsity constraints. This new basis estimation strategy is the new feature proposed for subspace-based reconstruction in this work to achieve high temporal resolution (e.g., subsecond/3D volume). It does not require sequence modification to acquire additional navigation data, it is compatible with commercially available stack-of-stars sequences, and it does not need an intermediate reconstruction step. The proposed 4D dynamic MRI approach was tested in abdominal motion phantom, free-breathing abdominal MRI, and dynamic contrast-enhanced MRI (DCE-MRI). Our results have shown that GRASP-Pro reconstruction with the new basis estimation strategy enables highly-accelerated 4D dynamic imaging at subsecond temporal resolution (with five spokes or less for each dynamic frame per image slice) for both free-breathing non-DCE-MRI and DCE-MRI. In the abdominal phantom, better image quality with lower root mean square error and higher structural similarity index was achieved using GRASP-Pro compared with standard GRASP. With the ability to acquire each 3D image in less than 1 s, intraframe respiratory blurring can be intrinsically reduced for body applications with our approach, which eliminates the need for explicit motion detection and motion compensation.

Development of a refined illumination and reflectance approach for optimal construction site interior image enhancement

PurposeImages taken from construction site interiors often suffer from low illumination and poor natural colors, which restrict their application for high-level site management purposes. The state-of-the-art low-light image enhancement method provides promising image enhancement results. However, they generally require a longer execution time to complete the enhancement. This study aims to develop a refined image enhancement approach to improve execution efficiency and performance accuracy.Design/methodology/approachTo develop the refined illumination enhancement algorithm named enhanced illumination quality (EIQ), a quadratic expression was first added to the initial illumination map. Subsequently, an adjusted weight matrix was added to improve the smoothness of the illumination map. A coordinated descent optimization algorithm was then applied to minimize the processing time. Gamma correction was also applied to further enhance the illumination map. Finally, a frame comparing and averaging method was used to identify interior site progress.FindingsThe proposed refined approach took around 4.36–4.52 s to achieve the expected results while outperforming the current low-light image enhancement method. EIQ demonstrated a lower lightness-order error and provided higher object resolution in enhanced images. EIQ also has a higher structural similarity index and peak-signal-to-noise ratio, which indicated better image reconstruction performance.Originality/valueThe proposed approach provides an alternative to shorten the execution time, improve equalization of the illumination map and provide a better image reconstruction. The approach could be applied to low-light video enhancement tasks and other dark or poor jobsite images for object detection processes.

U-Net based Mapping from Digital Images to Laser Doppler Imaging for Burn Assessment.

The incidence of burn injuries is higher in low-and middle-income countries, and particularly in remote areas where the access to specialized burn assessment, care and recovery is limited. Given the high costs associated with one of the most used techniques to evaluate the severity of a burn, namely laser Doppler imaging (LDI), an alternative approach could be beneficial for remote locations. This study proposes a novel approach to estimate the LDI from digital images of a burn. The approach is a pixel-wise regression model based on convolutional neural networks. To minimize the dependency on the conditions in which the images are taken, the effect of two image normalization techniques is also studied. Results indicate that the model performs satisfactorily on average, presenting low mean absolute and squared errors and high structural similarity index. While no significant differences are found when changing the normalization of the images, the performance is affected by their quality. This suggests that changes in the intensity of the images do not alter the relevant information about the wound, whereas changes in brightness, contrast and sharpness do.

Fabric Defect Segmentation System Based on a Lightweight GAN for Industrial Internet of Things

Machine vision systems based on deep learning play an important role in the industrial Internet of things (IIoT) and Industry 4.0 applications, especially for product quality monitoring. Fabric defect detection is an important task in the industrial production of textiles and is crucial for product quality assurance. In actual production, the detection of many small and weak target defects remains challenging. Furthermore, industrial production requires high production rates and small model sizes in practice. This study proposes a lightweight segmentation system that meets real-time industrial production requirements. Herein, first, the defect sample image was repaired based on the image repair mechanism of the generative adversarial network model. Then, the difference between the defect sample and the repaired sample was obtained and subsequent processing, such as denoising and enhancement, was done. Finally, the defect areas were segmented. Our model was specifically designed for the segmentation of weak and small defects. This was achieved through adversarial training, optimization of an objective function, and image processing. Experimental comparisons show that the intersection over union of the three different datasets is 77.84%, 77.85%, and 73.6% and that our model is superior to the conventional semantic segmentation model. Furthermore, our model has good image restoration quality with a low mean absolute error and high structural similarity index. Additionally, our model is lightweight, has good real-time performance, and is suitable for applications in the IIoT and industrial production lines, such as embedded systems.

Registration of IRT and visible light images in neurosurgery: analysis and comparison of automatic intensity-based registration approaches.

The purpose of this study is to analyze and compare six automatic intensity-based registration methods for intraoperative infrared thermography (IRT) and visible light imaging (VIS/RGB). The practical requirement is to get a good performance of Euclidean distance between manually set landmarks in reference and target images as well as to achieve a high structural similarity index metric (SSIM) and peak signal-to-noise ratio (PSNR) with respect to the reference image. In this study, preprocessing is applied to bring both image types to a similar intensity. Similarity transformation is employed to align roughly IRT and visible light images. Two optimizers and two measures are used in this process. Thereafter, due to locally different displacement of the brain surface through respiration and heartbeat, two non-rigid transformations are applied, and finally, a bicubic interpolation is carried out to compensate for the resulting estimated transformation. Performance was assessed using eleven image datasets. The registration accuracy of the different computational approaches was assessed based on SSIM and PSNR. Additionally, five concise landmarks for each dataset were selected manually in reference and target images and the Euclidean distance between the corresponding landmarks was compared. The results are showing that the combination of normalized intensity, mutual information measure with one-plus-one evolutionary optimizer in combination with Demon registration results in improved accuracy and performance as compared to all other methods tested here. Furthermore, the obtained results led to [Formula: see text], [Formula: see text], [Formula: see text], [Formula: see text], and [Formula: see text] registrations for datasets 1, 2, 5, 7, and 8 with respect to the second best result by calculating the mean Euclidean distance of five landmarks. We conclude that the mutual information measure with one-plus-one evolutionary optimizer in combination with Demon registration can achieve better accuracy and performance to those other methods mentioned here for automatic registration of IRT and visible light images in neurosurgery.

Investigation of the performance of different wavelet-based fusions of SAR and optical images using Sentinel-1 and Sentinel-2 datasets

In this study, the fusion of optical and synthetic aperture radar images with wavelet transform was investigated. Images are obtained from Sentinel-1 and sentinel-2 satellites. Images were decomposed by wavelet transform. The four main coefficients were obtained for different wavelet packages and up to ten decomposition levels. The coefficients were combined taking the maximum, minimum or mean. 1710 Fused images were obtained for all possible combinations in terms of different wavelet packets, decomposition levels and fusion rules. Fused images were evaluated according to the structural similarity index (SSI). It was seen that the missing regions in the optical images were improved in the fused images with the appropriate wavelet packets and highest SSI.