Training Deep Learning Models Research Articles

Semi-supervised image manipulation localization with residual enhancement

Images have become a significant medium for information transmission, while image forensics has garnered widespread attention from researchers. Due to the scarcity of finely annotated images in the field of image manipulation detection and localization, existing methods for locating manipulated images can only utilize a limited amount of data for model training. However, deep learning models typically require a large number of finely annotated images to fully leverage their powerful fitting capabilities. In this paper, we propose a semi-supervised image manipulation localization framework, employing semi-supervised learning to use unannotated images for deep learning model training. To achieve this goal, we first design a residual enhancement module that contains an encoding-decoding structure. The regression target of this branch is the pristine regions in the images to generate the reconstructed images. Next, we perform a residual operation between the reconstructed and original images to roughly locate the anomalous regions and refine the features extracted by the encoder. Secondly, we employ weakly-supervised learning by adding an image-level classification head to the final layer of the encoder. The classification head generates a class active map based on image-level classification results, which further guides the model’s feature augmentation. Finally, we formulate a specialized semi-supervised framework tailored for image manipulation detection, enabling the utilization of a large volume of unannotated data for model training. Extensive experimental results highlight the notable efficacy of the proposed approach, and outperforms state-of-the-art approaches.

ShuffleFL: Addressing Heterogeneity in Multi-Device Federated Learning

Federated Learning (FL) has emerged as a privacy-preserving paradigm for collaborative deep learning model training across distributed data silos. Despite its importance, FL faces challenges such as high latency and less effective global models. In this paper, we propose ShuffleFL, an innovative framework stemming from the hierarchical FL, which introduces a user layer between the FL devices and the FL server. ShuffleFL naturally groups devices based on their affiliations, e.g., belonging to the same user, to ease the strict privacy restriction-"data at the FL devices cannot be shared with others", thereby enabling the exchange of local samples among them. The user layer assumes a multi-faceted role, not just aggregating local updates but also coordinating data shuffling within affiliated devices. We formulate this data shuffling as an optimization problem, detailing our objectives to align local data closely with device computing capabilities and to ensure a more balanced data distribution at the intra-user devices. Through extensive experiments using realistic device profiles and five non-IID datasets, we demonstrate that ShuffleFL can improve inference accuracy by 2.81% to 7.85% and speed up the convergence by 4.11x to 36.56x when reaching the target accuracy.

A novel multi-scale violence and public gathering dataset for crowd behavior classification

Dependable utilization of computer vision applications, such as smart surveillance, requires training deep learning networks on datasets that sufficiently represent the classes of interest. However, the bottleneck in many computer vision applications lies in the limited availability of adequate datasets. One particular application that is of great importance for the safety of cities and crowded areas is smart surveillance. Conventional surveillance methods are reactive and often ineffective in enable real-time action. However, smart surveillance is a key component of smart and proactive security in a smart city. Motivated by a smart city application which aims at the automatic identification of concerning events for alerting law-enforcement and governmental agencies, we craft a large video dataset that focuses on the distinction between small-scale violence, large-scale violence, peaceful gatherings, and natural events. This dataset classifies public events along two axes, the size of the crowd observed and the level of perceived violence in the crowd. We name this newly-built dataset the Multi-Scale Violence and Public Gathering (MSV-PG) dataset. The videos in the dataset go through several pre-processing steps to prepare them to be fed into a deep learning architecture. We conduct several experiments on the MSV-PG datasets using a ResNet3D, a Swin Transformer and an R(2 + 1)D architecture. The results achieved by these models when trained on the MSV-PG dataset, 88.37%, 89.76%, and 89.3%, respectively, indicate that the dataset is well-labeled and is rich enough to train deep learning models for automatic smart surveillance for diverse scenarios.

A rolling bearing fault diagnosis method based on interactive generative feature space oversampling-based autoencoder under imbalanced data

With the rapid development of railroads and the yearly increase in the scale of operation, the safe operation and maintenance of rail trains have become particularly important. Among them, deep learning-based bearing fault diagnosis methods have attracted more and more attention in rail train operation and maintenance. However, rail trains usually operate normally. Collecting complete fault data for deep learning model training is often difficult. Such scenarios with a large difference between the number of normal data and fault data usually affect the performance of fault diagnosis models. Here, an interactive generative feature space oversampling-based autoencoder (IGFSO-AE) is proposed to realize fault sample generation under imbalanced data. First, the original vibration signal is converted into a semantically stable amplitude–frequency signal by fast Fourier transform and input into the autoencoder; second, the order of the hidden layer space features of the autoencoder is randomly exchanged, and the interactive sample generation learning strategy trains the autoencoder; then, interpolation oversampling is used to interpolate samples in the hidden layer space where the Euclidean distance between samples is large, and is input into the decoder, the generated samples are mixed with the original samples to form a new training set, which is used to train the intelligent fault diagnosis model and output the diagnosis results. Finally, the performance of the proposed method is evaluated using the publicly available bearing dataset and the bogie-bearing fault simulation bench in our lab. The experimental results show that IGFSO-AE can generate diverse samples with incremental information and exhibits robustness and superiority in different imbalanced proportions of data.

Construction of design requirements knowledgebase from unstructured design guidelines using natural language processing

In the manufacturing industry, unstructured documents such as design guidelines, regulatory documents, and failure cases are essential for product development. However, due to the large volume and frequent revisions of these documents, designers often find it difficult to keep up to date with the latest content. This study presents a method for analyzing the characteristics of unstructured design guidelines and automatically constructing a knowledgebase of design requirements from them. A knowledgebase is structured data that a computer can understand, and that can be used to assist designers in the design process. The knowledgebase is constructed using the sections of the document, including design variables and design requirements. The construction process involves pre-processing the documents, extracting information using natural language processing models, and generating a knowledgebase using predefined rules. A requirements knowledgebase was experimentally constructed from a standard document on the general requirements for the design of pressure vessels (American Society of Mechanical Engineers Section VIII Division 1) using the proposed method. In the experiment, the accuracy of information extraction was 86.3 %, and the generation process took 3 min and 50 s. Thus, the proposed method eliminates the need for specialized training of deep learning models and can be applied to various design guideline documents with simple modifications to the design vocabulary and rules. The knowledgebase has applications in design validation, and is expected to enhance the efficiency of the product development process and contribute to reducing the overall development timeline.

Cross-sensor transfer learning for fire smoke scene detection using variable-bands multi-spectral satellite imagery aided by spectral patterns

ABSTRACT This paper addresses the challenge of training deep learning models for fire smoke scene detection from multi-sensor, multi-spectral satellite imagery, where spectral bands vary and training data is scarce, especially for new sensors. We introduce a novel cross-sensor transfer learning approach enhanced by spectral pattern extraction, notably aided by a deep learning (DL) module called Input Amplification (IA). Our contribution includes the creation of two datasets, Landsat_smk2770 and Sentinel2_smk, with varying spectral bands. We employ a model named IA_VIB_SD which incorporates IA and is designed specifically for fire smoke scene detection. We investigated the transferability of the Landsat_smk2770-trained IA_VIB_SD model to the Sentinel2_smk dataset using various transfer learning techniques, and compared the performance of the transferred model with the benchmark IA_VIB_SD model exclusively trained on pure Sentinel2_smk data. Our proposed transfer learning approach resulted in a transferred model with an average accuracy 5% higher than the benchmark model. Notably, Our proposed transfer learning approach outperformed existing transfer learning methods by more than 1% in terms of the accuracy, even when trained on a mere 10% of the Sentinel2_smk dataset. This research advances fire smoke scene detection from multi-sensor, multi-spectral satellite imagery.

LRFE: A NOVEL LOCAL RESPONSE FEATURE ELIMINATION PROCESS FOR IDENTIFICATION OF LUNG CANCER CELLS

One of the main causes of cancer-related mortality across the globe is lung cancer. Early-stage lung cancer frequently exhibits no symptoms, which delays diagnosis until the illness has progressed. Before symptoms manifest, screening and early detection techniques can aid in the early diagnosis and treatment of lung cancer. Many olden research papers have implemented image processing and few latest papers have implemented computer vision techniques to detect lung cancer. Particularly when dealing with minor or subtle anomalies, image processing algorithms may not be able to detect lung cancer lesions with sufficient sensitivity and specificity. It is still difficult to increase the detection algorithms' accuracy and dependability, especially when dealing with early-stage lesions or situations where attributes overlap. It takes a lot of processing power, such as high-performance GPUs and enormous memory capacities, to train deep learning models, particularly large-scale convolutional neural networks (CNNs). In this proposed research, the model pre-processes the images using the ostu and sober filter mechanisms because Otsu's approach adjusts to the features of the input image, including noise, contrast, and lighting fluctuations. It is capable of handling images with varying dynamic ranges and intensity distributions without depending on pre-established threshold settings. When it comes to image noise, the Sobel filter is more resilient than other edge detection methods. It produces clearer edge maps and fewer false detections by determining the gradient magnitude, which amplifies edge information while suppressing noise. The features are extracted using the tuned AlexNet pre-trained model, in AlexNet there is a layer known as “Layer-wise Relevance Propagation”. By giving each pixel or feature in the input image a relevance score, the LRP layer offers fine-grained feature attribution. This makes it possible to analyze in great depth which particular elements or areas of the input image are most important for the network to forecast, which helps to clarify the underlying patterns that the network has learned. At last, the extracted features are further reduced using the enhanced feature elimination method. By iteratively selecting subsets of features based on their importance, RFE helps to identify the most relevant features for the classification task. Integrating RFE with SVM classifiers can lead to improved model performance by focusing on the subset of features that are most discriminative and informative for the classification problem.

Conquering Class Imbalances in Deep Learning-based Segmentation of Dental Radiographs with Different Loss Functions.

ObjectiveThe imbalanced nature of real-world datasets is an ongoing challenge in the field of machine and deep learning. In medicine and in dentistry, most data samples represent patients not affected by pathologies, and on imagery, pathologic image areas are often smaller than healthy ones. Selecting suitable loss functions during deep learning is essential and may help to overcome the resulting imbalance. We assessed six different loss functions for one exemplary task, tooth structure segmentation on bitewing radiographs, for their performance. MethodsSix different loss functions (Focal Loss, Dice Loss, Tversky Loss and hybrid losses of Cross-Entropy and Dice Loss, Focal and Dice Loss, Focal and Generalized Dice Loss) were compared on a tooth structure segmentation task of 1,625 bitewing radiographs. Training was performed using three different model architectures (U-Net, Linknet, DeepLavbV3+) over a 5-fold cross-validation. Tooth structures consisted of the classes (occurrence in % of samples/captures areas measured on pixel level) enamel (100%/25%), dentin (100%/50%), root canal (100%/10%), filling (81%/8%) and crown (28%/5%). ResultsHybrid loss functions significantly outperformed standalone ones and provided robust results over the different architectures for the classes enamel, dentin, root canal and filling. Specifically, the Dice Focal loss reached high performance to conquer both image level and pixel level class imbalance, respectively. Clinical SignificanceIn dental use cases it is often important to predict minority classes such as pathologies accurately. Using specific loss function may be an effective strategy to overcome data imbalance when training deep learning models.

Enhancing Medical Image Classification with Generative AI using Latent Denoising Diffusion Probabilistic Model and Wiener Filtering Approach

In the evolving landscape of medical diagnostics, a paradigm shift is being catalysed by the advent of generative artificial intelligence. Medical X-ray, CT and MRI images are essential diagnostic tools used by healthcare professionals to assess various musculoskeletal conditions. However, obtaining a sufficient number of medical images for training deep learning models can be challenging due to limited access to labelled data. Hence, the authors propose a novel Latent diffusion process for synthesizing medical images that closely resemble real patient images, aiming to address the challenge of limited access to labelled data in medical diagnostics. Leveraging deep learning and generative modelling techniques, this method synthesizes high-fidelity images that closely mimic real patient scans. By introducing noise and subsequently training the model to denoise, the approach captures intricate patterns inherent in authentic medical images. Among the four datasets utilized, the Diabetes Retinopathy dataset demonstrates superior performance, achieving the highest Mean Structural Similarity Index (MSSIM) score of 0.57 (compared to the dataset baseline of 0.62) and an accuracy of 93.75% when passed through the proposed pipeline. The Cataract dataset, registered a MSSIM score of 0.51 (versus the dataset baseline of 0.53) and an accuracy score of 97.52%, while the Knee OA dataset follows closely with MSSIM and accuracy scores of 0.65 (in contrast to the dataset baseline of 0.63) and 68.66% respectively. The results obtained are then compared with the results generated by the other state of the art models.

Enhancing ransomware detection using Siamese network

Organizations in the current digital era are exposed to a variety of cybersecurity threats that can often result in financial losses and harm to their reputation. Among these threats, ransomware attacks can cause significant damage. Attackers are constantly improving their techniques to bypass security channels, which makes it challenging to monitor and detect the patterns of attacks. Consequently, there is a growing inclination towards employing state-of-the-art techniques to identify and defend during ransomware attacks. Deep learning is a proven technique that can be employed to learn from large complex patterns. However, large datasets are required in the training of deep learning models which is a challenging task. Few-shot learning (FSL) overcomes this limitation by using less data. In this research work, a Siamese network design is developed by incorporating the architectural principles of AlexNet and features of the VGG configuration. The employed methodology enables us to evaluate the inherent resemblances and disparities in the data. This novel methodology demonstrated exceptional performance, with an average accuracy of 97% when compared to various effects and learning rates. The results of the presented study demonstrate the capacity to greatly enhance cybersecurity by providing a scalable and effective approach for detecting ransomware.

Facial Expression Recognition Using Convolutional Neural Network

Understanding others' intentions through nonverbal cues like facial emotions is crucial in human communication. To design and train Deep Learning Models, this paper describes in detail how Convolutional Neural Network Models are developed using tf. Keras. The aim is to Sort facial photos into one of the seven face detection classifiers, our model is developed in such a manner that it learns hidden nonlinearity from the entered facial images, which is vital for discriminating the form of emotion someone is expressing. The model proposed on the Lenet-5 architecture by Yann LeCun uses the subsampling, feature map, and activation function (ReLu) in between the convolutional layer and fully connected layer for the output soft-max activation function will be used. The FER-2013 dataset, which consists of 35,887 structured 48x48 pixel grayscale images, was used to train the CNN models. The training dataset has 28,709 elements, while the testing dataset has 3,589 elements, and while validation has 3,589 elements. Train and test are the two folder names used to organize the FER dataset. separated even further into distinct files, each holding a different kind of FER dataset class. To mitigate the overfitting of the dropout, batch normalization and the model are employed. Since this is a multiclass classification problem, we are utilizing the Soft-max activation function and the Rectified linear unit for non-linear operation (ReLu). We are training a categorical cross- entropy and matrix for accuracy based on the parameters to assess the constructed CNN model's performance by examining the training epoch history and we have used optimizer Adam (Adaptive Moment Estimation) with the learning rate of 0.0001. We obtained the accuracy of the LeNet-5 model on training at 95.49% and testing at 49.47% [13].

Large-scale land use/land cover extraction from Landsat imagery using feature relationships matrix based deep-shallow learning

Deep learning has demonstrated its effectiveness in capturing high-level features, with convolutional neural networks (CNNs) excelling in remote sensing classification. However, CNNs encounter challenges when applied to Landsat images with limited multi-spectral bands, as they struggle to learn stable features from the spectral domain and integrate them with spatial features to enhance accuracy. Additionally, most CNN applications focus on learning features directly from the raw image, making them susceptible to spectral environment changes. To overcome these limitations, this paper introduces a novel approach for large-scale Land Use/Land Cover (LULC) extraction from Landsat OLI images. The proposed classification architecture comprises two modules. The first module utilizes a feature relationships matrix to generate an extent feature map (EFM), and a specifically designed CNN structure learns deep features from the EFM and spatial domain. In the second module, a multiple classifiers system (MCS) is employed to obtain shallow learning features, which are further enhanced by another CNN structure through continued learning. The combined features from these modules contribute to improved classification of remote sensing images. Experimental results demonstrate that our proposed method effectively acquires stable features for training deep learning models with strong generalization ability. It exhibits significant advancements in accuracy improvement and large-scale LULC extraction in the Yangtze River Economic Belt (YREB) in China, surpassing comparative approaches based on deep learning and non-deep learning methods.

CBCT-DRRs superior to CT-DRRs for target-tracking applications for pancreatic SBRT

Objective. In current radiograph-based intra-fraction markerless target-tracking, digitally reconstructed radiographs (DRRs) from planning CTs (CT-DRRs) are often used to train deep learning models that extract information from the intra-fraction radiographs acquired during treatment. Traditional DRR algorithms were designed for patient alignment (i.e. bone matching) and may not replicate the radiographic image quality of intra-fraction radiographs at treatment. Hypothetically, generating DRRs from pre-treatment Cone-Beam CTs (CBCT-DRRs) with DRR algorithms incorporating physical modelling of on-board-imagers (OBIs) could improve the similarity between intra-fraction radiographs and DRRs by eliminating inter-fraction variation and reducing image-quality mismatches between radiographs and DRRs. In this study, we test the two hypotheses that intra-fraction radiographs are more similar to CBCT-DRRs than CT-DRRs, and that intra-fraction radiographs are more similar to DRRs from algorithms incorporating physical models of OBI components than DRRs from algorithms omitting these models. Approach. DRRs were generated from CBCT and CT image sets collected from 20 patients undergoing pancreas stereotactic body radiotherapy. CBCT-DRRs and CT-DRRs were generated replicating the treatment position of patients and the OBI geometry during intra-fraction radiograph acquisition. To investigate whether the modelling of physical OBI components influenced radiograph-DRR similarity, four DRR algorithms were applied for the generation of CBCT-DRRs and CT-DRRs, incorporating and omitting different combinations of OBI component models. The four DRR algorithms were: a traditional DRR algorithm, a DRR algorithm with source-spectrum modelling, a DRR algorithm with source-spectrum and detector modelling, and a DRR algorithm with source-spectrum, detector and patient material modelling. Similarity between radiographs and matched DRRs was quantified using Pearson’s correlation and Czekanowski’s index, calculated on a per-image basis. Distributions of correlations and indexes were compared to test each of the hypotheses. Distribution differences were determined to be statistically significant when Wilcoxon’s signed rank test and the Kolmogorov-Smirnov two sample test returned p ≤ 0.05 for both tests. Main results. Intra-fraction radiographs were more similar to CBCT-DRRs than CT-DRRs for both metrics across all algorithms, with all p ≤ 0.007. Source-spectrum modelling improved radiograph-DRR similarity for both metrics, with all p < 10−6. OBI detector modelling and patient material modelling did not influence radiograph-DRR similarity for either metric. Significance. Generating DRRs from pre-treatment CBCT-DRRs is feasible, and incorporating CBCT-DRRs into markerless target-tracking methods may promote improved target-tracking accuracies. Incorporating source-spectrum modelling into a treatment planning system’s DRR algorithms may reinforce the safe treatment of cancer patients by aiding in patient alignment.

Deep learning the cis-regulatory code for gene expression in selected model plants

Elucidating the relationship between non-coding regulatory element sequences and gene expression is crucial for understanding gene regulation and genetic variation. We explored this link with the training of interpretable deep learning models predicting gene expression profiles from gene flanking regions of the plant species Arabidopsis thaliana, Solanum lycopersicum, Sorghum bicolor, and Zea mays. With over 80% accuracy, our models enabled predictive feature selection, highlighting e.g. the significant role of UTR regions in determining gene expression levels. The models demonstrated remarkable cross-species performance, effectively identifying both conserved and species-specific regulatory sequence features and their predictive power for gene expression. We illustrated the application of our approach by revealing causal links between genetic variation and gene expression changes across fourteen tomato genomes. Lastly, our models efficiently predicted genotype-specific expression of key functional gene groups, exemplified by underscoring known phenotypic and metabolic differences between Solanum lycopersicum and its wild, drought-resistant relative, Solanum pennellii.

Upscaling reactive transport models from pore-scale to continuum-scale using deep learning method

Reactive transport modeling of subsurface environments plays an important role in addressing critical problems of geochemical processes, such as dissolution and precipitation of minerals. Current transport models for porous media span various scales, ranging from pore-scale to continuum-scale. In this study, we established an upscaling method connecting pore-scale and continuum-scale models by employing a deep learning methodology of Convolutional Neural Networks (CNNs). We applied Darcy-Brinkmann-Stokes (DBS) method to simulate the fluid flow and reactive transport in pore-scale models, which would act as constituents of a continuum-scale model. The datasets of spatial pore distribution of subvolume samples were used as the input for the deep learning model, and the continuum (Darcy)-scale parameters such as permeability, effective surface area, and effective diffusion coefficient were figured out as outputs (i.e., labels). By applying the trained models of the subvolumes in the entire sample volume, we generated the initial field of porosity, permeability, effective diffusion coefficient, and effective surface area for continuum-scale simulation of a mineral dissolution problem. We took an acid dissolution case as an example to utilize the outcomes of trained deep learning models as input data in the continuum-scale simulation. This work presents a comprehensive upscaling workflow, as bridging the findings of microscale simulations to the continuum-scale simulations of a reactive transport problem.

Mitigating bias in deep learning: training unbiased models on biased data for the morphological classification of galaxies

ABSTRACT Galaxy morphologies and their relation with physical properties have been a relevant subject of study in the past. Most galaxy morphology catalogues have been labelled by human annotators or by machine learning models trained on human-labelled data. Human-generated labels have been shown to contain biases in terms of the observational properties of the data, such as image resolution. These biases are independent of the annotators, that is, are present even in catalogues labelled by experts. In this work, we demonstrate that training deep learning models on biased galaxy data produces biased models, meaning that the biases in the training data are transferred to the predictions of the new models. We also propose a method to train deep learning models that considers this inherent labelling bias, to obtain a de-biased model even when training on biased data. We show that models trained using our deep de-biasing method are capable of reducing the bias of human-labelled data sets.

Wildfire response of forest species from multispectral LiDAR data. A deep learning approach with synthetic data

Forests play a crucial role as the lungs and life-support system of our planet, harbouring 80% of the Earth's biodiversity. However, we are witnessing an average loss of 480 ha of forest every hour because of destructive wildfires spreading across the globe. To effectively mitigate the threat of wildfires, it is crucial to devise precise and dependable approaches for forecasting fire dynamics and formulating efficient fire management strategies, such as the utilisation of fuel models.The objective of this study was to enhance forest fuel classification that considers only structural information, such as the Prometheus model, by integrating data on the fire responses of various tree species and other vegetation elements, such as ground litter and shrubs. This distinction can be achieved using multispectral (MS) Light Detection and Ranging (LiDAR) data in mixed forests. The methodology involves a novel approach in semantic classifications of forests by generating synthetic data with semantic labels regarding fire responses and reflectance information at different spectral bands, as a real MS scanner device would detect. Forests, which are highly intricate environments, present challenges in accurately classifying point clouds. To address this complexity, a deep learning (DL) model for semantic classification was trained on synthetic point clouds in different formats to achieve the best performance when leveraging MS data.Forest plots in the study region were scanned using different Terrestrial Laser Scanning sensors at wavelengths of 905 and 1550 nm. Subsequently, an interpolation process was applied to generate the MS point clouds of each plot, and the trained DL model was applied to classify them. These classifications surpassed the average thresholds of 90% and 75% for accuracy and intersection over union, respectively, resulting in a more precise categorisation of fuel models based on the distinct responses of forest elements to fire. The results of this study reveal the potential of MS LiDAR data and DL classification models for improving fuel model retrieval in forest ecosystems and enhancing wildfire management efforts.

TIST-Net: style transfer in dynamic contrast enhanced MRI using spatial and temporal information.

Training deep learning models for image registration or segmentation of dynamic contrast enhanced (DCE)-MRI data is challenging. This is mainly due to the wide variations in contrast enhancement within and between patients. To train a model effectively, a large dataset is needed, but acquiring it is expensive and time consuming. Instead, style transfer can be used to generate new images from existing images.&#xD; &#xD;In this study, our objective is to develop a style transfer method that incorporates spatio-temporal information to either add or remove contrast enhancement from an existing image.&#xD; &#xD;We propose a Temporal Image-to-Image Style Transfer Network (TIST-Net), consisting of an auto-encoder combined with convolutional long short-term memory (LSTM) networks. This enables disentanglement of the content and style latent spaces of the time series data, using spatio-temporal information to learn and predict key structures . To generate new images , we use deformable and adaptive convolutions which allow fine grained control over the combination of the content and style latent spaces. We evaluate our method, using popular metrics and a previously proposed contrast weighted structural similarity index measure (CW-SSIM). We also perform a clinical evaluation, where experts are asked to rank images generated by multiple methods. &#xD; &#xD;Our model achieves state-of-the-art performance on three datasets (kidney, prostate and uterus) achieving an SSIM of 0.91±0.03, 0.73±0.04, 0.88±0.04 respectively when performing style transfer between a non-enhanced image and a contrast-enhanced image. Similarly, SSIM results for style transfer from a contrast-enhanced image to a non-enhanced image were 0.89±0.03, 0.82±0.03, 0.87±0.03. In the clinical evaluation, our method was ranked consistently higher than other approaches.&#xD; &#xD;TIST-Net can be used to generate new DCE-MRI data from existing images. In future, this may improve models for tasks such as image registration or segmentation by allowing small training datasets to be expanded.

A Swin transformer encoder-based StyleGAN for unbalanced endoscopic image enhancement

With the rapid development of artificial intelligence, automated endoscopy-assisted diagnostic systems have become an effective tool for reducing the diagnostic costs and shortening the treatment cycle of patients. Typically, the performance of these systems depends on deep learning models which are pre-trained with large-scale labeled data, for example, early gastric cancer based on endoscopic images. However, the expensive annotation and the subjectivity of the annotators lead to an insufficient and class-imbalanced endoscopic image dataset, and these datasets are detrimental to the training of deep learning models. Therefore, we proposed a Swin Transformer encoder-based StyleGAN (STE-StyleGAN) for unbalanced endoscopic image enhancement, which is composed of an adversarial learning encoder and generator. Firstly, a pre-trained Swin Transformer is introduced into the encoder to extract multi-scale features layer by layer from endoscopic images. The features are subsequently fed into a mapping block for aggregation and recombination. Secondly, a self-attention mechanism is applied to the generator, which adds detailed information of the image layer by layer through recoded features, enabling the generator to autonomously learn the coupling between different image regions. Finally, we conducted extensive experiments on a private intestinal metaplasia grading dataset from a Grade-A tertiary hospital. The experimental results show that the images generated by STE-StyleGAN are closer to the initial image distribution, achieving a Fréchet Inception Distance (FID) value of 100.4. Then, these generated images are used to enhance the initial dataset to improve the robustness of the classification model, and achieved a top accuracy of 86 %.

Securing Smart Contracts: Harnessing the Power of Efficient NetB2 Detection

Objective: Using a variety of datasets from the Ethereum documentation and Smart Contract Dataset repository, this study tackles the crucial problem of classifying smart contract vulnerabilities. Methods: Our study uses a three-module method and focuses on the Resource 3 Dataset, which contains over 2,000 Ethereum smart contracts, including inherited contracts. The groundwork for deep learning model training is laid in Module 1 by extracting bytecode from Solidity files and creating images thereafter. In Colab, Module 2 entails importing data, pre-processing, SMOTE balancing, and building three deep learning models: CNN, XCEPTION, and EfficientNet-B2. Module 3 is a Flask-based web application created in Visual Studio Code that enables vulnerability predictions, bytecode extraction, and user interaction. Findings: With an overall accuracy of 71 percent, the Convolutional Neural Network (CNN) displays its effectiveness in classifying vulnerabilities. Although the accuracy of XCEPTION and EfficientNet-B2 is 69% and 75%, respectively, the latter is the top performer. Novelty &amp; Applications: The online application adds to the comprehensive examination of smart contract security by giving users an easy-to-use interface. The EfficientNet-B2 model stands out as a dependable tool for precise vulnerability classification, and this study advances our understanding of and efforts to mitigate vulnerabilities in Ethereum smart contracts. Keywords: Smart Contracts, Vulnerability Classification, Ethereum, Deep Learning, Convolutional Neural Network (CNN)