Generative Adversarial Network Approach Research Articles

Assessment of reinforced concrete corrosion degree based on the quantum particle swarm optimised-generative adversarial network

Reinforced concrete corrosion inspection methods based on deep learning have been widely used in the engineering field to monitor the service status of reinforced concrete. However, in engineering practice, it is difficult to obtain a large amount of reinforced concrete corrosion data of different types, which greatly hinders the improvement of the accuracy of neural network models in predicting corrosion conditions. The classic generative adversarial network (GAN) model gives poor model quality for datasets with small amounts of data and high concentration. This paper proposes an improved generative adversarial network approach to optimise reinforced concrete corrosion data. Firstly, a quantum particle swarm optimisation (QPSO) algorithm is used to improve the generative adversarial network. Then, existing corrosion characteristic data is used to train the improved generative adversarial network until the ideal equilibrium state is reached. Next, the feature data generated by the generator are fused with the original data and the fused data are input into several common machine learning models for training. Experimental results show that compared with other conventional results obtained by directly inputting corrosion data into a neural network model for training, the improved method makes full use of multi-source signal data and achieves better classification performance.

Enhancing Financial Time Series Prediction with Quantum-Enhanced Synthetic Data Generation: A Case Study on the S&P 500 Using a Quantum Wasserstein Generative Adversarial Network Approach with a Gradient Penalty

This study introduces a novel Quantum Wasserstein Generative Adversarial Network approach with a Gradient Penalty (QWGAN-GP) model that leverages a quantum generator alongside a classical discriminator to synthetically generate time series data. This approach aims to accurately replicate the statistical properties of the S&P 500 index. The synthetic data generated by this model were compared to the original series using various metrics, including Wasserstein distance, Dynamic Time Warping (DTW) distance, and entropy measures, among others. The outcomes demonstrate the model’s robustness, with the generated data exhibiting a high degree of fidelity to the statistical characteristics of the original data. Additionally, this study explores the applicability of the synthetic time series in enhancing prediction models. An LSTM (Long-Short Term Memory)-based model was developed to evaluate the impact of incorporating synthetic data on forecasting accuracy, particularly focusing on general trends and extreme market events. The findings reveal that models trained on a mix of synthetic and real data significantly outperform those trained solely on historical data, improving predictive performance.

A generative adversarial network approach for removing motion blur in the automatic detection of pavement cracks

AbstractAdvancements in infrastructure management have significantly benefited from automatic pavement crack detection systems, relying on image processing enhanced by high‐resolution imaging and machine learning. However, image and motion blur substantially challenge the accuracy of crack detection and analysis. Nevertheless, research on mitigating motion blur remains sparse. This study introduces an effective image processing system adept at deblurring and segmentation, employing a generative adversarial network (GAN) with UNet as the generator and Wasserstein GAN with Gradient Penalty (WGAN‐gp) as the loss function. This approach performs exceptionally in deblurring pavement crack images and improves segmentation accuracy. Models were trained with sharp and artificially blurred images, with WGAN‐gp surpassing other loss functions in effectiveness. This research innovatively suggests assessing deblurring quality through segmentation accuracy in addition to peak signal‐to‐noise ratio (PSNR) and structural similarity (SSIM), revealing that PSNR and SSIM may not fully capture deblurring effectiveness for pavement crack images. An extensive evaluation of various generators, including UNet, lightweight UNet, TransUNet, DeblurGAN, DeblurGAN‐v2, and MIMO‐UNet, identifies the superior performance of UNet on simulated motion blur. Validation with actual motion‐blurred images confirms the effectiveness of the proposed model. These findings demonstrate that GAN‐based models have great potential in overcoming motion blur challenges in pavement crack detection systems, marking a notable advancement in the field.

Addressing diversity in hiring procedures: a generative adversarial network approach

Addressing diversity in hiring procedures: a generative adversarial network approach

Reinventing Web Security: An Enhanced Cycle-Consistent Generative Adversarial Network Approach to Intrusion Detection

Web3.0, as the link between the physical and digital domains, faces increasing security threats due to its inherent complexity and openness. Traditional intrusion detection systems (IDSs) encounter formidable challenges in grappling with the multidimensional and nonlinear traffic data characteristic of the Web3.0 environment. Such challenges include insufficient samples of attack data, inadequate feature extraction, and resultant inaccuracies in model classification. Moreover, the scarcity of certain traffic data available for analysis by IDSs impedes the system’s capacity to document instances of malicious behavior. In response to these exigencies, this paper presents a novel approach to Web3.0 intrusion detection, predicated on the utilization of cycle-consistent generative adversarial networks (CycleGANs). Leveraging the data transformation capabilities of its generator, this method facilitates bidirectional conversion between normal Web3.0 behavioral data and potentially intrusive behavioral data. This transformative process not only augments the diversity and volume of recorded intrusive behaviors but also clandestinely simulates various attack scenarios. Furthermore, through fostering mutual competition and learning between the discriminator and generator, the approach enhances the ability to discern the defining characteristics of potential intrusive behaviors, thereby bolstering the accuracy of intrusion detection. To substantiate the efficacy of the CycleGAN-based intrusion detection method, simulation experiments were conducted utilizing public datasets, including KDD CUP 1999 (KDD), CIC-DDOS2019, CIC-IDS2018, and SR-BH 2020. The experimental findings evince the method’s remarkable accuracies across the four datasets, attaining rates of 99.81%, 97.79%, 89.25%, and 95.15%, respectively, while concurrently maintaining low false-positive rates. This research contributes novel insights and methodologies toward the advancement of Web3.0 intrusion detection through the application of CycleGAN technology, which is poised to play a pivotal role in fortifying the security landscape of Web3.0.

Enhanced pyramidal residual networks for single image super-resolution

Several super-resolution (SR) techniques are introduced in the literature, including traditional and machine learning-based algorithms. Especially, deep learning-based SR approaches emerge with demands for better quality images providing deeper subpixel enhancement. Dealing with the image enhancement task in the satellite images domain, a new SR method for single image SR, namely Enhanced Deep Pyramidal Residual Networks, is introduced in this study. The proposed method overcomes the potential instability problem of Enhanced Deep Residual Networks for Single Image Super-Resolution (EDSR) approach by gradually increasing the feature maps depending upon Pyramidal Residual Networks architecture. The EDSR itself is a good algorithm in the SR domain. However, it has a strict structure for increasing the block size. To overcome this problem with the aim of increasing the algorithm’s performance, the pyramidal residual networks gradually increasing hypothesis is utilized in the proposed approach, which is the main contribution and novelty of this study. Besides, by using the pyramidal residual networks gradually increasing hypothesis in the proposed approach, the parameter size of the models is also reduced, which affects the computational time. Two different models are proposed by considering addition and multiplication manners, and the proposed models are evaluated using well-known remote sensing datasets NWPU-RESISC45 and UC Merced. The results obtained by the proposed model are compared with the results of traditional image enhancement algorithms together with the EDSR itself, EDSR with deeper structure, Super-Resolution Generative Adversarial Networks approach, and Residual Local Feature Networks approach in terms of peak signal to noise ratio (PSNR) and structural similarity index measure (SSIM) metrics and showed that the proposed models present better quality images. Moreover, considering the computational time and complexity, it is shown that some proposed models achieve approximately 27% less output parameter having similar PSNR and SSIM values and computational time for EDSR itself and 65% less output parameter having better PSNR and SSIM values and 16% lower computational time for EDSR with deeper structure.

An intra-class distribution-focused generative adversarial network approach for imbalanced tabular data learning

An intra-class distribution-focused generative adversarial network approach for imbalanced tabular data learning

MIMO-ODDM Signal Detection: A Spatial-based Generative Adversarial Network Approach

MIMO-ODDM Signal Detection: A Spatial-based Generative Adversarial Network Approach

Cycle Generative Adversarial Network approach for normalization of Gram-stain images for bacteria detection

The Gram staining method is one of the most effective morphological identification procedures for detecting bacteria from direct smear microscopy. This staining process is inexpensive. It aids in diagnosing bacterial infections quickly as it is used for direct clinical sample specimens such as pus, urine, and sputum. The computer-aided diagnostic system aids the clinician by avoiding tedious manual evaluation procedures. However, images captured often suffer from contrast, illumination, and stain variations due to various camera settings and situations. These differences are due to image acquisition conditions, sample quality, and poor staining procedures. These variations affect the diagnosis process, lowering the image analysis performance of the computer-aided diagnosis system. In this context, the present work proposes a novel color normalization approach based on a Cycle Generative Adversarial Network(GAN). We introduce a novel normalization loss function, Lcycm, which is integrated into our dedicated normalization loss, LN, within the framework of Cycle GAN(CGAN). The proposed method is compared with the state-of-the-art normalization algorithms qualitatively and quantitatively using the KMC dataset. In addition, the study demonstrates the impact of normalization on the Convolutional Neural Network (CNN) -based segmentation and classification process. Furthermore, a bacteria detection framework is proposed based on the U2Net segmentation model and a CNN classifier. The proposed normalization achieved an SSIM score of 0.93 ± 0.07 and PSNR of 29 ± 3.7. The accuracy of the CNN-based classifier improved by 40 % after normalization.

Super-Resolution Reconstruction of Weak Targets on Water Surfaces: A Generative Adversarial Network Approach Based on Implicit Neural Representation

Super-Resolution Reconstruction of Weak Targets on Water Surfaces: A Generative Adversarial Network Approach Based on Implicit Neural Representation

Customer baseline load estimation for virtual power plants in demand response: An attention mechanism-based generative adversarial networks approach

The virtual power plant (VPP) that aggregates demand-side resources, is a new type of entity to participate in the electricity market and demand response (DR) program. Accurate customer baseline load (CBL) estimation is critical for DR implementation, especially the financial settlement in incentive-based DR. However, this is a challenging task as CBLs cannot be measured and are not equal to actual loads when DR events occur. Moreover, VPPs with different aggregation scales form heterogeneous electricity customers, which increases the difficulty of CBL estimation. In order to address this challenge, this paper proposes a novel deep learning-based CBL estimation method for varied types of electricity customers with different load levels. Specifically, we first transform the CBL estimation problem into a time-series missing data imputation issue, by regarding actual load sequences as CBL sequences with missing data, during DR periods. Then, we propose an attention mechanism-based neural network model to learn load patterns and characteristics of various CBLs, and also create the DR mask to avoid the disturbance of actual loads of DR periods on CBL’s normal pattern. Further, we develop the generative adversarial networks (GAN)-based data imputation framework to produce the corresponding complete CBL sequence according to the actual load sequence, and then recover the missing values accordingly. Finally, comprehensive case studies are conducted based on public datasets, and our proposed method outperforms all benchmarks, where the mean and standard deviation of its estimation percentage error are 5.85% and 1.74%, respectively. This validates the effectiveness and superiority of the proposed method.

Understanding causal effects of ride-sourcing subsidy: A novel generative adversarial networks approach

Ride-sourcing platforms offer subsidies for drivers to ensure stable supply capacity for on-demand ride services. These subsidies guarantee minimum surges in advance to help drivers plan to drive, thus more efficiently coping with the spatial–temporal imbalance between supply and demand than surge wage. Understanding the causal effects of ride-sourcing subsidy is a prerequisite for precision targeting when deploying driver promotion activities. We propose a novel generative adversarial networks based model GANIRC to estimate the individual treatment effect (ITE) of ride-sourcing subsidy on drivers' online time. It captures counterfactual distributions via adversarial learning and generates individual response curves (IRCs) in the form of neural networks. The generator acts as a metafunction of responses, and the analytical constraints of IRCs are relaxed. Wasserstein distance is adopted to measure the closeness between counterfactual and factual distributions, and improve the stability of the minimax game between the generator and discriminator. In addition to the theoretical proof that our model approximately minimizes the upper bound on the ITE estimation error, the model performance is verified by leveraging ride-sourcing subsidy activity data in four cities with varying scales. Results show that our proposed model can generate accurate counterfactual distributions based on limited observational data. In the case study of the four cities, the drivers with neoclassical behavior, who increase working time with income, dominate in the ride-sourcing market, and inactive drivers respond more positively to subsidies than active drivers. Very few drivers in large cities are identified to have income-targeting behavior, who have income targets and stop working when reaching these targets. Our study reconciles the controversy of whether neoclassical theory or income-targeting theory is appropriate for ride-sourcing drivers, and has practical implications for understanding behavior and optimizing ride-sourcing operations.

Underwater Wireless Optical Communication With One-Bit Quantization: A Hybrid Autoencoder and Generative Adversarial Network Approach

Compared with underwater acoustic communication, underwater wireless optical communication (UWOC) has the advantages of wide communication bandwidth, high transmission speed and strong directional transmission, which make it have broad application prospects. However, the absorption and scattering effects in underwater environments cause a UWOC system to suffer from severe channel fading. To reduce the system complexity and power loss, the on–off-keying (OOK) modulation scheme and one-bit analog-to-digital converter are considered in this work. Besides, to deal with the complex underwater optical channels and the nonlinearity of the one-bit quantization, a novel deep learning based architecture integrating the autoencoder (AE) and generative adversarial network (GAN), named hybrid AE-GAN, is developed. In the proposed hybrid AE-GAN, the generator in GAN is responsible for a generalized channel equalization, which aims to equalize both the impairments from underwater optical channels and the distortion from one-bit quantization. While the decoder in AE and the discriminator in GAN share the same network to distinguish true and fake as well as reconstruct the sent messages simultaneously. Meanwhile, the one-bit quantized signal is regarded as conditional information for GAN to assist in targeted channel equalization for various signals. Moreover, a specialized loss function and training strategy for the hybrid AE-GAN are also presented, which can optimize AE and GAN at the same time, and deal with the problem that the binarization of OOK stymies the gradient backpropagation. The simulation results indicate that the proposed hybrid AE-GAN can achieve superior performance.

Hybrid data augmentation and deep attention-based dilated convolutional-recurrent neural networks for speech emotion recognition

Recently, speech emotion recognition (SER) has become an active research area in speech processing, particularly with the advent of deep learning (DL). Numerous DL-based methods have been proposed for SER. However, most of the existing DL-based models are complex and require a large amounts of data to achieve a good performance. In this study, a new framework of deep attention-based dilated convolutional-recurrent neural networks coupled with a hybrid data augmentation method was proposed for addressing SER tasks. The hybrid data augmentation method constitutes an upsampling technique for generating more speech data samples based on the traditional and generative adversarial network approaches. By leveraging both convolutional and recurrent neural networks in a dilated form along with an attention mechanism, the proposed DL framework can extract high-level representations from three-dimensional log Mel spectrogram features. Dilated convolutional neural networks acquire larger receptive fields, whereas dilated recurrent neural networks overcome complex dependencies as well as the vanishing and exploding gradient issues. Furthermore, the loss functions are reconfigured by combining the SoftMax loss and the center-based losses to classify various emotional states. The proposed framework was implemented using the Python programming language and the TensorFlow deep learning library. To validate the proposed framework, the EmoDB and ERC benchmark datasets, which are imbalanced and/or small datasets, were employed. The experimental results indicate that the proposed framework outperforms other related state-of-the-art methods, yielding the highest unweighted recall rates of 88.03 ± 1.39 (%) and 66.56 ± 0.67 (%) for the EmoDB and ERC datasets, respectively.

Channel Estimation for High-Speed Railway Wireless Communications: A Generative Adversarial Network Approach

In high-speed railways, the wireless channel and network topology change rapidly due to the high-speed movement of trains and the constant change of the location of communication equipment. The topology is affected by channel noise, making accurate channel estimation more difficult. Therefore, the way to obtain accurate channel state information (CSI) is the greatest challenge. In this paper, a two-stage channel-estimation method based on generative adversarial networks (cGAN) is proposed for MIMO-OFDM systems in high-mobility scenarios. The complex channel matrix is treated as an image, and the cGAN is trained against it to generate a more realistic channel image. In addition, the noise2noise (N2N) algorithm is used to denoise the pilot signal received by the base station to improve the estimation quality. Simulation experiments have shown the proposed N2N-cGAN algorithm has better robustness. In particular, the N2N-cGAN algorithm can be adapted to the case of fewer pilot sequences.

Motion Sensor–Based Fall Prevention for Senior Care: A Hidden Markov Model with Generative Adversarial Network Approach

Whereas modern medicine has enabled humans to live longer and more robust lives, recent years have seen a significant increase in chronic care costs. The prevention of threats to mobility is critical for chronic disease management. Researchers and physicians often analyze data from wearable motion sensor–based information systems (IS) to prevent falls. However, prior studies on fall prevention often achieve suboptimal performance because of their limited capacities in modeling data distributions. In this study, we adopt the computational design science paradigm to develop a novel fall prevention framework, which includes the hidden Markov model with generative adversarial network (HMM-GAN) that extracts temporal and sequential patterns from sensor signals and recognizes snippet states and a logistic regression that utilizes the snippet states and determines whether and when to trigger protective devices to prevent fall injuries. We evaluate the proposed framework against prevailing fall-prevention models and the HMM-GAN component against state-of-the-art sensor analytics models on large-scale data sets. Through an in-depth case study, we demonstrate how the proposed framework can lead to significantly reduced potentially catastrophic falls. Besides practical health information technology contributions, HMM-GAN offers methodological contributions to the IS knowledge base for scholars designing novel IT artifacts for healthcare applications.

Conditional Generative Adversarial Network Approach for Autism Prediction

Autism Spectrum Disorder (ASD) requires a precise diagnosis in order to be managed and rehabilitated. Non-invasive neuroimaging methods are disease markers that can be used to help diagnose ASD. The majority of available techniques in the literature use functional magnetic resonance imaging (fMRI) to detect ASD with a small dataset, resulting in high accuracy but low generality. Traditional supervised machine learning classification algorithms such as support vector machines function well with unstructured and semi structured data such as text, images, and videos, but their performance and robustness are restricted by the size of the accompanying training data. Deep learning on the other hand creates an artificial neural network that can learn and make intelligent judgments on its own by layering algorithms. It takes use of plentiful low-cost computing and many approaches are focused with very big datasets that are concerned with creating far larger and more sophisticated neural networks. Generative modelling, also known as Generative Adversarial Networks (GANs), is an unsupervised deep learning task that entails automatically discovering and learning regularities or patterns in input data in order for the model to generate or output new examples that could have been drawn from the original dataset. GANs are an exciting and rapidly changing field that delivers on the promise of generative models in terms of their ability to generate realistic examples across a range of problem domains, most notably in image-to-image translation tasks and hasn't been explored much for Autism spectrum disorder prediction in the past. In this paper, we present a novel conditional generative adversarial network, or cGAN for short, which is a form of GAN that uses a generator model to conditionally generate images. In terms of prediction and accuracy, they outperform the standard GAN. The proposed model is 74% more accurate than the traditional methods and takes only around 10 min for training even with a huge dataset.

Exploiting the Generative Adversarial Network Approach to Create a Synthetic Topography Corneal Image.

Corneal diseases are the most common eye disorders. Deep learning techniques are used to perform automated diagnoses of cornea. Deep learning networks require large-scale annotated datasets, which is conceded as a weakness of deep learning. In this work, a method for synthesizing medical images using conditional generative adversarial networks (CGANs), is presented. It also illustrates how produced medical images may be utilized to enrich medical data, improve clinical decisions, and boost the performance of the conventional neural network (CNN) for medical image diagnosis. The study includes using corneal topography captured using a Pentacam device from patients with corneal diseases. The dataset contained 3448 different corneal images. Furthermore, it shows how an unbalanced dataset affects the performance of classifiers, where the data are balanced using the resampling approach. Finally, the results obtained from CNN networks trained on the balanced dataset are compared to those obtained from CNN networks trained on the imbalanced dataset. For performance, the system estimated the diagnosis accuracy, precision, and F1-score metrics. Lastly, some generated images were shown to an expert for evaluation and to see how well experts could identify the type of image and its condition. The expert recognized the image as useful for medical diagnosis and for determining the severity class according to the shape and values, by generating images based on real cases that could be used as new different stages of illness between healthy and unhealthy patients.

Inverse design of a vanadium dioxide based dynamic structural color via conditional generative adversarial networks

Dynamic structural color provides an additional time dimension in contrast to the static one, enriching the information load and functionalities. As a phase change material, vanadium dioxide offers great opportunities to implement dynamic structural color as its insulator-metal transition. Nevertheless, the multiple states also place a barrier to the efficient design of the structure configurations. This work firstly reports the dynamic structural color inverse design of asymmetric Fabry-Pérot cavity through a parameter-based conditional generative adversarial networks approach. The proposed structure attains a gamut as large as 117% of sRGB in the insulator state and can produce a 5% color coverage variation via the phase change of VO2 layer. By using the trained conditional generative adversarial networks, the inverse design accuracy with the average color difference ΔE of 0.98 is achieved. A monochromatic pattern is designed by the trained networks to demonstrate different color dynamics of the various structures.

Synthetic augmentation for semantic segmentation of class imbalanced biomedical images: A data pair generative adversarial network approach

In recent years, deep learning (DL) has been recognized very useful in the semantic segmentation of biomedical images. Such an application, however, is significantly hindered by the lack of pixel-wise annotations. In this work, we propose a data pair generative adversarial network (DPGAN) for the purpose of synthesizing concurrently the diverse biomedical images and the segmentation labels from random latent vectors. First, a hierarchical structure is constructed consisting of three variational auto-encoder generative adversarial networks (VAEGANs) with an extra discriminator. Subsequently, to alleviate the influence from the imbalance between lesions and non-lesions areas in biomedical segmentation data sets, we divide the DPGAN into three stages, namely, background stage, mask stage and advanced stage, with each stage deploying a VAEGAN. In such a way, a large number of new segmentation data pairs are generated from random latent vectors and then used to augment the original data sets. Finally, to validate the effectiveness of the proposed DPGAN, experiments are carried out on a vestibular schwannoma data set, a kidney tumor data set and a skin cancer data set. The results indicate that, in comparison to other state-of-the-art GAN-based methods, the proposed DPGAN shows better performance in the generative quality, and meanwhile, gains an effective boost on semantic segmentation of class imbalanced biomedical images.