Generative Adversarial Networks Research Articles

Design of A Novel Generative Adversarial Network for Outlier Prediction with AMBO Algorithm

Design of A Novel Generative Adversarial Network for Outlier Prediction with AMBO Algorithm

Effectiveness of generative adversarial networks in denoising medical imaging (CT/MRI images)

Effectiveness of generative adversarial networks in denoising medical imaging (CT/MRI images)

Ejection of Real-Time Malicious Intrusion and Attacks in IoT Empowered Infrastructure

The project recognizes the pervasive threat of computer viruses, malware, and hostile attacks on computer networks, highlighting the critical role of intrusion detection as a proactive defense technology. The project introduces a novel approach based on deep learning to identify and mitigate cybersecurity vulnerabilities and breaches in IoT-driven cyber-physical systems, aiming for enhanced security measures. The project's objective is to elevate intrusion detection beyond the limitations of traditional systems by addressing issues like accuracy, detection effectiveness, and reducing false positives. This emphasizes the advancement and innovation in cybersecurity. To achieve the project's goals, the method employs a generative adversarial network, a cutting-edge deep learning technique. Additionally, it distinguishes itself by contrasting unsupervised and deep learning-based discriminative approaches, showcasing a comprehensive and effective approach to cybersecurity. In our project, we successfully implemented an ensemble method to boost predictive accuracy by integrating multiple individual models. Particularly noteworthy is the inclusion of a hybrid architecture, combining Convolutional Neural Networks (CNN) and Long Short-Term Memory (LSTM), denoted as CNN+LSTM. This hybrid model achieved an impressive accuracy of 99% when applied to the KDD-Cup dataset, underscoring the efficacy of our ensemble technique for intrusion detection in IoT- based cybersecurity infrastructures.

Structural topology optimization based on deep learning

In the mechanical design of structures, traditional topology optimization methods involve numerous finite element iterative analyses, leading to a significant expenditure of computational resources. Therefore, the improved multi-scale gradient generative adversarial networks topology optimization technique is proposed. The topology optimization condition parameters are compressed into a low-dimensional latent space feature representation using the encoder, allowing the model to better extract features from these parameters. To speed up model training, the generator and discriminator networks use lightweight residual convolutional blocks. The hybrid attention mechanism extracts prominent region features from the topology optimization structure map. The model training process is guided by a multi-dimensional fusion loss function to enhance the quality of generated model samples. Finally, transferring the parameters of the low-resolution topology optimization model to the high-resolution model enables complete training on a limited amount of high-resolution topology optimization datasets. The experimental data on the low- and high-resolution topology optimization datasets demonstrate that, when compared to alternative methods, this method produces better-quality topology optimization structure maps. Additionally, it can generate high-resolution topology optimization structure maps in minimal time, enabling real-time topology optimization.

Stone inscription image segmentation based on Stacked-UNets and GANs

To overcome the challenges posed in effectively extracting stone inscriptions characterized by highly self-similarity between the foreground and background, a character image segmentation framework is proposed that integrates Stacked-UNets and Generative Adversarial Networks (GANs). Initially, a convolutional rule tailored for self-similar feature extraction is introduced to enhance the image detail segmentation. Subsequently, in improving the stacked units, multi-scale character masks with Spatial Transformer Network (STN) are added to guide the character segmentation. Finally, with two GANs and datasets, the character recognition and generation capabilities of the Stacked-UNets are trained, and further constructing its character segmentation and restoration abilities. Ultimately, the edge segmentation performance was enhanced, both in extracting characters from stone inscriptions with self-similar blocks and in effectively recovering partially incomplete characters. Compared to state-of-the-art methods, the Stacked-UNets demonstrates improvements of 6.41%, 7.39%, 8.43%, 8.11%, 4.13%, and 2.58% across six indicators, respectively.

GeoGail: A Model-based Imitation Learning Framework for Human Trajectory Synthesizing

Synthesized human trajectories are crucial for a large number of applications. Existing solutions are mainly based on the generative adversarial network (GAN), which is limited due to the lack of modeling the human decision-making process. In this paper, we propose a novel imitation learning based method to synthesize human trajectories. This model utilizes a novel semantics-based interaction mechanism between the decision-making strategy and visitations to diverse geographical locations to model them in the semantic domain in a uniform manner. To augment the modeling ability to the real-world human decision-making policy, we propose a feature extraction model to extract the internal latent factors of variation of different individuals, and then propose a novel self-attention based policy net to capture the long-term correlation of mobility and decision-making patterns. Then, to better reward users’ mobility behavior, we propose a novel multi-scale reward net combined with mutual information to model the instant reward, long-term reward, and individual characteristics in a cohesive manner. Extensive experimental results on two real-world trajectory datasets show that our proposed model can synthesize the most high-quality trajectory data compared with six state-of-the-art baselines in terms of a number of key usability metrics, and can well support practical applications based on trajectory data, demonstrating its effectiveness. Furthermore, our proposed method can learn explainable knowledge automatically from data, including explainable statistical features of trajectories and statistical relation between decision-making policy and features.

TrafficPro: A road speed prediction framework for urban signal-controlled road networks

In view of the problem that traditional deep learning models do not consider the active time-varying characteristics of traffic flow (signal control information) when predicting the speed of urban road networks, and have low prediction accuracy, this paper proposes a speed prediction framework based on generative adversarial networks and graph neural networks. In this framework, the generator network simultaneously encodes the road network traffic flow and signal control information through active and passive prediction modules to generate prediction results, and then uses the discriminator network to improve the generalization of the prediction results. This framework can obtain higher prediction accuracy than traditional time series models and deep learning models. In the real road network speed prediction scenario, this framework can reduce the prediction error compared to the best benchmark model 3%-4%.

Current Status and Challenges and Future Trends of Deep Learning-Based Intrusion Detection Models.

With the advancement of deep learning (DL) technology, DL-based intrusion detection models have emerged as a focal point of research within the domain of cybersecurity. This paper provides an overview of the datasets frequently utilized in the research. This article presents an overview of the widely utilized datasets in the research, establishing a basis for future investigation and analysis. The text subsequently summarizes the prevalent data preprocessing methods and feature engineering techniques utilized in intrusion detection. Following this, it provides a review of seven deep learning-based intrusion detection models, namely, deep autoencoders, deep belief networks, deep neural networks, convolutional neural networks, recurrent neural networks, generative adversarial networks, and transformers. Each model is examined from various dimensions, highlighting their unique architectures and applications within the context of cybersecurity. Furthermore, this paper broadens its scope to include intrusion detection techniques facilitated by the following two large-scale predictive models: the BERT series and the GPT series. These models, leveraging the power of transformers and attention mechanisms, have demonstrated remarkable capabilities in understanding and processing sequential data. In light of these findings, this paper concludes with a prospective outlook on future research directions. Four key areas have been identified for further research. By addressing these issues and advancing research in the aforementioned areas, this paper envisions a future in which DL-based intrusion detection systems are not only more accurate and efficient but also better aligned with the dynamic and evolving landscape of cybersecurity threats.

Toward comprehensive short utterances manipulations detection in videos

AbstractIn a landscape increasingly populated by convincing yet deceptive multimedia content generated through generative adversarial networks, there exists a significant challenge for both human interpretation and machine learning algorithms. This study introduces a shallow learning technique specifically tailored for analyzing visual and auditory components in videos, targeting the lower face region. Our method is optimized for ultra-short video segments (200-600 ms) and employs wavelet scattering transforms for audio and discrete cosine transforms for video. Unlike many approaches, our method excels at these short durations and scales efficiently to longer segments. Experimental results demonstrate high accuracy, achieving 96.83% for 600 ms audio segments and 99.87% for whole video sequences on the FakeAVCeleb and DeepfakeTIMIT datasets. This approach is computationally efficient, making it suitable for real-world applications with constrained resources. The paper also explores the unique challenges of detecting deepfakes in ultra-short sequences and proposes a targeted evaluation strategy for these conditions.

Distributed photovoltaic power forecasting based on personalized federated adversarial learning

Existing distributed photovoltaic (PV) power forecasting methods fail to address the impact of sample scarcity and heterogeneity in PV power data. Moreover, training a single prediction model proves challenging to meet the personalized forecasting needs of different PV stations in distributed environments. This paper proposes a personalized federated generative adversarial network (PFedGAN)-based DPV power forecasting method. Leveraging the federated learning (FL) framework, it achieves collaborative training of prediction models among DPV stations while preserving data privacy. y introducing generative adversarial networks (GAN) and personalized strategy optimization into the FL training process, it alleviates data scarcity issues and reduces the impact of data heterogeneity. A TimesNet-DeepAR (TNE-DeepAR) power prediction model is designed, where the TimesNet module extracts correlations between PV power data from different time periods, and the DeepAR module facilitates PV power prediction, mitigating the effects of meteorological factors' multi-periodic variations on PV power. Experimental results show that the proposed hybrid prediction model reduces the average mean absolute percentage error (MAPE) by 30–40 % compared to single models. The proposed approach reduces the MAPE by 9.79 % compared to traditional methods and by 49.62 % for PV stations with scarce data.

Generative Adversarial Autoencoder Integration Voting Algorithm Based on Mass Spectrometry Data

Mass spectrometry technology is often used in disease prevention and diagnosis and treatment. However, the number of mass spectrometry data features is huge and the features vary greatly between different diseases, making multi-disease diagnosis. The task of judgment is complex and difficult. To address the above problems, this paper proposes a generative adversarial autoencoder integrated voting algorithm msDAGVote based on mass spectrometry data.The generative adversarial network based on dual autoencoders is used as the feature extraction framework of msDAGVote. After inputting mass spectrometry data for training, the generator subnetwork is used for feature extraction.Finally, the constructed features were screened by integrating the voting feature selection algorithm, and the optimal feature subset was used for multi-disease diagnosis.The results were evaluated on mass spectrometry datasets of different disease types. The experimental data showed that the features extracted by msDAGVote outperformed the comparison methods and significantly reduced the classification time.The required number of features and excellent disease classification and diagnosis capabilities are required. The classification AUC exceeds 0.98 on 6 datasets and The set exceeds 0.87.

A fault diagnosis method for bearings and gears in rotating machinery based on data fusion and transfer learning

Abstract Rotating machinery is a crucial component of industrial equipment, and the fault diagnosis of bearings and gears, as vital elements of rotating machinery, is essential since they often fail under harsh working conditions, leading to significant property losses and serious personal safety problems. However, fault data for gears and bearings are often sparse in actual condition, and it is a challenge to ensure the reliability and stability of fault diagnosis results by extracting the features of a single data. To solve the above problems, this paper proposes a fault diagnosis method that combines Transfer Learning and data fusion techniques. Firstly, in this method, two kinds of fault signals are transformed into Gramian Angular Difference Fields and Recurrence Plot. Next, a U-shaped feature fusion dual discriminator generative adversarial network is used to fuse two-dimensional images from multiple sensor data. Its feature fusion module deeply integrates the features of the two images, thereby solving the impact of single data on the reliability and stability of fault diagnosis. Moreover, open-source datasets are used for Transfer Learning training to tackle the small sample problem. Finally, a decision-level information fusion classifier, the Dual-Branch Dempster-Shafer Classifier (DB-DSC), classifies the fused images. This classifier incorporates an improved soft threshold function and D-S evidence theory to achieve adaptive gradient changes and improve the robustness and accuracy of classification results. The experimental results show the effectiveness and stability of the proposed method, and the generated images get high score in several metrics. The average classification accuracy of the classification network reaches 93% and 92.5% on the two datasets, Therefore, the proposed method exhibits strong fault diagnosis capabilities under the small sample conditions of bearings and gears.

An efficient conditional GAN-based framework for high-resolution prediction of tyre-pavement contact stresses – a contribution towards a digital twin of the road system

ABSTRACT The high-resolution prediction of tyre-pavement contact stresses is crucial for advancing pavement design and vehicle safety. A significant knowledge gap exists in accurately and quickly predicting tyre-pavement contact stresses, especially under varying conditions. Addressing this challenge, this study is part of the concerted effort within the project CRC/TRR 339, contributing to the series ‘A Contribution towards a Digital Twin of the Road System’. It aims to bridge this gap by introducing a novel Multimodal Conditional Deep Convolutional Generative Adversarial Network (MC-DCGAN) model for forecasting tyre-pavement contact stresses, offering an efficient and accurate method. The incorporation of a multimodal conditional module within the GAN-based framework allows for controllable outputs tailored to specific tyre types, inflation pressures, and loads. Leveraging the DCGAN architecture significantly enhances prediction accuracy. Experimental validation confirms the method’s high accuracy, strong generalisation capabilities, and a substantial reduction in computational time – nearly two orders of magnitude lower compared to traditional Finite Element simulations. This research not only fills a critical void in the high-precision prediction of tyre-pavement contact stresses, but also holds significant implications for optimising pavement design and enhancing road traffic safety, marking a significant step towards realising a digital twin of the road system.

Batch channel normalized-CWGAN with Swin Transformer for imbalanced data fault diagnosis of rotating machinery

Abstract In real scenarios, rotating machinery is mainly operated in optimal condition, leading to fault data scarce and difficult to collect. This issue results in imbalanced data, significantly limiting the effectiveness of intelligent fault diagnosis methods. To address this issue, a novel fault diagnosis method for rotating machinery is proposed in this paper, which combines the batch channel normalized conditional wasserstein generative adversarial network (BCN-CWGAN) with Swin Transformer. Firstly, the one-dimensional vibration signal is preprocessed into two-dimensional feature images using a symmetrized dot pattern (SDP). Subsequently, self-attention mechanism and deep feature learning module constructed by DenseNet are integrated into the generator of GAN to acquire more discriminative feature information. Meanwhile, the discriminator of GAN is combined with batch channel normalization strategy, which further enhances the generalization ability. Besides, a two time-scale update rule strategy enhances training stability and convergence speed by updating model parameters at different time scales. Then, the data augmentation capability of BCN-CWGAN is used to generate high-quality fault samples to augment the imbalanced dataset. Finally, Swin Transformer is combined to achieve accurate fault diagnosis. The performance enhancement of the proposed method is verified through comparison and diagnosis results of two engineering experiments, demonstrating its substantial value for research in engineering practice. With the proposed data augmentation method, the average accuracy of A1, B1, C1, and D1 datasets in experiment 1 reached 99.24%, 98.85%, 96.78%, and 96.04%, respectively. Meanwhile, the proposed method achieved the best accuracy in experiment 2.

Design of a Capacitive Tactile Sensor Array System for Human-Computer Interaction.

This paper introduces a novel capacitive sensor array designed for tactile perception applications. Utilizing an all-in-one inkjet deposition printing process, the sensor array exhibited exceptional flexibility and accuracy. With a resolution of up to 32.7 dpi, the sensor array was capable of capturing the fine details of touch inputs, making it suitable for applications requiring high spatial resolution. The design incorporates two multiplexers to achieve a scanning rate of 100 Hz, ensuring the rapid and responsive data acquisition that is essential for real-time feedback in interactive applications, such as gesture recognition and haptic interfaces. To evaluate the performance of the capacitive sensor array, an experiment that involved handwritten number recognition was conducted. The results demonstrated that the sensor accurately captured fingertip inputs with a high precision. When combined with an Auxiliary Classifier Generative Adversarial Network (ACGAN) algorithm, the sensor system achieved a recognition accuracy of 98% for various handwritten numbers from "0" to "9". These results show the potential of the capacitive sensor array for advanced human-computer interaction applications.

Traffic data imputation via knowledge graph-enhanced generative adversarial network

Traffic data imputation is crucial for the reliability and efficiency of intelligent transportation systems (ITSs), forming the foundation for downstream tasks like traffic prediction and management. However, existing deep learning-based imputation methods struggle with two significant challenges: poor performance under high missing data rates and the limited incorporation of external traffic-related factors. To address these challenges, we propose a novel knowledge graph-enhanced generative adversarial network (KG-GAN) for traffic data imputation. Our approach uniquely integrates external knowledge with traffic spatiotemporal dependencies to improve data imputation quality. Specifically, we construct a fine-grained knowledge graph (KG) that differentiates attributes and relationships of external factors such as points of interest (POI) and weather conditions, facilitating more robust knowledge representation learning. We then introduce a knowledge-aware embedding cell (EM-cell) that merges traffic data with these learned external representations, providing richer inputs for the spatiotemporal GAN. Extensive experiments on a large-scale real-world traffic dataset demonstrate that KG-GAN significantly outperforms state-of-the-art methods under various missing data scenarios. Additionally, ablation studies confirm the superior performance gained from incorporating external knowledge, underscoring the importance of this approach in addressing complex missing data patterns.

Non-resonant background removal in broadband CARS microscopy using deep-learning algorithms

Broadband Coherent anti-Stokes Raman (BCARS) microscopy is an imaging technique that can acquire full Raman spectra (400–3200 cm−1) of biological samples within a few milliseconds. However, the CARS signal suffers from an undesired non-resonant background (NRB), deriving from four-wave-mixing processes, which distorts the peak line shapes and reduces the chemical contrast. Traditionally, the NRB is removed using numerical algorithms that require expert users and knowledge of the NRB spectral profile. Recently, deep-learning models proved to be powerful tools for unsupervised automation and acceleration of NRB removal. Here, we thoroughly review the existing NRB removal deep-learning models (SpecNet, VECTOR, LSTM, Bi-LSTM) and present two novel architectures. The first one combines convolutional layers with Gated Recurrent Units (CNN + GRU); the second one is a Generative Adversarial Network (GAN) that trains an encoder-decoder network and an adversarial convolutional neural network. We also introduce an improved training dataset, generalized on different BCARS experimental configurations. We compare the performances of all these networks on test and experimental data, using them in the pipeline for spectral unmixing of BCARS images. Our analyses show that CNN + GRU and VECTOR are the networks giving the highest accuracy, GAN is the one that predicts the highest number of true positive peaks in experimental data, whereas GAN and VECTOR are the most suitable ones for real-time processing of BCARS images.

A Novel Electromagnetic Sensing Generative Adversarial Network for Uniaxial Objects

Electromagnetic imaging achieves enhanced resolution by leveraging the advanced sensing and data analysis capabilities of Internet of Things (IoT) systems. This paper introduces a novel learning approach for generative adversarial networks (GANs) to tackle significant challenges in electromagnetic sensing. The proposed method involves deploying additional transmitters and receivers to irradiate TM (transverse magnetic) and TE (transverse electric) polarization waves around uniaxial objects to capture the scattered field in free space. Subsequently, scattered field generative adversarial networks (SF-GANs) are utilized to simulate and learn the characteristics of Maxwell’s equations. Numerical simulations and experimental results demonstrate the superior performance of the SF-GANs compared to backpropagation generative adversarial networks (BP-GANs). Furthermore, it is worth noting that our method is capable of reconstructing high-dielectric-constant objects.

Malware Detection Based on API Call Sequence Analysis: A Gated Recurrent Unit–Generative Adversarial Network Model Approach

Malware remains a major threat to computer systems, with a vast number of new samples being identified and documented regularly. Windows systems are particularly vulnerable to malicious programs like viruses, worms, and trojans. Dynamic analysis, which involves observing malware behavior during execution in a controlled environment, has emerged as a powerful technique for detection. This approach often focuses on analyzing Application Programming Interface (API) calls, which represent the interactions between the malware and the operating system. Recent advances in deep learning have shown promise in improving malware detection accuracy using API call sequence data. However, the potential of Generative Adversarial Networks (GANs) for this purpose remains largely unexplored. This paper proposes a novel hybrid deep learning model combining Gated Recurrent Units (GRUs) and GANs to enhance malware detection based on API call sequences from Windows portable executable files. We evaluate our GRU–GAN model against other approaches like Bidirectional Long Short-Term Memory (BiLSTM) and Bidirectional Gated Recurrent Unit (BiGRU) on multiple datasets. Results demonstrated the superior performance of our hybrid model, achieving 98.9% accuracy on the most challenging dataset. It outperformed existing models in resource utilization, with faster training and testing times and low memory usage.

ACGAN for Addressing the Security Challenges in IoT-Based Healthcare System

The continuous evolution of the IoT paradigm has been extensively applied across various application domains, including air traffic control, education, healthcare, agriculture, transportation, smart home appliances, and others. Our primary focus revolves around exploring the applications of IoT, particularly within healthcare, where it assumes a pivotal role in facilitating secure and real-time remote patient-monitoring systems. This innovation aims to enhance the quality of service and ultimately improve people’s lives. A key component in this ecosystem is the Healthcare Monitoring System (HMS), a technology-based framework designed to continuously monitor and manage patient and healthcare provider data in real time. This system integrates various components, such as software, medical devices, and processes, aimed at improvi1g patient care and supporting healthcare providers in making well-informed decisions. This fosters proactive healthcare management and enables timely interventions when needed. However, data transmission in these systems poses significant security threats during the transfer process, as malicious actors may attempt to breach security protocols.This jeopardizes the integrity of the Internet of Medical Things (IoMT) and ultimately endangers patient safety. Two feature sets—biometric and network flow metric—have been incorporated to enhance detection in healthcare systems. Another major challenge lies in the scarcity of publicly available balanced datasets for analyzing diverse IoMT attack patterns. To address this, the Auxiliary Classifier Generative Adversarial Network (ACGAN) was employed to generate synthetic samples that resemble minority class samples. ACGAN operates with two objectives: the discriminator differentiates between real and synthetic samples while also predicting the correct class labels. This dual functionality ensures that the discriminator learns detailed features for both tasks. Meanwhile, the generator produces high-quality samples that are classified as real by the discriminator and correctly labeled by the auxiliary classifier. The performance of this approach, evaluated using the IoMT dataset, consistently outperforms the existing baseline model across key metrics, including accuracy, precision, recall, F1-score, area under curve (AUC), and confusion matrix results.