Domain Adversarial Network Research Articles

Multi-source soft sensor model for industrial processes based on Graph Convolution and Dual-constraint Adversarial Domain Generalization

Abstract To address the issue of poor generalization performance of soft sensor models owing to multimode characteristics within process data and insufficient labeling, this paper proposes a Multi-Source Graph Convolution and Dual Constraint Adversarial Domain Generalization (MSGCN-DADG) soft sensor model. Multimode data constitute multiple source domains, and treat the process variable in the source domain as a node in the diagram structure. By updating the graph convolution network with self-loops and adjacency information of nodes, multi-source domain features are obtained. Domain adversarial networks are employed to align these features, generating domain-invariant features common to all source domains. The proposed method improves the domain adversarial loss function with a dual constraint regularization using Maximum Mean Discrepancy (MMD) to reduce the differences among source domain features and between the source domains and the prior distribution. A fully connected layer is used to establish a model between domain-invariant features and source domain labels, and this model is generalized to the target domain through domain generalization. The proposed model is validated on two real industrial processes, Multiphase Flow Process (MFP) and Thermal Power Plant (TPP) are compared with several domain adaptation and domain generalization methods. Experimental results verify that the proposed method exhibits better prediction accuracy and generalization ability.

A Domain Adaptive Interpretable Substructure-Aware Graph Attention Network for Drug-Drug Interaction Prediction.

Accurate prediction of drug-drug interaction (DDI) is essential to improve clinical efficacy, avoid adverse effects of drug combination therapy, and enhance drug safety. Recently researchers have developed several computer-aided methods for DDI prediction. However, these methods lack the substructural features that are critical to drug interactions and are not effective in generalizing across domains and different distribution data. In this work, we present SAGAN, a domain adaptive interpretable substructure-aware graph attention network for DDI prediction. Based on attention mechanism and unsupervised clustering algorithm, we propose a new substructure segmentation method, which segments the drug molecule into multiple substructures, learns the mechanism of drug interaction from the perspective of interaction, and identifies important interaction regions between drugs. To enhance the generalization ability of the model, we improve and apply a conditional domain adversarial network to achieve cross-domain generalization by alternately optimizing the cross-entropy loss on the source domain and the adversarial loss of the domain discriminator. We evaluate and compare SAGAN with the state-of-the-art DDI prediction model on four real-world datasets for both in-domain and cross-domain scenarios, and show that SAGAN achieves the best overall performance. Moreover, the visualization results of the model show that SAGAN has achieved pharmacologically significant substructure extraction, which can help drug developers screen for some undiscovered local interaction sites, and provide important information for further drug structure optimization. The codes and datasets are available online at https://github.com/wyx2012/SAGAN .

An Adaptive Multimodal Fusion 3D Object Detection Algorithm for Unmanned Systems in Adverse Weather

Unmanned systems encounter challenging weather conditions during obstacle removal tasks. Researching stable, real-time, and accurate environmental perception methods under such conditions is crucial. Cameras and LiDAR sensors provide different and complementary data. However, the integration of disparate data presents challenges such as feature mismatches and the fusion of sparse and dense information, which can degrade algorithmic performance. Adverse weather conditions, like rain and snow, introduce noise that further reduces perception accuracy. To address these issues, we propose a novel weather-adaptive bird’s-eye view multi-level co-attention fusion 3D object detection algorithm (BEV-MCAF). This algorithm employs an improved feature extraction network to obtain more effective features. A multimodal feature fusion module has been constructed with BEV image feature generation and a co-attention mechanism for better fusion effects. A multi-scale multimodal joint domain adversarial network (M2-DANet) is proposed to enhance adaptability to adverse weather conditions. The efficacy of BEV-MCAF has been validated on both the nuScenes and Ithaca365 datasets, confirming its robustness and good generalization capability in a variety of bad weather conditions. The findings indicate that our proposed algorithm performs better than the benchmark, showing improved adaptability to harsh weather conditions and enhancing the robustness of UVs, ensuring reliable perception under challenging conditions.

Enhanced cross-domain lithology classification in imbalanced datasets using an unsupervised domain Adversarial Network

Recent advancements in Artificial Intelligence (AI), particularly deep learning, have significantly improved lithology identification in reservoir exploration by leveraging micrographic rock imagery. Deep neural networks excel in feature extraction, enhancing classification accuracy. However, these models are prone to domain shifts, which often degrade their performance in real-world applications. This paper proposes an unsupervised domain adaptation framework that integrates Fisher linear discriminant analysis and Online Hard Example Mining (OHEM) to mitigate domain shifts and improve classification, particularly in datasets with imbalanced classes. The model employs a ω-balanced global–local domain discriminator to align feature distributions between different domains and introduces focal loss with class-wise weighted factors for better handling of imbalanced data. Additionally, an adapted version of OHEM identifies difficult samples during training, allowing the model to concentrate on challenging cases. The proposed method is validated on micrographic rock imagery from the Tibet, Qinghai, and Xinjiang regions, achieving an average accuracy of 83.2%, which is 13.8% higher than ResNet50 and at least 1% superior to other domain adaptation models. This research highlights the potential of AI-driven solutions in geoscientific applications and provides a robust framework for unsupervised lithology classification.

A meta transfer learning-driven few-shot fault diagnosis method for combine harvester gearboxes

Combine harvester gearboxes operate for extended periods under variable operating conditions, making it costly to gather sufficient fault data. A meta transfer learning-driven fault diagnosis method for combine harvester gearboxes is proposed to solve the complex operating conditions and scarce fault samples. The meta learning is employed to train the model so that the performance of the proposed method is not contingent upon the quantity of training data. The multi-step loss optimization (MSL) method is introduced to improve the inner loop and address the unstable update gradients in training. The enhanced method uses each task to refine the model updating strategy, thus circumventing the gradient explosion and decay. The proposed method employs conditional domain adversarial network to extract deep discriminative features from both domains. The batch feature constraint (BFC) is proposed to balance the features’ transferability and class discriminability. A weight-balancing strategy is employed to reconstruct the training loss function, enabling gearbox fault diagnosis under variable operating conditions with few-shot data. The effectiveness of the proposed method is validated through data collected from the combined harvester gearbox’s fault diagnosis experimental rig.

A Collaborative Domain Adversarial Network for Unlabeled Bearing Fault Diagnosis

At present, data-driven fault diagnosis has made significant achievements. However, in actual industrial environments, labeled fault data are difficult to obtain, making the industrial application of intelligent fault diagnosis models very challenging. This limitation even prevents intelligent fault diagnosis algorithms from being applicable in real-world industrial settings. In light of this, this paper proposes a Collaborative Domain Adversarial Network (CDAN) method for the fault diagnosis of rolling bearings using unlabeled data. First, two types of feature extractors are employed to extract features from both the source and target domain samples, reducing signal redundancy and avoiding the loss of critical signal features. Second, the multi-kernel clustering algorithm is used to compute the differences in input feature values, create pseudo-labels for the target domain samples, and update the CDAN network parameters through backpropagation, enabling the network to extract domain-invariant features. Finally, to ensure that unlabeled target domain data can participate in network training, a pseudo-label strategy using the maximum probability label as the true label is employed, addressing the issue of unlabeled target domain data not being trainable and enhancing the model’s ability to acquire reliable diagnostic knowledge. This paper validates the CDAN using two publicly available datasets, CWRU and PU. Compared with four other advanced methods, the CDAN method improved the average recognition accuracy by 7.85% and 5.22%, respectively. This indirectly proves the effectiveness and superiority of the CDAN in identifying unlabeled bearing faults.

Towards Discriminative Class-Aware Domain Alignment via Coding Rate Reduction for Unsupervised Adversarial Domain Adaptation

Unsupervised domain adaptation (UDA) methods, based on adversarial learning, employ the means of implicit global and class-aware domain alignment to learn the symmetry between source and target domains and facilitate the transfer of knowledge from a labeled source domain to an unlabeled target domain. However, these methods still face misalignment and poor target generalization due to small inter-class domain discrepancy and large intra-class discrepancy of target features. To tackle these challenges, we introduce a novel adversarial learning-based UDA framework named Coding Rate Reduction Adversarial Domain Adaptation (CR2ADA) to better learn the symmetry between source and target domains. Integrating conditional domain adversarial networks with domain-specific batch normalization, CR2ADA learns robust domain-invariant features to implement global domain alignment. For discriminative class-aware domain alignment, we propose the global and local coding rate reduction methods in CR2ADA to maximize inter-class domain discrepancy and minimize intra-class discrepancy of target features. Additionally, CR2ADA combines minimum class confusion and mutual information to further regularize the diversity and discriminability of the learned features. The effectiveness of CR2ADA is demonstrated through experiments on four UDA datasets. The code can be obtained through email or GitHub.

Advanced Multi-Label Fire Scene Image Classification via BiFormer, Domain-Adversarial Network and GCN

Detecting wildfires presents significant challenges due to the presence of various potential targets in fire imagery, such as smoke, vehicles, and people. To address these challenges, we propose a novel multi-label classification model based on BiFormer’s feature extraction method, which constructs sparse region-indexing relations and performs feature extraction only in key regions, thereby facilitating more effective capture of flame characteristics. Additionally, we introduce a feature screening method based on a domain-adversarial neural network (DANN) to minimize misclassification by accurately determining feature domains. Furthermore, a feature discrimination method utilizing a Graph Convolutional Network (GCN) is proposed, enabling the model to capture label correlations more effectively and improve performance by constructing a label correlation matrix. This model enhances cross-domain generalization capability and improves recognition performance in fire scenarios. In the experimental phase, we developed a comprehensive dataset by integrating multiple fire-related public datasets, and conducted detailed comparison and ablation experiments. Results from the tenfold cross-validation demonstrate that the proposed model significantly improves recognition of multi-labeled images in fire scenarios. Compared with the baseline model, the mAP increased by 4.426%, CP by 4.14% and CF1 by 7.04%.

A Cross-Working Condition-Bearing Diagnosis Method Based on Image Fusion and a Residual Network Incorporating the Kolmogorov–Arnold Representation Theorem

With the optimization and advancement of industrial production and manufacturing, the application scenarios of bearings have become increasingly diverse and highly coupled. This complexity poses significant challenges for the extraction of bearing fault features, consequently affecting the accuracy of cross-condition fault diagnosis methods. To improve the extraction and recognition of fault features and enhance the diagnostic accuracy of models across different conditions, this paper proposes a cross-condition bearing diagnosis method. This method, named MCR-KAResNet-TLDAF, is based on image fusion and a residual network that incorporates the Kolmogorov–Arnold representation theorem. Firstly, the one-dimensional vibration signals of the bearing are processed using Markov transition field (MTF), continuous wavelet transform (CWT), and recurrence plot (RP) methods, converting the resulting images to grayscale. These grayscale images are then multiplied by corresponding coefficients and fed into the R, G, and B channels for image fusion. Subsequently, fault features are extracted using a residual network enhanced by the Kolmogorov–Arnold representation theorem. Additionally, a domain adaptation algorithm combining multiple kernel maximum mean discrepancy (MK-MMD ) and conditional domain adversarial network with entropy conditioning (CDAN+E ) is employed to align the source and target domains, thereby enhancing the model’s cross-condition diagnostic accuracy. The proposed method was experimentally validated on the Case Western Reserve University (CWRU) dataset and the Jiangnan University (JUN) dataset, which include the 6205-2RS JEM SKF, N205, and NU205 bearing models. The method achieved accuracy rates of 99.36% and 99.889% on the two datasets, respectively. Comparative experiments from various perspectives further confirm the superiority and effectiveness of the proposed model.

Single-Lead ECG Cross-Session Identification Based on Conditional Domain Adversarial Network

Single-Lead ECG Cross-Session Identification Based on Conditional Domain Adversarial Network

Failure Mechanism Information-Assisted Multi-Domain Adversarial Transfer Fault Diagnosis Model for Rolling Bearings under Variable Operating Conditions

Deep transfer learning tackles the challenge of fault diagnosis in rolling bearings across variable operating conditions, which is pivotal for intelligent bearing health management. Traditional transfer learning may not be able to adapt to the specific characteristics of the target domain, especially in the case of variable working conditions or lack of annotated data for the target domain. This may lead to unstable training results or negative transfer of the neural network. This paper proposes a new method for enhancing unsupervised domain adaptation in bearing fault diagnosis, aimed at providing robust fault diagnosis for rolling bearings under varying operating conditions. It incorporates bearing fault finite element simulation data into the domain adversarial network, guiding adversarial training using fault evolution mechanisms. The algorithm establishes global and subdomain classifiers, with simulation signals replacing label predictions for target data in the subdomain, ensuring minimal information transfer. By reconstructing the loss function, we can extract the common features of the same type bearing under different conditions and enhance the domain antagonism robustness. The proposed method is validated using two sets of testbed data as target domains. The results demonstrate that the method can adequately adapt the deep feature distributions of the model and experimental domains, thereby improving the accuracy of fault diagnosis in unsupervised cross-domain scenarios.

An improved method for rapid un-collapsed building extraction from post-disaster high-resolution remote sensing imagery based on multi-scale feature alignment

ABSTRACT Quick and accurate extraction of un-collapsed buildings from post-disaster High-resolution Remote Sensing Images (HRSIs) is imperative for emergency response. Pre-disaster HRSIs could serve as auxiliary data for training models to expedite this extraction process. However, the effectiveness of models trained directly on pre-disaster HRSIs tends to diminish when applied to post-disaster scenarios, mainly due to the notable discrepancies between these datasets. The current popular approach to mitigate this issue involves aligning features from pre- and post-disaster images using an unsupervised domain adversarial learning framework. However, conventional methods often fall short in reducing the substantial disparity between pre- and post-disaster images, due to a lack of comprehensive alignment of category-level and multi-scale features. To overcome these limitations, we propose the Multi-scale Global and Category-attention Features Alignment Network (MGCAN). This novel approach further refines feature alignment strategies by concurrently aligning both multi-scale global and category-attention features, thus effectively narrowing the gap between pre- and post-disaster HRSIs. Extensive experiments have demonstrated that MGCAN significantly improves the accuracy of un-collapsed building extraction from post-disaster HRSIs. Moreover, compared to other state-of-the-art domain adversarial networks, MGCAN exhibits superior performance in different disaster scenarios.

Bearing fault diagnosis using Gradual Conditional Domain Adversarial Network

Given the limited availability of accurately labeled data in fault diagnosis across various industrial scenarios, we proposed a Gradual Conditional Domain Adversarial Network (GCDAN) incorporating various fault categories and rotating speeds. We constructed a prototype system for collecting three-dimensional vibration data samples and modified the network structure to accommodate the input. Inspired by the generalization capability of cross-device scenarios, we adopted CDAN as the main component. To overcome the performance degradation caused by the source and target domains with substantial distribution differences, we introduced Gradual Domain Adaptation into our algorithm. Unlabeled data samples obtained from the intermediate domains were used to train a sequence of CDANs. Experimental comparison results confirmed the effectiveness of the 3-D input data and its network alteration. Additionally, GCDAN performed better over challenging transfer tasks compared to the existing state-of-art algorithms in terms of prediction accuracy and multi-class classification metrics.

An adversarial transfer learning method based on domain distribution prediction for aero-engine fault diagnosis

The utilization of transfer learning enables effective realization of the transferability of aero-engine fault diagnosis models across disparate states. However, the gradual degradation of engine performance and the complex and variable flight states lead to continuous changes in data distribution. The common transfer learning methods employ discrete divisions of data domain distributions, which are insufficient to cope with the continuous changes of the domain. To accomplish transfer learning towards a continuous and multi-dimensional target domain, we propose a continuous domain distribution adversarial network (CDDAN) based on deep domain adversarial network. The method defines the number of effective cycles directly associated with engine degradation as a continuous domain index. When the domain index is extended to multiple dimensions, a hybrid gaussian model is introduced to represent distribution prediction within multi-dimensional continuous domains. Subsequently, we validate the feasibility and superiority of our method using datasets generated based on twin-spool turbofan engines. In comparison to other transfer learning methods, the proposed method achieves superior effect in continuous domain adaptation. The experimental results demonstrate that this method exhibits adaptability to failures in the diagnosis method caused by performance degradation and changes in flight state of the aero engine, while remaining independent of target domain data annotation. This advantage becomes particularly apparent in scenarios with limited target domain data and multi-state fault diagnosis.

CAT-DTI: cross-attention and Transformer network with domain adaptation for drug-target interaction prediction

Accurate and efficient prediction of drug-target interaction (DTI) is critical to advance drug development and reduce the cost of drug discovery. Recently, the employment of deep learning methods has enhanced DTI prediction precision and efficacy, but it still encounters several challenges. The first challenge lies in the efficient learning of drug and protein feature representations alongside their interaction features to enhance DTI prediction. Another important challenge is to improve the generalization capability of the DTI model within real-world scenarios. To address these challenges, we propose CAT-DTI, a model based on cross-attention and Transformer, possessing domain adaptation capability. CAT-DTI effectively captures the drug-target interactions while adapting to out-of-distribution data. Specifically, we use a convolution neural network combined with a Transformer to encode the distance relationship between amino acids within protein sequences and employ a cross-attention module to capture the drug-target interaction features. Generalization to new DTI prediction scenarios is achieved by leveraging a conditional domain adversarial network, aligning DTI representations under diverse distributions. Experimental results within in-domain and cross-domain scenarios demonstrate that CAT-DTI model overall improves DTI prediction performance compared with previous methods.

A gradient aligned domain adversarial network for unsupervised intelligent fault diagnosis of gearboxes

Unsupervised domain adaptation alleviates the dependencies of conventional fault diagnosis methods on sufficient labeled data and strict data distributions. Nonetheless, the current domain adaptation methods only concentrate on the data distributions and ignore the feature gradient distributions, leading to some samples being misclassified due to large gradient discrepancies, thus affecting diagnosis performance. In this paper, a gradient aligned domain adversarial network (GADAN) is proposed. First, the discrepancies of the marginal and conditional distribution between the source and target domain are reduced by minimizing the joint maximum mean discrepancy. Then, a pseudo-labeling approach based on a clustering self-supervised strategy is utilized to attain high-quality pseudo-labels of target domains, and most importantly in the dimension of the data gradient, the feature gradient distributions are aligned by adversarial learning to further reduce the domain shift, even if the distributions of the two domains are close enough. Finally, experiments and engineering applications demonstrate the effectiveness and superiority of GADAN for transfer diagnosis between various working conditions or different machines.

A multi-representation transfer adversarial network for intelligent fault diagnosis of rotating machinery

Fault diagnosis of rolling bearings is among the most crucial links in the prognostic and health management of bearings. To solve the problem that cross-domain fault diagnosis cannot be performed due to the distribution differences between different working conditions, a transfer diagnosis method based on multi-representation adversarial neural network is proposed. First, the multi-representation neural network is applied to extract multiscale features. Second, the domain adversarial network is utilized to set the gradient inversion layer and extract the domain invariant features in the multiscale features. In terms of the loss function, the Wasserstein function and cross-entropy loss function are utilized to measure the distance between the source domain and the target domain. The experimental case of rolling bearing supports the effectiveness and superiority of the proposed method.

Electronic Nose Drift Suppression Based on Smooth Conditional Domain Adversarial Networks.

Anti-drift is a new and serious challenge in the field related to gas sensors. Gas sensor drift causes the probability distribution of the measured data to be inconsistent with the probability distribution of the calibrated data, which leads to the failure of the original classification algorithm. In order to make the probability distributions of the drifted data and the regular data consistent, we introduce the Conditional Adversarial Domain Adaptation Network (CDAN)+ Sharpness Aware Minimization (SAM) optimizer-a state-of-the-art deep transfer learning method.The core approach involves the construction of feature extractors and domain discriminators designed to extract shared features from both drift and clean data. These extracted features are subsequently input into a classifier, thereby amplifying the overall model's generalization capabilities. The method boasts three key advantages: (1) Implementation of semi-supervised learning, thereby negating the necessity for labels on drift data. (2) Unlike conventional deep transfer learning methods such as the Domain-adversarial Neural Network (DANN) and Wasserstein Domain-adversarial Neural Network (WDANN), it accommodates inter-class correlations. (3) It exhibits enhanced ease of training and convergence compared to traditional deep transfer learning networks. Through rigorous experimentation on two publicly available datasets, we substantiate the efficiency and effectiveness of our proposed anti-drift methodology when juxtaposed with state-of-the-art techniques.

Efficient Near-Infrared Spectrum Detection in Nondestructive Wood Testing via Transfer Network Redesign.

This study systematically developed a deep transfer network for near-infrared spectrum detection using convolutional neural network modules as key components. Through meticulous evaluation, specific modules and structures suitable for constructing the near-infrared spectrum detection model were identified, ensuring its effectiveness. This study extensively analyzed the basic network components and explored three unsupervised domain adaptation structures, highlighting their applications in the nondestructive testing of wood. Additionally, five transfer networks were strategically redesigned to substantially enhance their performance. The experimental results showed that the Conditional Domain Adversarial Network and Globalized Loss Optimization Transfer network outperformed the Direct Standardization, Piecewise Direct Standardization, and Spectral Space Transformation models. The coefficients of determination for the Conditional Domain Adversarial Network and Globalized Loss Optimization Transfer network are 82.11% and 83.59%, respectively, with root mean square error prediction values of 12.237 and 11.582, respectively. These achievements represent considerable advancements toward the practical implementation of an efficient and reliable near-infrared spectrum detection system using a deep transfer network.

Improved Conditional Domain Adversarial Networks for Intelligent Transfer Fault Diagnosis

Intelligent fault diagnosis encounters the challenges of varying working conditions and sample class imbalance individually, but very few approaches address both challenges simultaneously. This article proposes an improvement network model named ICDAN-F, which can deal with fault diagnosis scenarios with class imbalance and working condition variations in an integrated way. First, Focal Loss, which was originally designed for target detection, is introduced to alleviate the sample class imbalance problem of fault diagnosis and emphasize the key features. Second, the domain discriminator is improved by the default ReLU activation function being replaced with Tanh so that useful negative value information can help extract transferable fault features. Extensive transfer experiments dealing with varying working conditions are conducted on two bearing fault datasets with the effect of class imbalance. The results show that the fault diagnosis performance of ICDAN-F outperforms several other widely used domain adaptation methods, achieving 99.76% and 96.76% fault diagnosis accuracies in Case 1 and Case 2, respectively, which predicts that ICDAN-F can handle both challenges in a cohesive manner.