Cross-domain Transfer Learning Research Articles

Cardiovascular disease diagnosis using cross-domain transfer learning.

While cardiovascular diseases (CVDs) are commonly diagnosed by cardiologists via inspecting electrocardiogram (ECG) waveforms, these decisions can be supported by a data-driven approach, which may automate this process. An automatic diagnostic approach often employs hand-crafted features extracted from ECG waveforms. These features, however, do not generalise well, challenged by variation in acquisition settings such as sampling rate and mounting points. Existing deep learning (DL) approaches, on the other hand, extract features from ECG automatically but require construction of dedicated networks that require huge data and computational resource if trained from scratch. Here we propose an end-to-end trainable cross-domain transfer learning for CVD classification from ECG waveforms, by utilising existing vision-based CNN frameworks as feature extractors, followed by ECG feature learning layers. Because these frameworks are designed for image inputs, we employ a stacked spectrogram representation of multi-lead ECG waveforms as a preprocessing step. We also proposed a fusion of multiple ECG leads, using plausible stacking arrangements of the spectrograms, to encode their spatial relations. The proposed approach is validated on multiple ECG datasets and competitive performance is achieved.

Assessment of operating performance using cross-domain feature transfer learning

Assessment of operating performance evaluates optimal degree for processes under normal conditions. Maintaining in good operating performance indicates high benefit of the production. To assess the performance for a newly built process with a small number of historical data, a cross-domain feature transfer learning (CDFTL) method is proposed in this research. The assumption that the data from the source and target domains should be independent and identically distributed is no longer necessary. The common and specific features are both utilized to guarantee the assessment precision and model generalization ability. Finally, the proposed method is applied to a copper flotation process.

A framework for semi-supervised metric transfer learning on manifolds

A common assumption of statistical learning theory is that the training and testing data are drawn from the same distribution. However, in many real-world applications, this assumption does not hold true. Hence, a realistic strategy, Cross Domain Adaptation (DA) or Transfer Learning (TA), can be used to employ previously labelled source domain data to boost the task in the new target domain. Previously, Cross Domain Adaptation methods have been focused on re-weighting the instances or aligning the cross-domain distributions. However, these methods have two significant challenges: (1) There is no proper consideration of the unlabelled data of target task as in the real-world, an abundant amount of unlabelled data is available, (2) The use of normal Euclidean distance function fails to capture the appropriate similarity or dissimilarity between samples. To deal with this issue, we have proposed a Semi-Supervised Metric Transfer Learning framework called SSMT that reduces the distribution between domains both statistically and geometrically by learning the instance weights, while a regularized distance metric is learned to minimize the within-class co-variance and maximize the between-class co-variance simultaneously for the target domain. Compared with the previous works where Mahalanobis distance metric and instance weights are learned by using the labelled data or in a pipelined framework that leads to a decrease in the performance, our proposed SSMT attempts to learn a regularized distance metric and instance weights by considering unlabelled data in a parallel framework. Experimental evaluation on three cross-domain visual data sets, e.g., PIE Face, Handwriting Digit Recognition on MNIST–USPS and Object Recognition, demonstrates the effectiveness of our designed approach on facilitating the unlabelled target task learning, compared to current state-of-the-art domain adaptation approaches.

SAR Target Recognition Based on Cross-Domain and Cross-Task Transfer Learning

Inspired by their tremendous success in optical image detection and classification, convolutional neural networks (CNNs) have recently been used in synthetic aperture radar automatic target recognition (SAR-ATR). Although CNN-based methods can achieve excellent recognition performance, it is difficult to collect a large number of real SAR images available for training. In this paper, we introduce simulated SAR data to alleviate the problem of insufficient training data. To address domain shift and task transfer problems caused by differences between simulated and real data, we propose a model that integrates meta-learning and adversarial domain adaptation. We use sufficient simulated data and a few real data to pre-train the model. After fine-tuning, the pre-trained model can quickly adapt to new tasks in real data. Extensive experimental results obtained in the real SAR dataset demonstrate that our model effectively solves the cross-domain and cross-task transfer problem. Compared with conventional SAR-ATR methods, the proposed model can achieve better recognition performance with a small amount of training data.

Cross-domain aspect extraction for sentiment analysis: A transductive learning approach

Aspect-Based Sentiment Analysis (ABSA) is a promising approach to analyze consumer reviews at a high level of detail, where the opinion about each feature of the product or service is considered. ABSA usually explores supervised inductive learning algorithms, which requires intense human effort for the labeling process. In this paper, we investigate Cross-Domain Transfer Learning approaches, in which aspects already labeled in some domains can be used to support the aspect extraction of another domain where there are no labeled aspects. Existing cross-domain transfer learning approaches learn classifiers from labeled aspects in the source domain and then apply these classifiers in the target domain, i.e., two separate stages that may cause inconsistency due to different feature spaces. To overcome this drawback, we present an innovative approach called CD-ALPHN (Cross-Domain Aspect Label Propagation through Heterogeneous Networks). First, we propose a heterogeneous network-based representation that combines different features (labeled aspects, unlabeled aspects, and linguistic features) from source and target domain as nodes in a single network. Second, we propose a label propagation algorithm for aspect extraction from heterogeneous networks, where the linguistic features are used as a bridge for this propagation. Our algorithm is based on a transductive learning process, where we explore both labeled and unlabeled aspects during the label propagation. Experimental results show that the CD-ALPHN outperforms the state-of-the-art methods in scenarios where there is a high-level of inconsistency between the source and target domains — the most common scenario in real-world applications.

View-invariant gait recognition method by three-dimensional convolutional neural network

Gait as an important biometric feature can identify a human at a long distance. View change is one of the most challenging factors for gait recognition. To address the cross view issues in gait recognition, we propose a view-invariant gait recognition method by three-dimensional (3-D) convolutional neural network. First, 3-D convolutional neural network (3DCNN) is introduced to learn view-invariant feature, which can capture the spatial information and temporal information simultaneously on normalized silhouette sequences. Second, a network training method based on cross-domain transfer learning is proposed to solve the problem of the limited gait training samples. We choose the C3D as the basic model, which is pretrained on the Sports-1M and then fine-tune C3D model to adapt gait recognition. In the recognition stage, we use the fine-tuned model to extract gait features and use Euclidean distance to measure the similarity of gait sequences. Sufficient experiments are carried out on the CASIA-B dataset and the experimental results demonstrate that our method outperforms many other methods.

Using Deep Convolutional Neural Networks to Develop the Next Generation of Sensors for Interpreting Real World EEG Signals Part 2: Developing Sensors for Vigilance Detection

Using Deep Convolutional Neural Networks to Develop the Next Generation of Sensors for Interpreting Real World EEG Signals Part 2: Developing Sensors for Vigilance Detection

Web Multimedia Object Classification Using Cross-Domain Correlation Knowledge

Given a collection of web images with the corresponding textual descriptions, in this paper, we propose a novel cross-domain learning method to classify these web multimedia objects by transferring the correlation knowledge among different information sources. Here, the knowledge is extracted from unlabeled objects through unsupervised learning and applied to perform supervised classification tasks. To mine more meaningful correlation knowledge, instead of using commonly used visual words in the traditional bag-of-visual-words (BoW) model, we discover higher level visual components (words and phrases) to incorporate the spatial and semantic information into our image representation model, i.e., bag-of-visual-phrases (BoP). By combining the enriched visual components with the textual words, we calculate the frequently co-occurring pairs among them to construct a cross-domain correlated graph in which the correlation knowledge is mined. After that, we investigate two different strategies to apply such knowledge to enrich the feature space where the supervised classification is performed. By transferring such knowledge, our cross-domain transfer learning method can not only handle large scale web multimedia objects, but also deal with the situation that the textual descriptions of a small portion of web images are missing. Empirical experiments on two different datasets of web multimedia objects are conducted to demonstrate the efficacy and effectiveness of our proposed cross-domain transfer learning method.

Sentiment Analysis of Product Reviews by means of Cross-domain Transfer Learning

Sentiment Analysis of Product Reviews by means of Cross-domain Transfer Learning