Deep Manifold Research Articles

A deep feature manifold embedding method for hyperspectral image classification

ABSTRACT In this letter, we proposed a novel deep feature manifold embedding method to improve feature extraction ability of traditional deep learning methods. This method first obtains deep features of hyperspectral image (HSI) from a trained autoencoder. Then, an intrinsic graph and a penalty graph are constructed to discover the discriminant manifold structure of deep features. Finally, the deep features are mapped into a low-dimensional embedding space, in which samples in intraclass manifold are compacted and samples from interclass manifolds are separated. Experiments on Pavia University, Indian Pines and Urban datasets demonstrate that the proposed method effectively improves the classification performance of HSI compared with other state-of-the-art approaches.

DLPNet: A deep manifold network for feature extraction of hyperspectral imagery

Deep learning has received increasing attention in recent years and it has been successfully applied for feature extraction (FE) of hyperspectral images. However, most deep learning methods fail to explore the manifold structure in hyperspectral image (HSI). To tackle this issue, a novel graph-based deep learning model, termed deep locality preserving neural network (DLPNet), was proposed in this paper. Traditional deep learning methods use random initialization to initialize network parameters. Different from that, DLPNet initializes each layer of the network by exploring the manifold structure in hyperspectral data. In the stage of network optimization, it designed a deep-manifold learning joint loss function to exploit graph embedding process while measuring the difference between the predictive value and the actual value, then the proposed model can take into account the extraction of deep features and explore the manifold structure of data simultaneously. Experimental results on real-world HSI datasets indicate that the proposed DLPNet performs significantly better than some state-of-the-art methods.

DYNAMIC MRI USING DEEP MANIFOLD SELF-LEARNING.

We propose a deep self-learning algorithm to learn the manifold structure of free-breathing and ungated cardiac data and to recover the cardiac CINE MRI from highly undersampled measurements. Our method learns the manifold structure in the dynamic data from navigators using autoencoder network. The trained autoencoder is then used as a prior in the image reconstruction framework. We have tested the proposed method on free-breathing and ungated cardiac CINE data, which is acquired using a navigated golden-angle gradient-echo radial sequence. Results show the ability of our method to better capture the manifold structure, thus providing us reduced spatial and temporal blurring as compared to the SToRM reconstruction.

Transfer learning with deep manifold regularized auto-encoders

The excellent performance of transfer learning has emerged in the past few years. How to find feature representations which minimize the distance between source and target domains is a crucial problem in transfer learning. Recently, deep learning methods have been proposed to learn higher level and robust representations. However, in traditional methods, label information in source domain is not designed to optimize both feature representations and parameters of the learning model. Additionally, the redundancy of data may incur performance degradation on transfer learning. To address these problems, we propose a novel semi-supervised representation deep learning framework for transfer learning. To obtain this framework, manifold regularization is integrated for the parameter optimization, and the label information is encoded using a softmax regression model in auto-encoders. Meanwhile, whitening layer is introduced to reduce the redundancy of data before auto-encoders. Extensive experiments demonstrate the effectiveness of our proposed framework compared to other competing state-of-the-art baseline methods.

Deep Manifold Structure Transfer for Action Recognition.

While intrinsic data structure in subspace provides useful information for visual recognition, it has not yet been well studied in deep feature learning for action recognition. In this paper, we introduce a new spatio-temporal manifold network (STMN) that leverages data manifold structures to regularize deep action feature learning, aiming at simultaneously minimizing the intra-class variations of learned deep features and alleviating the over-fitting problem. To this end, the manifold prior is imposed from the top layer of a convolutional neural network (CNN), and is propagated across convolutional layers during forward-backward propagation. The observed correspondence of manifold structures in the data space and feature space validates that the manifold priori can be transferred across CNN layers. STMN theoretically recasts the problem of transferring the data structure prior into the deep learning architectures as a projection over the manifold via an embedding method, which can be easily solved by an Alternating Direction Method of Multipliers and Backward Propagation (ADMM-BP) algorithm. STMN is generic in the sense that it can be plugged into various backbone architectures to learn more discriminative representation for action recognition. Extensive experimental results show that our method achieves comparable or even better performance as compared with the state-of-the-art approaches on four benchmark datasets.

Blended Emotion in-the-Wild: Multi-label Facial Expression Recognition Using Crowdsourced Annotations and Deep Locality Feature Learning

Comprehending different categories of facial expressions plays a great role in the design of computational model analyzing human perceived and affective state. Authoritative studies have revealed that facial expressions in human daily life are in multiple or co-occurring mental states. However, due to the lack of valid datasets, most previous studies are still restricted to basic emotions with single label. In this paper, we present a novel multi-label facial expression database, RAF-ML, along with a new deep learning algorithm, to address this problem. Specifically, a crowdsourcing annotation of 1.2 million labels from 315 participants was implemented to identify the multi-label expressions collected from social network, then EM algorithm was designed to filter out unreliable labels. For all we know, RAF-ML is the first database in the wild that provides with crowdsourced cognition for multi-label expressions. Focusing on the ambiguity and continuity of blended expressions, we propose a new deep manifold learning network, called Deep Bi-Manifold CNN, to learn the discriminative feature for multi-label expressions by jointly preserving the local affinity of deep features and the manifold structures of emotion labels. Furthermore, a deep domain adaption method is leveraged to extend the deep manifold features learned from RAF-ML to other expression databases under various imaging conditions and cultures. Extensive experiments on the RAF-ML and other diverse databases (JAFFE, CK$$+$$+, SFEW and MMI) show that the deep manifold feature is not only superior in multi-label expression recognition in the wild, but also captures the elemental and generic components that are effective for a wide range of expression recognition tasks.

A deep manifold learning approach for spatial-spectral classification with limited labeled training samples

One major challenge of designing deep learning systems for hyperspectral data classification is the lack of labeled training samples. Inspired by recent manifold learning researches, this paper presents a novel Locality Preserving Convolutional Network to address this challenge. The proposed method invents a semi-supervised locality-preserving regularization operation, and inserts a new layer in the three-dimensional convolutional neural network for end-to-end spatial-spectral classification. The benefits are three-fold. First, by using unlabeled training samples which are more easily available, the proposed method reduces the number of labeled samples required for training a deep learning model; Second, the proposed method incorporates the intrinsic geographical correlation among nearby samples into the extracted features, which prevents it from losing accuracy when only limited labeled samples are available; Third, with a three-dimensional architecture, the proposed method can extract the spatial and spectral features simultaneously from the hyperspectral data for classification. A gradient-decent based approach is deployed to train the whole network in a unified way. Experiments over different benchmarks show that, the proposed method relieves the Hughes phenomenon for deep learning, and achieves competitively high classification accuracy compared to other state-of-the-art approaches.

Deep Manifold Preserving Autoencoder for Classifying Breast Cancer Histopathological Images.

Classifying breast cancer histopathological images automatically is an important task in computer assisted pathology analysis. However, extracting informative and non-redundant features for histopathological image classification is challenging due to the appearance variability caused by the heterogeneity of the disease, the tissue preparation, and staining processes. In this paper, we propose a new feature extractor, called deep manifold preserving autoencoder, to learn discriminative features from unlabeled data. Then, we integrate the proposed feature extractor with a softmax classifier to classify breast cancer histopathology images. Specifically, it learns hierarchal features from unlabeled image patches by minimizing the distance between its input and output, and simultaneously preserving the geometric structure of the whole input data set. After the unsupervised training, we connect the encoder layers of the trained deep manifold preserving autoencoder with a softmax classifier to construct a cascade model and fine-tune this deep neural network with labeled training data. The proposed method learns discriminative features by preserving the structure of the input datasets from the manifold learning view and minimizing reconstruction error from the deep learning view from a large amount of unlabeled data. Extensive experiments on the public breast cancer dataset (BreaKHis) demonstrate the effectiveness of the proposed method.

Deep Manifold Learning Combined With Convolutional Neural Networks for Action Recognition.

Learning deep representations have been applied in action recognition widely. However, there have been a few investigations on how to utilize the structural manifold information among different action videos to enhance the recognition accuracy and efficiency. In this paper, we propose to incorporate the manifold of training samples into deep learning, which is defined as deep manifold learning (DML). The proposed DML framework can be adapted to most existing deep networks to learn more discriminative features for action recognition. When applied to a convolutional neural network, DML embeds the previous convolutional layer's manifold into the next convolutional layer; thus, the discriminative capacity of the next layer can be promoted. We also apply the DML on a restricted Boltzmann machine, which can alleviate the overfitting problem. Experimental results on four standard action databases (i.e., UCF101, HMDB51, KTH, and UCF sports) show that the proposed method outperforms the state-of-the-art methods.

Deep Manifold Learning of Symmetric Positive Definite Matrices with Application to Face Recognition

In this paper, we aim to construct a deep neural network which embeds high dimensional symmetric positive definite (SPD) matrices into a more discriminative low dimensional SPD manifold. To this end, we develop two types of basic layers: a 2D fully connected layer which reduces the dimensionality of the SPD matrices, and a symmetrically clean layer which achieves non-linear mapping. Specifically, we extend the classical fully connected layer such that it is suitable for SPD matrices, and we further show that SPD matrices with symmetric pair elements setting zero operations are still symmetric positive definite. Finally, we complete the construction of the deep neural network for SPD manifold learning by stacking the two layers. Experiments on several face datasets demonstrate the effectiveness of the proposed method.

심해저 원유 생산용 매니폴드 프레임 구조 기본 설계

심해저 원유 생산용 매니폴드 프레임 구조 기본 설계

Henryk (Heini) Eisenberg (1921–2009): From polymer chemistry to halophilic enzymes to chromatin and back

Henryk (Heini) Eisenberg (1921–2009): From polymer chemistry to halophilic enzymes to chromatin and back