Hierarchical multi-class classification in multimodal spacecraft data using DNN and weighted support vector machine

Abstract

Prognostics and health management (PHM) is widely applied to assess the reliability, safety and operation of systems particularly in spacecraft systems. However, spacecraft systems are very complex with intangibility and uncertainty, and it is difficult to model and analyze the complex degradation process, and thus there is no single prognostic method for solving the critical and complicated problem. This paper presents a novel hierarchical multi-class classification method using deep neural networks (DNN) and weighted support vector machine (WSVM) in order to achieve a highly discriminative feature representation for classifying the multimodal spacecraft data. First, the stack auto-Encoder (SAE) or deep belief network is adopted to initialize the initial weights and offsets of the hierarchical multi-layer neural network in order to reduce the dimension of the original multimodal data, and the optimal depth of multi-layer neural network and the discriminative features are also obtained. Second, in order to make the high dimensional spacecraft data more separable, the initialization parameters are online monitored by using a gradient descent method. Finally, a flexible hierarchical estimation method of a multi-class weighted support vector machines (MCWSVM) is applied to classify the multimodal spacecraft data. The performance of the proposed work is evaluated by the classification accuracy, sensitivity, specificity and execution time, respectively. The results demonstrate that the proposed DNN with MCWSVM is efficient in terms of better classification accuracy at a lesser execution time when compared to K-nearest neighbors (KNN), SVM and naive Bayes method (NBM).