Mutual Information Variational Autoencoders and Its Application to Feature Extraction of Multivariate Time Series

Abstract

The application of deep learning in time-series prediction has developed gradually. In this paper, we propose a deep generative network model for feature extraction of multivariate time series, namely, mutual information variational autoencoders (MI-VAE). In the architecture of the proposed model, we use the latent space of VAE for feature learning, which can extract the essential features of multivariate time-series data effectively. The latent space employed directly as a feature extractor can avoid poor interpretability of model. In addition, we introduce a mutual information term into the loss function, which improves the expression capability and accuracy of model. The proposed model, combining the merits of VAE and mutual information, extracts features for multivariate time-series data from a new perspective. The Lorenz system and Beijing air quality time series are used to test performance of the proposed model and comparative models. Results show that the proposed model is superior to other similar models in terms of accuracy and expression capability of latent space.