Input quality aware convolutional LSTM networks for virtual marine sensors

Abstract

The harsh environmental conditions in a marine area make continuous observations of it challenging. To temporally or permanently replace faulty hardware sensors, reliable virtual sensors are getting more and more important. This paper introduces a deep learning architecture for a marine virtual sensor application that is able to utilize input quality information. We propose a novel input quality based dropout layer to take advantage of Information about the quality of the input sensors. The virtual sensor models are built upon convolutional and recurrent long short-term memory layers. We apply a time dimensionality reduction method called exPAA that retains finer details from recent values, but past information with less details are also available to the model. As interpretable reliability is important virtual sensors, we include predictive uncertainty based on dropout and Monte Carlo predictions into our neural network. Experimental results show that we perform better than the baseline and our input quality based dropout layer improves on these results even further. We also provide insights on the learned uncertainty intervals as well as the utilized linear and non-linear correlations of the first convolutional layer.