A novel quality control method of time-series ocean wave observation data combining deep-learning prediction and statistical analysis

Abstract

Quality control (QC) of marine data is a critical aspect in ensuring the usability of oceanic data. In this paper, we propose a novel QC method for time-series ocean wave data, which combines deep learning prediction and statistical analysis. Our method first realizes multi-element LSTM prediction of the time-series ocean wave observation data, capturing both temporal consistency and physical relationships between the multi-element inputs. Then, it applies peak detection on the regional mean difference ratio derived from the predicted and true values of the ocean wave data, and finally labels the anomalous data points based on peak detection results. We conducted experiments on the time-series wave data of four sites from the National Marine Science Center, China, and compared our proposed method with traditional QC method that is currently used for operational marine data quality control, as well as classic anomaly detection models including Isolation Forest and VAE-LSTM. The results show a significant improvement in the Precision, Recall, and F1 Score for erroneous samples using our proposed method. Our proposed method takes advantages of both deep learning and statistical analysis and considers physical correlation of multiple elements of marine data, effectively addressing the problem of erroneous discrimination of abnormal sea conditions in the traditional method, and providing valuable insights for the study of marine time-series observational data.