Investigation of Issues in Data Anomaly Detection Using Deep-Learning- and Rule-Based Classifications for Long-Term Vibration Measurements

Abstract

Structural health monitoring (SHM) systems are widely used for civil infrastructure monitoring. Data acquired from the SHM systems play an important role in assessing structural integrity and determining further maintenance activities. Considering that sensors in the SHM systems are installed in a harsh environment for long-term measurements, some sensors can malfunction and produce faulty data. As a large amount of measured data is often desired to be automatically processed and can adversely affect structural assessments, identifying such abnormal data is important. This paper provides critical investigations of the automated detection of data anomalies using existing deep-learning-based classification in conjunction with a simple rule-based approach. The issues investigated in this study include (1) the presence of ambiguous data that cannot be categorized as an anomaly class in the literature, (2) information loss during the conversion of time-series data into images for the deep-learning-based approach, and (3) additional issues, such as misclassification by trained models and requirements of the threshold section in the rule-based approach. The results of these key investigations can be utilized to develop an effective anomaly detection process.