Study on data fuzzy breakpoint detection in massive dynamic data flow

Abstract

The current method obtains the frequency of occurrence of abnormal data detected in the adjacent regions through reading between the sensor and the adjacent conversion data, and uses the frequency of occurrence of abnormal data to describe the spatial correlation, according to readings of sensor data using the Bayesian analysis method of sensor to determine whether the sensor is abnormal. But this method has the problem of low detection accuracy. For this reason, this paper proposes a method to detect the fuzzy breakpoint of data in the massive dynamic data flow. Firstly, this method used the amplitude difference method to determine the abnormal data amplitude and the discrete point difference of data fuzzy breakpoint, and then used the wavelet transform to extract the features of inflection point of the data fuzzy breakpoint. Combined with the features of inflection point of the extracted data fuzzy breakpoint, we carried out the support vector machine classification, and detected the data fuzzy breakpoints in the massive dynamic data flow. Experimental results show that the proposed method can effectively improve the accuracy of fuzzy breakpoint detection.