A Flow feature detection framework for large-scale computational data based on incremental proper orthogonal decomposition and data mining

Abstract

ABSTRACTA framework based on incremental proper orthogonal decomposition (iPOD) and data mining to perform large-scale computational data analysis is presented. It includes iPOD to incrementally reduce data dimensions and decouple dynamic flow structures in massive CFD data; data mining to classify and identify candidate global regions of interest (ROIs) for focused analysis; feature detection to capture key flow features and ultimate ROIs (UROIs); and targeted data storage and visualisation. Quantitative results show that iPOD is able to process large datasets that overwhelm the batch-POD, leading to 4–16× data reduction in the temporal domain. Data mining and feature detection algorithms, respectively, identify 50–70% of the spatial domain with high probability of flow feature occurrence and only 2–30% containing key flow features. The UROI and associated data can be selectively stored and visualised. In contrast to batch-POD, iPOD reduces memory usage by more than 10× and time by up to 75%.