A survey on feature drift adaptation: Definition, benchmark, challenges and future directions

Abstract

This paper provides insights into a nearly neglected type of drift: feature drifts.Existing works on feature drift detection and adaptation are surveyed.Existing works are empirically analyzed showing how challenging this problem is.This paper provides insights into future directions for research into feature drift detection and adaptation. Data stream mining is a fast growing research topic due to the ubiquity of data in several real-world problems. Given their ephemeral nature, data stream sources are expected to undergo changes in data distribution, a phenomenon called concept drift. This paper focuses on one specific type of drift that has not yet been thoroughly studied, namely feature drift. Feature drift occurs whenever a subset of features becomes, or ceases to be, relevant to the learning task; thus, learners must detect and adapt to these changes accordingly. We survey existing work on feature drift adaptation with both explicit and implicit approaches. Additionally, we benchmark several algorithms and a naive feature drift detection approach using synthetic and real-world datasets. The results from our experiments indicate the need for future research in this area as even naive approaches produced gains in accuracy while reducing resources usage. Finally, we state current research topics, challenges and future directions for feature drift adaptation.