Improved Hybrid Bag-Boost Ensemble With K-Means-SMOTE–ENN Technique for Handling Noisy Class Imbalanced Data

Abstract

Abstract A class imbalance problem plays a vital role while dealing with classes with rare number of instances. Noisy class imbalanced datasets create considerable effect on the machine learning classification of classes. Data resampling techniques commonly used for handling class imbalance problem show insignificant behavior in noisy imbalanced datasets. To cure curse of data resampling technique in noisy class imbalanced data, we have proposed improved hybrid bag-boost with proposed resampling technique model. This model contains proposed resampling technique used for handling noisy imbalanced datasets. Proposed resampling technique comprises K-Means SMOTE (Synthetic Minority Oversampling TEchnique) as an oversampling technique and edited nearest neighbor (ENN) undersampling technique used as noise removal. This resampling technique is used to mitigate noise in imbalanced datasets at three levels, i.e. first clusters datasets using K-Means clustering technique, SMOTE inside clusters for handling imbalance by inducing synthetic instances of class in minority and lastly, using ENN technique to remove instances that create noise afterwards. Experiments were performed using 11 binary imbalanced datasets by varying attribute noise percentages, and by using area under receiver operating curve as performance metrics. Experimental results confirmed that proposed model shows better results than the rest. Moreover, it is also confirmed that proposed technique performs better with an increased noise percentage in binary imbalanced datasets.