A classification-based fuzzy-rules proxy model to assist in the full model selection problem in high volume datasets

Abstract

ABSTRACT Improvement of accuracy in classifiers is a crucial topic in the machine learning field. The problem has been addressed, making new algorithms and selecting the fittest classifier for a given dataset. The latter approach combined with feature selection and pre-processing form up a new paradigm known as Full Model Selection. This paradigm is like a black box whose input is a dataset, and as an output, a precise classification model is obtained. Despite that, full model selection is not the first alternative with the larger datasets of nowadays. We propose the use of MapReduce to deal with huge datasets, a bio-inspired optimisation algorithm and the use of a novel algorithm based on fuzzy classification rules as a proxy model to guide the optimisation process. To the best of our knowledge, this work is the first to propose a classification algorithm based on fuzzy rules as a proxy model. Obtained results showed an accuracy improvement and a considerable reduction of the computing time in datasets of a wide range of sizes.