Evaluating filter fuzzy analogy homogenous ensembles for software development effort estimation

Abstract

AbstractResearchers have developed and evaluated many techniques to deliver accurate estimates of the effort required to complete a new software program. Among these, analogy has emerged as a very promising technique, in particular the fuzzy analogy estimation technique that uses the fuzzy logic concepts in order to deal with both categorical and numerical data. The aim of this paper is twofold: (1) evaluate the impact of 3 filters on the predictive ability of single and ensemble fuzzy analogy techniques and (2) assess whether filters could be a source of diversity for fuzzy analogy ensembles. Moreover, it compares the filter single and ensemble fuzzy analogy techniques with fuzzy analogy ensembles built without using feature selection over 6 datasets. The overall results suggest that (1) more accurate estimates are generated when filters were used with single and ensemble fuzzy analogy techniques, (2) filter single fuzzy analogy techniques outperformed filter fuzzy analogy ensembles, and (3) fuzzy analogy ensembles without feature selection were more accurate than filter single and ensemble techniques. Therefore, though the use of feature selection techniques led single and ensemble fuzzy analogy to generate accurate estimations, they failed to be a source of diversity for fuzzy analogy ensembles. Hence, constructing fuzzy analogy homogenous ensembles that combine single fuzzy analogy techniques with different parameter configurations still generate better accuracy than filter fuzzy analogy ensembles. However, further empirical evaluations of filter/wrappers fuzzy analogy ensembles are required in order to confirm or refute these findings.