A Novel Ensemble Approach for Improving Generalization Ability of Neural Networks

Abstract

Ensemble learning is one of the main directions in machine learning and data mining, which allows learners to achieve higher training accuracy and better generalization ability. In this paper, with an aim at improving generalization performance, a novel approach to construct an ensemble of neural networks is proposed. The main contributions of the approach are its diversity measure for selecting diverse individual neural networks and weighted fusion technique for assigning proper weights to the selected individuals. Experimental results demonstrate that the proposed approach is effective.KeywordsEnsemble learningdiversitysensitivityfusionclusteringthe second training