Computational awareness for learning neural network ensembles

Abstract

This paper proposes a hybrid negative correlation learning in which each individual neural network in an neural network ensemble would either learn a data point by negative correlation learning or learn to be different to the neural network ensemble. The implementation is through randomly splitting the training set into two subsets for each individual neural network in learning. On one subset of the training data, the individual neural network would be trained by negative correlation learning. On the other subset of the training data, the individual neural network would be trained to be different to the neural network ensemble. The purpose of such random splitting of the training data is to allow each individual neural network to build up its self-awareness of the learning direction on each given data point.