From low negative correlation learning to high negative correlation learning

Abstract

Besides the studied transition learning between the two different ensemble learning algorithms such as negative correlation learning and balanced ensemble learning, transition learning could also implemented in negative correlation learning with different correlation penalties. On one hand, negative correlation learning with the lower correlation penalty named as low negative correlation learning might learn too much the training data while generating less negatively correlated neural networks. On the other hand, negative correlation learning with the higher correlation penalty called as high negative correlation learning might not be able to learn the training data, but be capable of generating highly negatively correlated neural networks. By conducting transition learning from low negative correlation learning to high negative correlation learning, this paper shows that the ensembles could have both the good performance and the diverse individual neural networks.