An enhanced structural developmental neural network with information saturation for continual unsupervised learning

Abstract

In this paper, an enhanced structural developmental neural network with information saturation (ESDNNIS) is proposed for continual unsupervised learning. It improves SDNNIS in the following respects: (1) it makes a distinction between the developmental stages of neurons to better regulate the updating of neurons; (2) it adopts the forgetting mechanism to control the network size; (3) it changes the way coverage domain parameter is initialized and updated to divide clusters more accurately; and (4) it adds a parent–child relationship update mechanism to provide better robustness to sample input order. ESDNNIS inherits the unsupervised incremental learning and class segmentation capabilities of SDNNIS, and achieves better class incremental clustering for more complex datasets while using fewer neurons than SDNNIS. The experimental results show that the accuracy of clustering results of ESDNNIS is improved by 10.94% on average compared with SDNNIS, while the number of generated neurons is reduced by 71.93% on average.