Selective Weight Update for Neural Network – Its Backgrounds

Abstract

AbstractVSF–Network, Vibration Synchronizing Function Network, is a hybrid neural network combining Chaos Neural Network and hierarchical neural network. VSF–Network is designed for symbol learning. VSF–Network finds unknown parts of input data by comparing to stored pattern and it learns unknown patterns using unused part of the network. New patterns are learned incrementally and they are stored as sub-networks . Combinations of patterns are represented as combinations of the sub-networks. In this paper, the two theoretical backgrounds of VSF–Network are introduced. At the first, an incremental learning framework with Chaos Neural Networks is introduced. Next, the pattern recognition with the combined with symbols is introduced. From the viewpoints of9 differential topology and mixture distribution, the combined pattern recognition by VSF-Network is explained. Through an experiment, both the incremental learning capability and the pattern recognition with pattern combination are shown.Index TermsIncremental learningChaos Neural networknonlinear dynamicscatastrophe theory