Incremental Learning Framework for Function Approximation via Combining Mixture of Expert Model and Adaptive Resonance Theory

Abstract

This paper introduces an incremental learning framework for function approximation which uses the structure of mixture of expert model and learning methodology of adaptive resonance theory. The proposed framework adapts their structure and parameter values through incremental, competitive learning, and supervised learning. The main idea comes from that the combination of two classical methods which are mixture of expert model and adaptive resonance theory can be jointly learned and the combination keeps up the advantages of each method;the mixture of expert model has the ability to avoid strong interference and the adaptive resonance theory is one of the best model of incremental learning. The idea can be implemented by modifying adaptive resonance theory based on the mixture of expert model. The empirical experiment would show the performance of the proposed implementation via comparing receptive field weighted regression(RFWR) and PROBART.