Construction of multi-layer feedforward binary neural network by a genetic algorithm

Abstract

An approach is introduced to determine the topology of a feedforward binary neural network automatically. The approach is based on a construction algorithm that constructs one layer of hidden nodes at a time until the problem is solved. In each layer, the algorithm determines the necessary number of nodes through a growth process by finding the best hidden node that would help to partition the input training data set. This is done using a genetic algorithm. The proposed algorithm can determine the necessary number of hidden layers and number of hidden nodes at each layer automatically. Tests on a number of benchmark problems illustrated the effectiveness of the proposed technique, both in terms of network complexity and recognition accuracy, compared with a geometrical learning approach.