An Improvement of Extreme Learning Machine Using Subclass Clustering

Abstract

Extreme learning machine (ELM) is an extremely fast learning algorithm proposed for a single-hidden-layer feed-forward neural network (SLFN). ELM projects a set of training instances into a random feature space, and then analytically calculates the weight matrix connecting between the hidden layer and the output layer, leading to a very fast learning speed. This paper proposes an improved version of ELM, named clustering-ELM, that assigns a subclass to each training instances and learns for a weight matrix that projects random features into subclass. In the prediction step, the responses from output nodes of the same class are integrated into one using maximum function. Experimental results conducted on various benchmark datasets reveal a promising performance of the proposed clustering-ELM, compared to the standard ELM.