Recognition rule acquisition by an advanced extension matrix algorithm

Abstract

Amongst all the methods of machine learning, learning from examples is considered as a key to acquire knowledge automatically. Learning from examples is to obtain a general cover through induction from a given set of positive and negative examples of a concept, which may describe all the positive examples, but reject all the negative examples of that concept. Extension matrix theory, a branch of learning from examples, presents the training examples as two matrices which consist of positive and negative examples respectively, and then finds a path satisfied with a positive example against the background of negative examples. Obviously, such a path is a conjunction of conditions that is satisfied by the positive example. However, most of all of pattern recognition problems, such as handwritten Chinese character recognition, have an overlay area. It is necessary to solve the problem of nonlinear boundaries among different classes when machine learning is applied to acquire the recognition rules. An advanced extension matrix algorithm is proposed in this paper, in which a heuristic search based on the average entropy is used to get the approximate solutions of the minimal complex. A potential function is used to estimate the probability density function of the overlay area between positive and negative examples, so that the nonlinear interfaces of the interclass areas may be obtained. This algorithm is applied to supervised learning for Chinese character recognition to acquire recognition rules, and the implementations upon 751,000 loosely-constrained handwritten Chinese characters indicate that these methodologies can be applied to a practical recognition system with promising results.