Hierarchical Learning of Boolean Functions

Abstract

The learning of Boolean functions has been the focus of a number of papers in computer science in the last few years, many of which have been stimulated by the work of Valiant [3, 4]. We also mention especially the recent long article by Blumer et al [1] on learnability for various classes of concepts including especially Boolean classes. The thrust of most of this theoretical work has essentially been to show under what conditions concepts can be learned in polynomial time or space. It is of course important to show that learning is feasible for as wide a class of concepts as possible. However, it is also important to focus on detailed results of a very finitistic kind, which are characteristic of learning theory as applied to human behavior, and are of intrinsic interest also in machine learning. In this paper we consider conditions under which a hierarchy of Boolean functions can increase in significant ways the rate of learning of a given Boolean function of n variables. In this context we also compare serial and parallel hierarchical learning, with, as might be expected, the most dramatic effects being produced by parallel hierarchical learning. Because in general the results are better for parallel than for serial learning the reader might wonder why we include a systematic study of serial learning. The reason is that even under serial learning conditions hierarchical learning can often lead to dramatic improvement in the rate of learning.