A Comparative Study of Inductive and Transductive Learning with Feedforward Neural Networks

Abstract

Traditional supervised approaches realize an inductive learning process: A model is learnt from labeled examples, in order to predict the labels of unseen examples. On the other hand, transductive learning is less ambitious. It can be thought as a procedure to learn the labels on a training set, while, simultaneously, trying to guess the best labels on the test set. Intuitively, transductive learning has the advantage of being able to directly use training patterns while deciding on a test pattern. Thus, transductive learning faces a simpler problem with respect to inductive learning. In this paper, we propose a preliminary comparative study between a simple transductive model and a pure inductive model, where the learning architectures are based on feedforward neural networks. The goal is to understand how transductive learning affects the complexity measured by the number of hidden neurons of the exploited neural networks. Preliminary experimental results are reported on the classical two spirals problem.