Multiclass classifiers based on dimension reduction with generalized LDA

Abstract

Linear discriminant analysis (LDA) has been widely used for dimension reduction of data sets with multiple classes. The LDA has been recently extended to various generalized LDA methods that are applicable regardless of the relative sizes between the data dimension and the number of data items. In this paper, we propose several multiclass classifiers based on generalized LDA (GLDA) algorithms, taking advantage of the dimension reducing transformation matrix without requiring additional training or parameter optimization. A marginal linear discriminant classifier (MLDC), a Bayesian linear discriminant classifier (BLDC), and a one-dimensional BLDC are introduced for multiclass classification. Our experimental results illustrate that these classifiers produce higher ten-fold cross validation accuracy than kNN and centroid-based classifiers in the reduced dimensional space obtained from GLDA.