This paper proposes a theorem on the uncorrelated optimal discriminant vectors (UODVs). It is proved that the classical optimal discriminant vectors are equivalent to UODV, which can be used to extract ( L−1) uncorrelated discriminant features for L-class problems without losing any discriminant information in the meaning of Fisher discriminant criterion function. Experiments on Concordia University CENPARMI handwritten numeral database indicate that UODVs are much more powerful than the Foley–Sammon optimal discriminant vectors. It is believed that when the number of training samples is large, the conjugate orthogonal set of discriminant vectors can be much more powerful than the orthogonal set of discriminant vectors.
Read full abstract