Unknown-Length Handwritten Numeral String Recognition Using Cascade of PCA-SVMNet Classifiers

Abstract

Automatic recognition of handwritten digit string with unknown length has many potential real applications. The most challenging step in this problem is how to efficiently segment connected and/or overlapped digits exhibited in the input image. Most existing numeral string segmentation approaches combine several segmentation hypotheses to handle various types of connected digits. This paper proposes a new handwritten digit string recognition without applying any explicit segmentation techniques. The proposed method uses a new cascade of hybrid principal component analysis network (PCANet) and support vector machine (SVM) classifier called PCA-SVMNet. PCANet is an emerging unsupervised simple deep neural network typically with only two convolutional layers. The proposed PCA-SVMNet model adds a new fully connected layer trained separately using SVM optimization method. Cascaded stages of PCA-SVMNet classifiers are constructed and trained to recognize various types of isolated and connected digits. Every PCA-SVMNet classifier is trained separately using combinations of real and synthetic touching digits. The first 1D-PCA-SVMNet stage is trained to recognize isolated handwritten digits (0...9) while forwarding non-isolated digits to the next stages. Each of the following stages is designed to recognize a class of connected digits and forwards the higher class to its successor. Multiple stages can be added accordingly to classify more complex touching digits. The experimental results using NIST SD19 real dataset show that the cascade of PCA-SVMNet classifier efficiently recognizes unknown handwritten digit string without applying any sophisticated segmentation methods. The proposed method achieves state-of-the-art recognition accuracy compared to other segmentation-free techniques.