Handwritten Digit recognition is a challenging problem these days due to the widely used Arabic language in the world, especially in the Middle East region. In this paper, sliding windows are used to enhance classification accuracies and implemented using random forests (RF) and support vector machine (SVM) classifiers for recognition of Arabic digit images. In order to study their effectiveness with and without using sliding windows, four different feature extraction techniques have been proposed which includes Mean-based, Gray-Level Co-occurrence Matrix (GLCM), Moment-based, and Edge Direction Histogram (EDH). The obtained accuracies show the significance of using sliding windows for classifying digit. The recognition rates acquired using the modified version of AHDBase dataset are 98% when Mean-based and Moment-based are applied with RF classifier, 98.33% and 99.13% when GLCM and EDH are used with linear-kernel SVM, respectively. Moreover, the performance of this study is compared against recent state-of-the-art approaches, namely Geometric-based, two-dimensional discrete cosine transform, Hierarchical features, Hetero-features, Discrete Fourier Transform and geometrical features, Gabor-based, gradient, structural, and concavity and Local Binary Convolutional Neural Networks.