At present, the excellent performance of support vector machine (SVM) has made it successfully applied in many fields. However, when SVM is used for two-dimensional matrix data classification, vectorization of these data easily leads to dimension curse and the loss of structural information. Moreover, SVM is sensitive to outliers, which causes the hyperplane to move towards outliers. Therefore, this paper proposes a novel classification method for data in matrix-form, named non-parallel bounded support matrix machine (NPBSMM). In NPBSMM, a constraint norm group (CNG) is constructed and applied to objective function, which can not only suppress the negative impact of outliers on the model, but also make NPBSMM has better sparsity. By constructing CNG, the operation of matrix inversion in dual problem of traditional classification methods is avoided, so NPBSMM is more suitable for solving large-scale data problems. Further, to extract structure information of matrix for modeling, multi-rank left and right projection matrices are employed to establish objective function, which makes NPBSMM has a better ability of data fitting. Experiments performed on three roller bearing fault datasets show that the proposed NPBSMM method has powerful performance and robustness as compared with other typical classification methods.