AbstractAutomatically classifying a huge amount of ground‐based auroral images is essential to facilitate aurora morphology statistical research and aid in comprehending the magnetospheric dynamics. However, facing the challenge of insufficient labeled images, deep learning methods perform suboptimally on small auroral image data sets, and traditional machine learning methods based on handcrafted features heavily rely on expert knowledge. In this paper, we propose a novel method that leverages the merits of both traditional machine learning and deep learning methods by extracting deep second‐order tensor features to train a support vector machine (SVM). To improve compactness and discriminative ability of the features, we comply the intrinsic data geometry on Riemannian manifold to employ dimensionality reduction and map the dimensionality‐reduced features from Riemannian space to Euclidean space for the SVM classifier. Experimental results on small aurora data sets conclusively demonstrate the effectiveness of our method, exhibiting competitive performance with recent aurora classification methods.