Abstract Electrical motor is a key component in industrial systems. Detecting incipient fault of motor is critical to system reliability. However, the characteristics of faults and normal stages are difficult to distinguish, Meanwhile, the lightweight requirements of the model and the imbalance of the samples also make incipient fault detection challenged. To address these problems, this paper proposes an unsupervised fault detection method combines lightweight network and orthogonal low-rank embedding (OLE). The raw signals are firstly transformed into time-frequency images and fed into lightweight convolution network for feature extraction. Then, the features are clustered into orthogonal subspaces to enhance inter-class separability. Finally, a detection module based on distance metric is designed to identify the incipient fault of motor. The effectiveness of the proposed method is validated on four industrial motor dataset and compared with other methods.