The On-Load Tap Changer (OLTC) is the only movable mechanical component in a converter transformer. To ensure the reliable operation of the OLTC and to promptly detect mechanical faults in OLTCs to prevent them from developing into electrical faults, this paper proposes a fault diagnosis method for OLTCs based on a combination of Particle Swarm Optimization (PSO) algorithm and Least Squares Support Vector Machine (LSSVM) with multi-feature fusion. Firstly, a multi-feature extraction method based on time/frequency domain statistics, synchrosqueezed wavelet transform, singular value decomposition, and multi-scale modal decomposition is proposed. Meanwhile, the random forest algorithm is used to screen features to eliminate the influence of redundant features on the accuracy of fault diagnosis. Secondly, the PSO algorithm is introduced to optimize the hyperparameters of LSSVM to obtain optimal parameters, thereby constructing an optimal LSSVM fault diagnosis model. Finally, different types of feature combinations are utilized for fault diagnosis, and the impact of these feature combinations on the fault diagnosis results is compared. Experimental results indicate that features of different types can complement each other, making the OLTC state information carried by multi-dimensional features more comprehensive, which helps to improve the accuracy of fault diagnosis. Compared with four traditional fault diagnosis methods, the proposed method performs better in fault diagnosis accuracy, achieving the highest accuracy of 98.58%, which can help to detect mechanical faults in the OLTC early and reduce the system’s downtime.