Aiming at the problems that the movement recognition accuracy of lower limbs needs to be improved, the optimized SVM recognition method by using voting mechanism is proposed in this paper. First, CS algorithm is applied to optimize the kernel function parameter and the penalty factor for SVM model. And then, voting mechanism is used to ensure the recognition accuracy of SVM classification algorithm. Finally, the experiments have been implemented and different classification algorithms have been compared. The recognition results shows that the movement recognition accuracy for the lower limbs by the optimized SVM recognition algorithm using voting mechanism is about 98.78%, which is higher than other commonly used classification algorithm with or without voting mechanism. The recognition method for the lower limbs proposed in this paper can be used in the field of rehabilitation training, smart healthcare and so on.