Oral English teaching quality evaluation is a complex nonlinear relationship, which is affected by many factors and has low accuracy. Aiming at the problem, a teaching quality evaluation method based on a BP neural network optimized by the improved crow search algorithm (ICSA) is proposed. First, ICSA is put forward and five algorithms are used to compare with the proposed algorithm on 10 benchmarks functions. The results show that ICSA outperforms the other five algorithms on 10 functions. Second, a feature selection method based on the improved binary crow search algorithm (BICSA) is used to select teaching quality evaluation indexes, and 10 standard datasets from the UCI repository are used for testing experiments. Finally, an oral English teaching evaluation model based on BP neural network is designed, in which BICSA is used for feature selection and ICSA is used to optimize the initial weights of the BP neural network. In the experiment, we designed 5 first-grade indexes and 15 second-grade indexes, and then we collects 23 groups of oral English teaching quality data. BICSA selected 10 features from a set of 15 features. Experimental results show that this method can effectively evaluate the quality of oral English teaching with high accuracy and real-time performance.