Image classification is a fundamental problem in computer vision, and neural networks provide an effective solution. With the advancement of quantum technology, quantum neural networks have attracted a lot of attention. However, they are only suitable for low-dimensional data and require dimensionality reduction and quantum encoding. Two image classification methods have recently emerged: one employs PCA for dimensionality reduction and angular encoding, and the other integrates QNN into a CNN to improve performance. Despite numerous algorithms, the differences between them remain unclear. This study explores these algorithms’ performance in multi-class image classification and proposes an optimized hybrid quantum neural network suitable for the current environment. As the number of classes increases, research on PCA-based quantum algorithms reveals the barren plateau problem of QNN, which is not suitable for multiple classes in a hybrid setting. Our proposed model combining traditional CNN with QNN addresses QNN’s multi-class training difficulties to some extent and achieves satisfactory classification results. Nevertheless, its accuracy remains below that of the top-performing CNN models. Furthermore, we investigate transfer learning in hybrid quantum neural network models and assess the performance of our models on the quantum hardware from IBM. In conclusion, quantum neural networks show promise but require further research and optimization, facing challenges ahead.