Based on the MobileNetV3 model, this paper introduces the Coordinate attention (CA) attention mechanism and transfer learning to propose the MobileNet-CAL model to solve the problems of insufficient attention to model channel information, long classification training time, high training cost, and weak generalization ability. The model combines data enhancement, attention mechanism and transfer learning technology to improve the classification effect of the model, and updates the fully connected layer at the same time. Finally, the model is optimized by combining the Auxiliary loss function and the ASGD optimizer to improve the classification accuracy of the model, speed up the collection speed, and enhance the robustness of the model. Finally, the model is evaluated from multiple angles such as Accuracy, F1-score, Precision, Recall, and Specificity in the tomato pest and disease leaf dataset. Its Accuracy reaches 98.59% an accuracy of, which is improved by, and by, 4.47%respectively, compared with the original model. Experiments show that MobileNet-CAL can improve the classification accuracy to a certain extent, verifying that the model proposed 4.05%、3.43%、16.57% in 4.13%this paper is effective in the classification task of tomato pest and disease leaves.