With the rapid development of artificial intelligence and deep learning in recent years, many universities have put forward the goal of achieving digitalization, intelligent, and education informatization on campus. Throughout the lecture and learning process, the classroom status is an important reference factor to assess students’ acceptance of the course and the quality of lectures. However, at present, classroom status analysis is mainly conducted manually, which can distract teachers’ attention, so it is of great research significance to find a method that can improve the efficiency of classroom status analysis. In this paper, we choose an offline method to analyze the status of a classroom video recording in terms of students’ behavior and attendance in terms of frames, in which student behavior is identified by an improved target detection algorithm and attendance is analyzed by face recognition. By analyzing the structure of the neural network model, an improved neural network model is proposed for its characteristics of a large number of parameters and poor detection of small targets in the basic network. The backbone network is replaced by the improved neural network, and the depth‐separable convolutional network is used to reduce the network parameters and increase the computation speed. The information in the deeper feature map is fused upward into the shallow layer to improve the accuracy of small target recognition. Finally, the optimization algorithm is incorporated into the network to optimize the network model and accelerate the model convergence speed. In addition, this paper incorporates the improved behavior recognition method and face recognition method into the system to realize the analysis of the offline classroom status. The system is divided into a teacher side and a management side, where the teacher side is responsible for uploading course recordings and the management side is responsible for randomly analyzing students’ status and attendance at any time, and the combination of the two forms a convenient and comprehensive classroom status analysis system platform. Users can upload classroom videos through the instructor interface and can view the classroom status analysis results of a course at any time by searching randomly in the administration. In this paper, the classroom status is mainly judged by the recognition of students’ behaviors.