In the steelmaking industry, the state of the blast furnace tuyere is an important basis for obtaining the internal information of the blast furnace. Traditional detections mainly rely on manual experience judgment, which is a time-consuming and tiring procedure for a human. In order to improve the efficiency of the detection, this paper is devoted to applying artificial intelligence methods to blast furnace anomaly detection. However, because of the low imaging degree of the abnormal state monitoring of the furnace mouth, the difference in the abnormal category is inconspicuous, and it is difficulty to extract the features with the existing intelligent models. To solve these problems, a novel and stable method is proposed in this paper to classify the image recognition of the abnormal state of the tuyere into one category; this is a new architecture that combines multiple technologies. For the fine-grained image classification task, an improved abnormal state recognition algorithm of the blast furnace tuyere based on the channel attention residual mechanism is proposed. In the model, the dataset is augmented by rotating it at random angles to balance the amount of data in each category; then, the residual module is used to integrate high- and low-order feature information and optimize the network; then, the multi-layer channel attention module is added based on the channel attention residual mechanism, and it obtains the optimal parameter combination of the model through k-fold cross-validation. Moreover, the number of channels was reduced by half after channel fusion, which could effectively reduce the model parameters and model complexity. It is shown in our experiments that the proposed method has an accuracy rate of 97.10% in identifying the abnormal state of the tuyere in our collection of blast furnace tuyere datasets. In order to test the performance of the proposed method, some existing models, such as SERNet, ResNeXt, and repVGG, are involved for comparison, and the proposed method has a better classification effect in comparison to them.