Abstract Defect detection is a crucial direction of deep learning, which is suitable for industrial inspection of product quality in strip steel. As the strip steel production line continuously outputs products, it is necessary to take corresponding measures for the type of defect, once a subtle quality problem is found on steel strips. We propose a new defect area detection and classification method for automation strip steel defect detection. In order to eliminate the way of insufficient data in industrial production line scenarios, we design a transfer learning scheme to support the training of defect region detection. Subsequently, in order to achieve a more accurate classification of defect categories, we designed a deep learning model that integrated the detection results of defect regions and defects feature extraction. After applying our method to the test set and production line, we can achieve extremely high accuracy, reaching 87.11%, while meeting the production speed of the production line compared with other methods. The accuracy and speed of the model realize automatic quality monitoring in the manufacturing process of strip steel.