To address the low-efficiency issue of the manual assessment method for sewer pipe defects, we propose a defect severity assessment model based on automated pipe calibration (DSA-APC), which can provide automated and quantitative assessments. First, the cross-section feature is extracted by automated pipe calibration. A pipe cross-section feature extraction algorithm based on restricted Hough gradient transform (RHGT) is proposed. Then, a fine-defect feature extraction method based on edge detection is proposed to extract the features of pipe defects more finely. Finally, according to the assessment standards of the sewer pipe defect, a defect severity assessment table is constructed, and the area ratio of the defect feature and cross-section feature is used to evaluate the severity. Experiments are carried out on the Songbai data set and Level-sewer10 data set. The average absolute deviation of the DSA-APC model is 2.008%, and the average accuracy is 86.73%. The experimental results show that the DSA-APC model can correctly evaluate the severity level of sewer pipe defects, which has a good practical application value.