Abstract The defects of carbon fiber-reinforced polymer (CFRP) during the drilling process will affect the mechanical properties and service life of the components. We investigate the detection and characterization of delamination and burr defects after drilling CFRP. The drilling test was conducted on CFRP specimens, followed by image processing software to detect and extract the resulting defects. Subsequently, a more accurate two-dimensional quantitative characterization of the extracted delamination and burr defects was performed. Finally, by comprehensively considering the quality indexes of delamination and burr defects, a comprehensive evaluation factor that can fully reflect the hole-making defects is established to provide a theoretical basis and technical support for enhancing CFRP’s hole-making quality.