ABSTRACT Nowadays, composite materials have become prevalent across various sectors, particularly finding usage in large-scale applications such as spaceships, automobiles, and aircrafts. The accurate detection of the defects in these materials is crucial, yet traditional methods often rely on human inspection, which is susceptible to errors. Recent advancements in machine learning have enabled defect detection using ultrasonic non-destructive testing methods. This paper introduces a new dataset named UNDT, which is obtained from the scans of 60 different composite materials, generating a total of 1150 images depicting both defective and non-defective areas. Several transfer learning methods are applied on the newly introduced UNDT dataset as well as the publicly available USimgAIST ultrasonic dataset. Comparative performance assessments illustrate the significance of utilising the transfer learning approach for defect classification on ultrasonic inspection images. Furthermore, the research emphasises the substantial benefits of employing these transfer learning methods. Notably, the DenseNet121 and VGG19 models achieve the highest accuracy rates, with 98.8% and 98.6% on the UNDT and USimgAIST datasets, respectively.