Car Damage Detection and Classification

Abstract

Nowadays, the proliferation of automobile industries is directly related to the increasing number of car incidents. So, insurance companies are facing many simultaneous claims and solving claims leakage. The sense of Artificial Intelligence (AI) based on machine learning and deep learning algorithms can help to solve these kinds of problem for insurance industries. In this paper, we apply deep learning-based algorithms, VGG16 and VGG19, for car damage detection and assessment in real-world datasets. The algorithms detect the damaged part of a car and assess its location and then its severity. Initially, we discover the effect of domain-specific pre-trained CNN models, which are trained on an ImageNet dataset, and followed by fine-tuning, because some of the categories can be fine-granular to get our specific tasks. Then we apply transfer learning in pre-trained VGG models and use some techniques to improve the accuracy of our system. We achieve the accuracy of 95.22% of VGG19 and 94.56% of VGG16 in the damaged detection, the accuracy of 76.48% of VGG19 and 74.39% of VGG16 in damage localization, the accuracy of 58.48% of VGG19 and 54.8% of VGG16 in damage severity with the combination of transfer learning and L2 regularization. From their results, the performance of VGG19 is better than VGG16. After analyzing and implementing our models, we find out that the results of using transfer learning and L2 regularization can work better than those of fine-tuning.