Automated vehicle damage classification using the three-quarter view car damage dataset and deep learning approaches

Abstract

Automated procedures for classifying vehicle damage are critical in industries requiring extensive vehicle management. Despite substantial research demands, challenges in the field of vehicle damage classification persist due to the scarcity of public datasets and the complexity of constructing datasets. In response to these challenges, we introduce a Three-Quarter View Car Damage Dataset (TQVCD dataset), emphasizing simplicity in labeling, data accessibility, and rich information inherent in three-quarter views. The TQVCD dataset distinguishes class by vehicle orientation (front or rear) and type of damage while maintaining a three-quarter view. We evaluate performance using five prevalent pre-trained deep learning architectures—ResNet-50, DenseNet-160, EfficientNet-B0, MobileNet-V2, and ViT—employing a suite of binary classification models. To enhance classification robustness, we implement a model ensemble method to effectively mitigate individual model dependencies' deviations. Additionally, we interview three experts from the used-car platform to validate the necessity of a vehicle damage classification model using the corresponding dataset from an industrial perspective. Empirical findings underscore the dataset's comprehensive coverage of vehicle perspectives, facilitating efficient data collection and damage classification while minimizing labor-intensive labeling efforts.