Category re-balancing based domain adaptive semantic segmentation

Abstract

The semantic segmentation task faces the bottleneck of high manual annotation costs. Domain adaptive learning provides an effective solution through inter domain knowledge transfer. However, existing domain adaptive semantic segmentation tasks face the situation of category asymmetry between scenes when dealing with complex scenes. Existing methods lack handling of class imbalance in the prediction process. In domain adaptive semantic segmentation tasks, class imbalance limits the performance of inter domain transfer. Our work focuses on the impact of category distribution on domain adaptive semantic segmentation tasks in image pairs. Inspired by long tail learning, we divided categories into head, middle, and tail categories, and designed effective strategies to enhance the contribution of tail categories in domain adaptation tasks. We introduce the concept of category rebalancing into domain adaptive image matching, and our method is lightweight and effective, proving its effectiveness on general datasets.