STDC‐MA network for semantic segmentation

Abstract

Semantic segmentation is applied extensively in autonomous driving and intelligent transportation with methods that highly demand spatial and semantic information. Here, an STDC-MA network is proposed to meet these demands. First, the STDC-Seg structure is employed in STDC-MA to ensure a lightweight and efficient structure. Subsequently, the feature alignment module is applied to understand the offset between high-level and low-level features, solving the problem of pixel offset related to upsampling on the high-level feature map. The approach implements the effective fusion between high-level features and low-level features. A hierarchical multiscale attention mechanism is adopted to reveal the relationship among attention regions from two different input sizes of one image. Through this relationship, regions receiving much attention are integrated into the segmentation results, thereby reducing the unfocused regions of the input image and improving the effective utilisation of multiscale information. STDC-MA maintains the segmentation speed as the STDC-Seg network while improving the segmentation accuracy of small objects. STDC-MA was verified on the validation dataset of Cityscapes. The segmentation result of STDC-MA attained 78.32% mIOU with the input of 0.5× scale, 4.92% higher than STDC-Seg.