Abstract

Lane mark detection plays an important role in autonomous driving under structural environments. Many deep learning-based lane mark detection methods have been put forward in recent years. However, most of current methods limit their solutions within one single image and do not make use of the de facto successive image input during the driving scene, which may lead to inferior performance in some challenging scenarios such as occlusion, shadows, and lane mark degradation. To address the issue, we propose a novel lane mark detection network which takes pre-aligned multiple successive frames as inputs to produce more stable predictions. A Spatial-Temporal Attention Module (STAM) is designed in the network to adaptively aggregate the feature information of history frames to the current frame. Various structure of the STAM is also studied to ensure the best performance. Experiments on Tusimple and ApolloScape datasets show that our method can effectively improve lane mark detection and achieve state-of-the-art performance.

Highlights

  • With the rapid development of autonomous driving technology, lane mark detection have made great progress in recent years

  • As detecting lane marks from individual images suffers from challenging situations such as heavy shadow, serious occlusion, and severe lane mark damage, we focus on lane mark detection under continuous driving scenes

  • Lane marks with an accuracy greater than 85% are considered as True Positive (TP), otherwise False Positive (FP) or False Negative (FN)

Read more

Summary

Introduction

With the rapid development of autonomous driving technology, lane mark detection have made great progress in recent years. Traditional methods for lane mark detection usually involve several basic procedures, including image pre-processing, feature extraction, and detection by fitting [1,2,3]. Lane marks that cannot be precisely detected in a current single frame is able to be inferred from the information of former frames. A novel method using multiple frames for improving lane mark detection is proposed. With richer information from continuous images, the proposed method is able to greatly improve lane mark predictions on challenging scenarios and achieve state-of-the-art performance. By exploring the spatial-temporal information hidden in the multiple frames, the negative influence from complex scenarios like shadow, lane mark degradation, and vehicle occlusion could be largely mitigated;. The module enhances the features of current frame by attentively aggregating spatial-temporal information from history frames. Comprehensive experiments and ablation studies verified that the proposed model is effective and can achieve state-of-the-arts performance

Related Work
Proposed Methods
Multi-Frame Pre-Alignment
Instance Segmentation Network
Spatio-Temporal Attention Module
Post-Processing
Datasets
Implementation Details
Evaluation Criteria
Ablation Study
1: Frames
Aggregation Methods
Experiments on Tusimple
Methods
Experiment on ApolloScape
Conclusions
Full Text
Paper version not known

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call

Disclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.