Abstract
This study addresses the problem of holistic road scene understanding based on the integration of visual and range data. To achieve the grand goal, the authors propose an approach that jointly tackles object-level image segmentation and semantic region labelling within a conditional random field (CRF) framework. Specifically, the authors first generate semantic object hypotheses by clustering 3D points, learning their prior appearance models, and using a deep learning method for reasoning their semantic categories. The learned priors, together with spatial and geometric contexts, are incorporated in CRF. With this formulation, visual and range data are fused thoroughly, and moreover, the coupled segmentation and semantic labelling problem can be inferred via graph cuts. The authors’ approach is validated on the challenging KITTI dataset that contains diverse complicated road scenarios. Both quantitative and qualitative evaluations demonstrate its effectiveness.
Highlights
Road scene understanding plays an important role in various computer vision applications, ranging from autonomous driving to urban modeling
The step of semantic reasoning via the convolutional recursive neuron network (CRNN) is critical for our final results
The image patches registered to these clustered 3D points are fed into the CRNN as inputs
Summary
Road scene understanding plays an important role in various computer vision applications, ranging from autonomous driving to urban modeling It commonly involves multiple tasks, such as drivable road surface detection [1, 2], pedestrian and vehicle detection [3, 4, 5, 6], semantic region labeling [7, 8, 9, 10, 11, 12], geometric context reasoning [13, 14], and so on. These challenges have led to a large amount of studies on tackling each problem.
Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have
Disclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.