Lane Detection Method Research Articles

Improved lane detection for autonomous vehicles using deep learning, semantic segmentation, edge detection and multi-sensor data fusion

Automated driving has gained significant attention because it can eliminate severe driving risks in real time. While autonomous vehicles rely heavily on sensors for lane detection, obstacle identification, and environmental awareness, accurate lane recognition remains a persistent challenge due to factors such as noise from shadows, poor lane markings, and obstructed views. Despite advances in computer vision, this problem is yet to be fully resolved, presenting a gap in the current literature. The primary objective of this research is to address these challenges by developing an enhanced lane-detection system. To achieve this, the study integrates advanced techniques, including semantic segmentation, edge detection, and deep learning, coupled with multi-sensor data fusion from cameras, LIDAR, and radar. By employing this methodology, the research examines various lane-detection methods and benchmarks the proposed model against existing systems in terms of accuracy, specificity and processing speed. Initial findings demonstrate that the combination of semantic segmentation and multi-sensor fusion improves lane detection in real-time scenarios. The proposed model achieved a lane detection accuracy of 97.8%, a specificity of 99.28%, and an average processing time of 0.0047 seconds per epoch. This study not only addresses the limitations of existing lane detection systems but also offers insights into improving road safety for autonomous vehicles.

Enhanced Cross Layer Refinement Network for robust lane detection across diverse lighting and road conditions

With the rapid development of autonomous driving technology, lane detection, a key component of intelligent vehicle systems, is crucial for ensuring road safety and efficient vehicle navigation. In this paper, a new lane detection method is proposed to address the problem of degraded performance of existing lane detection methods when dealing with complex road environments. The proposed method evolves from the original Cross Layer Refinement Network (CLRNet) by incorporating two of our carefully designed core components: the Global Feature Optimizer (GFO) and the Adaptive Lane Geometry Aggregator (ALGA). The GFO is a multi-scale attention mechanism that mimics the human visual focusing ability, effectively filtering out unimportant information and focusing on the image regions most relevant to the task. The ALGA is a shape feature-aware aggregation module that utilizes the shape prior of lanes to enhance the correlation of anchor points in an image, better fusing global and local information. By integrating both components into CLRNet, an enhanced version called Enhanced CLRNet (E-CLRNet) is presented, which exhibits higher performance stability in complex roadway scenarios. Experiments on the CULane dataset reveal that E-CLRNet demonstrates superior performance stability over the original CLRNet in complex scenarios, including curves, shadows, missing lines, and dazzling light conditions. In particular, in the curves, the F1 score of E-CLRNet is improved by almost 3% over the original CLRNet. This study not only improves the accuracy and performance stability of lane detection but also provides a new solution for the application of autonomous driving technology in complex environments, which promotes the development of intelligent vehicle systems.

A robust and real-time lane detection method in low-light scenarios to advanced driver assistance systems

Lane detection, which relies on front-view RGB cameras, is a crucial aspect of Advanced Driver Assistance Systems (ADAS), but its effectiveness is notably reduced in low-light conditions. This issue is exacerbated by the lack of specialized datasets and generalizable methods for such scenarios. To address this gap, we introduce NightLane, a comprehensive dataset tailored for low-light, multi-traffic lane detection. We adhere to stringent data annotation guidelines, ensuring reliable detection accuracy. Additionally, we propose the Fused Low-Light Enhancement Framework (FLLENet), which leverages modern detection networks and incorporates a low-light enhancement module and attention mechanisms. The enhancement module, based on zero-reference learning, improves image quality and channel richness, while the attention mechanisms effectively extract and utilize these features. Our extensive testing on NightLane and CULane datasets demonstrates superior performance in low-light lane detection, showcasing FLLENet’s robust generalizability and efficacy. Specifically, our approach achieves an F1 measure of 76.90 on CULane and 78.91 on NightLane, demonstrating its effectiveness against state-of-the-art methods. We also evaluate the real-time applicability of our framework on a low-power embedded lane detection system using NVIDIA Jetson AGX/Orin, achieving high accuracy and real-time performance. Our work offers a new approach and reference in the field of low-light lane detection, potentially aiding in the ongoing enhancement of ADAS (ADAS). Dateset are available at https://github.com/pengjingt/FLLENet.

LDTR: Transformer-based lane detection with anchor-chain representation

Despite recent advances in lane detection methods, scenarios with limited- or no-visual-clue of lanes due to factors such as lighting conditions and occlusion remain challenging and crucial for automated driving. Moreover, current lane representations require complex post-processing and struggle with specific instances. Inspired by the DETR architecture, we propose LDTR, a transformer-based model to address these issues. Lanes are modeled with a novel anchor-chain, regarding a lane as a whole from the beginning, which enables LDTR to handle special lanes inherently. To enhance lane instance perception, LDTR incorporates a novel multi-referenced deformable attention module to distribute attention around the object. Additionally, LDTR incorporates two line IoU algorithms to improve convergence efficiency and employs a Gaussian heatmap auxiliary branch to enhance model representation capability during training. To evaluate lane detection models, we rely on Fréchet distance, parameterized Fl-score, and additional synthetic metrics. Experimental results demonstrate that LDTR achieves state-of-the-art performance on well-known datasets.

LHFFNet: A hybrid feature fusion method for lane detection

Lane line images have the essential attribute of large-scale variation and complex scene information, and the similarity between adjacent lane lines is high, which can easily cause classification errors. And remote lane lines are difficult to recognize due to visual angle changes in width. To address this issue, this paper proposes an effective lane detection framework, which is a hybrid feature fusion network that enhances multiple spatial features and distinguishes key features throughout the entire lane line segment. It enhances and fuses lane line features at multiscale to enhance the feature representation of lane line images, especially at the far end. Firstly, in order to enhance the correlation of multiscale lane features, a multi-head self attention is used to construct a multi-space attention enhancement module for feature enhancement in multispace. Secondly, a spatial separable convolutional branch is designed for the jumping layer structure connecting multiscale lane line features. While retaining feature information of different scales, important lane areas in multiscale feature information are emphasized through the allocation of spatial attention weights. Finally, considering that lane lines are elongated areas in the image, and the background information in the image is much more abundant than lane line information, the flexibility of traditional pooling operations in capturing widely existing anisotropic contexts in actual environments is limited. Therefore, before embedding feature output branches, strip pooling is introduced to refine the representation of lane line information and optimize model performance. The experimental results show that the accuracy on the TuSimple dataset reaches 96.84%, and the F1 score on the CULane dataset reaches 75.9%.

Lane Line and Object Detection Using Yolo v3

In the contemporary age, creating autonomous vehi- cles is a crucial starting point for the advancement of intelligent transportation systems that rely on sophisticated telecommu- nications network infrastructure, including the upcoming 6g networks. The paper discusses two significant issues, namely, lane detection and obstacle detection (such as road signs, traffic lights, vehicles ahead, etc.) using image processing algorithms. To address issues like low accuracy in traditional image processing methods and slow real-time performance of deep learning-based methods, barriers for smart traffic lane and object detection algorithms are proposed. We initially rectify the distorted image resulting from the camera and then employ a threshold algorithm for the lane detection algorithm. The image is obtained by extracting a specific region of interest and applying an inverse perspective transform to obtain a top-down view. Finally, we apply the sliding window technique to identify pixels that belong to each lane and modify it to fit a quadratic equation. The Yolo algorithm is well-suited for identifying various types of obstacles, making it a valuable tool for solving identification problems. Finally, we utilize real-time videos and a straightforward dataset to conduct simulations for the proposed algorithm. The simula- tion outcomes indicate that the accuracy of the proposed method for lane detection is 97.91% and the processing time is 0.0021 seconds. The proposal for detecting obstacles has an accuracy rate of 81.90% and takes only 0.022 seconds to process. Compared to the conventional image processing technique, the proposed method achieves an average accuracy of 89.90% and execution time of 0.024 seconds, demonstrating a robust capability against noise. The findings demonstrate that the suggested algorithm can be implemented in self-driving car systems, allowing for efficient and fast processing of the advanced network.

Dynamically Enhanced lane detection with multi-scale semantic feature fusion

Lane detection plays a crucial role in autonomous driving technology, and there have been many recent advancements in 3D lane detection methods. One common approach is simplifying the problem by transforming images into Bird's Eye View (BEV) space. However, existing methods still have limitations, particularly in accurately identifying lanes in many complex autonomous driving scenarios, such as slopes and extreme weather conditions. Therefore, this paper proposes a dynamically updated lane detection method called DynamicallyLane. This method utilizes ConvNeXt V2-N deformations as the backbone for feature extraction, employs dynamic learnable encoding and deformable attention mechanisms, achieves precise conversion from the frontal view to BEV through a novel representation of 3D reference points, and utilizes the Enhanced BEV Features module for feature fusion, obtaining richer and more semantically informative feature representations to facilitate the model learning process better. Experimental results demonstrate that DynamicallyLane achieves an F-score of 56.2 % on the OpenLane dataset and performs excellently on the Apollo 3D Synthetic dataset. Our code is available at https://github.com/Tafble/lane_detection.

Current Approaches in Traffic Lane Detection: a minireview

The continuous development and importance of the field of road transport these days make it necessary to design, develop and implement technological solutions that reduce (eliminate as much as possible) the risk of road accidents. Such a technological solution is also represented by advanced driver assistance systems (ADAS), systems that assist drivers in various ways, such as collision avoidance, automatic parking, adaptive cruise control, attention and lane departure warnings. Over the next ten years, there will likely be a rise in the need for ADAS system deployment in automobile construction, driven by consumer and regulatory interest in safety applications that protect drivers and lower accident rates. At the moment, autonomous emergency braking and forward collision warning systems are mandated for all cars in the US and the EU. Additionally, advanced driver assistance systems (ADAS) may soon distinguish automobile brands and have a significant impact on consumer preference. The present work aims to provide a general picture related to the current research and development of ADAS systems that refer to the detection of the traffic lane and lane markings. The approaches are presented regarding: the current development directions of ADAS systems, current traffic lane detection techniques, traffic lane detection methods and the use of artificial intelligence techniques in this field. The general conclusion is that further research is needed in the field, research to increase the performance of traffic lane detective systems by using advanced algorithms and easy-to-implement methods that do not require large hardware resources.

A Faster and Lightweight Lane Detection Method in Complex Scenarios

Lane detection is a crucial visual perception task in the field of autonomous driving, serving as one of the core modules in advanced driver assistance systems (ADASs).To address the insufficient real-time performance of current segmentation-based models and the conflict between the demand for high inference speed and the excessive parameters in resource-constrained edge devices (such as onboard hardware, mobile terminals, etc.) in complex real-world scenarios, this paper proposes an efficient and lightweight auxiliary branch network (CBGA-Auxiliary) to tackle these issues. Firstly, to enhance the model’s capability to extract feature information in complex scenarios, a row anchor-based feature extraction method based on global features was adopted. Secondly, employing ResNet as the backbone network and CBGA (Conv-Bn-GELU-SE Attention) as the fundamental module, we formed the auxiliary segmentation network, significantly enhancing the segmentation training speed of the model. Additionally, we replaced the standard convolutions in the branch network with lightweight GhostConv convolutions. This reduced the parameters and computational complexity while maintaining accuracy. Finally, an additional enhanced structural loss function was introduced to compensate for the structural defect loss issue inherent in the row anchor-based method, further improving the detection accuracy. The model underwent extensive experimentation on the Tusimple dataset and the CULane dataset, which encompass various road scenarios. The experimental results indicate that the model achieved the highest F1 scores of 96.1% and 71.0% on the Tusimple and CULane datasets, respectively. At a resolution of 288 × 800, the ResNet18 and ResNet34 models achieved maximum inference speeds of 410FPS and 280FPS, respectively. Compared to existing SOTA models, it demonstrates a significant advantage in terms of inference speed. The model achieved a good balance between accuracy and inference speed, making it suitable for deployment on edge devices and validates the effectiveness of the model.

Vehicle Self-Position Estimation Using Lighting Recognition in Expressway Tunnel for Visual Inspection Flow

In this study, a stable and high-speed vision-based self-position estimation method was proposed that improves upon the existing method of lane detection by recognizing the lighting facilities that are installed in tunnels on Japanese expressways where GNSS cannot be used. In addition, we proposed a method for inspecting multiple cracks at once by estimating the self-position with the successful rate 75% in the traveling direction by counting the lighting with the successful rate 99.85%. The effectiveness of the method was verified by capturing images of cracks in an actual tunnel. The proposed method will enable more frequent inspections for tunnel cracks that lead to flaking while maintaining infrastructure safety, reducing costs, and improving tunnel visual inspection flow efficiency.

Robust Lane Detection Method Based on Dynamic Region of Interest

Lane detection is an important component of vehicle assisted driving systems. Many lane line algorithms have been proposed, but lane line detection is still a challenging task in environments with road text or vehicle interference. To address these issues, this paper proposes a robust lane line detection method under structured roads. First, we propose a method based on the slope and length of a straight line and the distance of the line from the centre line to extract regions of interest reducing interference from other invalid regions. Afterwards, we use a new fusion method to fuse the extracted colour features with the gradient features, enhancing the lane features while greatly reducing the interference in the pixels. Next, we cut the extracted pixel feature maps in equal parts into several sub-maps and perform pixel statistics for each sub-map, replacing sub-maps with abnormal pixel values with adjacent sub-maps, which can effectively reduce noise. Finally, we use DBSCAN to cluster the pixels and fit the lane lines with least squares. The experimental results show that the method can effectively detect lane lines and has good robustness.

Computer Vision-Based Lane Detection and Detection of Vehicle, Traffic Sign, Pedestrian Using YOLOv5

There has been a global increase in the number of vehicles in use, resulting in a higher occurrence of traffic accidents. Advancements in computer vision and deep learning enable vehicles to independently perceive and navigate their environment, making decisions that enhance road safety and reduce traffic accidents. Worldwide accidents can be prevented in both driver-operated and autonomous vehicles by detecting living and inanimate objects such as vehicles, pedestrians, animals, and traffic signs in the environment, as well as identifying lanes and obstacles. In our proposed system, road images are captured using a camera positioned behind the front windshield of the vehicle. Computer vision techniques are employed to detect straight or curved lanes in the captured images. The right and left lanes within the driving area of the vehicle are identified, and the drivable area of the vehicle is highlighted with a different color. To detect traffic signs, pedestrians, cars, and bicycles around the vehicle, we utilize the YOLOv5 model, which is based on Convolutional Neural Networks. We use a combination of study-specific images and the GRAZ dataset in our research. In the object detection study, which involves 10 different objects, we evaluate the performance of five different versions of the YOLOv5 model. Our evaluation metrics include precision, recall, precision-recall curves, F1 score, and mean average precision. The experimental results clearly demonstrate the effectiveness of our proposed lane detection and object detection method.

PortLaneNet: A Scene-Aware Model for Robust Lane Detection in Container Terminal Environments

In this paper, we introduce PortLaneNet, an optimized lane detection model specifically designed for the unique challenges of enclosed container terminal environments. Unlike conventional lane detection scenarios, this model addresses complexities such as intricate ground markings, tire crane lane lines, and various types of regional lines that significantly complicate detection tasks. Our approach includes the novel Scene Prior Perception Module, which leverages pre-training to provide essential prior information for more accurate lane detection. This module capitalizes on the enclosed nature of container terminals, where images from similar area scenes offer effective prior knowledge to enhance detection accuracy. Additionally, our model significantly improves understanding by integrating both high- and low-level image features through attention mechanisms, focusing on the critical components of lane detection. Through rigorous experimentation, PortLaneNet has demonstrated superior performance in port environments, outperforming traditional lane detection methods. The results confirm the effectiveness and superiority of our model in addressing the complex challenges of lane detection in such specific settings. Our work provides a valuable reference for solving lane detection issues in specialized environments and proposes new ideas and directions for future research.

A LANE TRACKING ALGORITHM FOR LOW-COMPUTATIONAL-POWER MICROCONTROLLER-CONTROLLED AUTONOMOUS VEHICLE MODELS

At work, three tasks were presented: road lane detection and trajectory estimation, environment mapping, and the application of a neural network. All these tasks are based on the results of the lane detection method. The presented lane detection method stands out due to the execution of an interpolation transformation for all previously detected edge points. This transformation transfers these points to a “bird’s-eye” coordinate system and distributes them on a grid. Road lanes are identified by a lane feature filter based on the analysis of the distances between unique points. This allows lane views to be obtained in a coordinate system while preserving the distance condition. The road environment map is constructed from the obtained images using a probabilistic algorithm called Distributed Particle-SLAM (DP-SLAM). Based on the map result, a method for representing characteristic points describing the path of road lanes in each incoming camera image has been developed. These points are then used for training the neural network. The neural network solves a regression task for the coordinates of the points on the road lanes, enabling the identification of coefficients for parabolic fitting. Validation has been performed.

A Fast and Accurate Lane Detection Method Based on Row Anchor and Transformer Structure.

Lane detection plays a pivotal role in the successful implementation of Advanced Driver Assistance Systems (ADASs), which are essential for detecting the road's lane markings and determining the vehicle's position, thereby influencing subsequent decision making. However, current deep learning-based lane detection methods encounter challenges. Firstly, the on-board hardware limitations necessitate an exceptionally fast prediction speed for the lane detection method. Secondly, improvements are required for effective lane detection in complex scenarios. This paper addresses these issues by enhancing the row-anchor-based lane detection method. The Transformer encoder-decoder structure is leveraged as the row classification enhances the model's capability to extract global features and detect lane lines in intricate environments. The Feature-aligned Pyramid Network (FaPN) structure serves as an auxiliary branch, complemented by a novel structural loss with expectation loss, further refining the method's accuracy. The experimental results demonstrate our method's commendable accuracy and real-time performance, achieving a rapid prediction speed of 129 FPS (the single prediction time of the model on RTX3080 is 15.72 ms) and a 96.16% accuracy on the Tusimple dataset-a 3.32% improvement compared to the baseline method.

A Hybrid Global-Local Perception Network for Lane Detection

Lane detection is a critical task in autonomous driving, which requires accurately predicting the complex topology of lanes in various scenarios. While previous methods of lane detection have shown success, challenges still exist, especially in scenarios where lane markings are absent. In this paper, we analyze the role of global and local features in accurately detecting lanes and propose a Hybrid Global-Local Perception Network (HGLNet) to leverage them. Global and local features play distinct roles in lane detection by respectively aiding in the detection of lane instances and the localization of corresponding lanes. HGLNet extracts global semantic context by utilizing a global extraction head that aggregates information about adaptive sampling points around lanes, achieving an optimal trade-off between performance and efficiency. Moreover, we introduce a Multi-hierarchy feature aggregator (MFA) to capture feature hierarchies in both regional and local ranges, elevating the representation of local features. The proposed Hybrid architecture can simultaneously focus on global and local features at different depth levels and efficiently integrate them to sense the global presence of lanes and accurately regress their locations. Experimental results demonstrate that our proposed method improves detection accuracy in various challenging scenarios, outperforming the state-of-the-art lane detection methods.

Autonomous Lane Detection Car using Raspberry PI and Open CV

This research paper introduces an innovative method for real-time autonomous lane detection utilizing a Raspberry Pi embedded system and the OpenCV computer vision library. The primary objective is to improve vehicle navigation capabilities by precisely identifying lane boundaries from input video streams. The system's robust performance across diverse environmental conditions is achieved through the computational power of the Raspberry Pi platform and the flexibility of OpenCV. The methodology encompasses image preprocessing, lane detection algorithms, and seamless integration with the Raspberry Pi hardware. Through comprehensive experimental results, the proposed approach showcases its effectiveness and efficiency in autonomously detecting lanes. This research contributes to the development of safer and more reliable autonomous driving systems

StructLane: Leveraging Structural Relations for Lane Detection.

Accurately detecting the lanes plays a significant role in various autonomous and assistant driving scenarios. It is a highly structured task as lanes in the 3D world are continuous and parallel to each other. While most existing methods focus on how to inject structural priors into the representation of each lane, we propose a StructLane method to further leverage the structural relations among lanes for more accurate and robust lane detection. To achieve this, we explicitly encode the structural relations using a set of relational templates in a learned structural space. We then employ the attention mechanism to enable interactions between templates and image features to incorporate structural relational priors. Our StructLane can be applied to existing lane detection methods as a plug-and-play module to improve their performance. Extensive experiments on the widely used CULane, TuSimple, and LLAMAS datasets demonstrate that StructLane consistently improves the performance of state-of-the-art models across all datasets and backbones. Visualization results also demonstrate the robustness of our StructLane compared with existing methods due to the leverage of structural relations. Codes will be released at https://github.com/lqzhao/StructLane.

VANISHING POINT AIDED LANE DETECTION USING A MULTI-SENSOR SYSTEM

Abstract. Lane Detection is a critical component of an autonomous driving system that can be integrated alongside with High-definition (HD) map to improve accuracy and reliability of the system. Typically, lane detection is achieved using computer vision algorithms such as edge detection and Hough transform, deep learning-based algorithms, or motion-based algorithms to detect and track the lanes on the road. However, these approaches can contain incorrectly detected line segments with outliers. To address these issues, we proposed a vanishing point aided lane detection method that utilizes both camera and LiDAR sensors, and then employs a RANSAC-based post-processing method to remove potential outliers to improve the accuracy of the detected lanes. We evaluated this method on four datasets provided from the KITTI Benchmark Suite and achieved a total precision of 87%.

A Fast and Robust Lane Detection via Online Re-Parameterization and Hybrid Attention.

Lane detection is a vital component of intelligent driving systems, offering indispensable functionality to keep the vehicle within its designated lane, thereby reducing the risk of lane departure. However, the complexity of the traffic environment, coupled with the rapid movement of vehicles, creates many challenges for detection tasks. Current lane detection methods suffer from issues such as low feature extraction capability, poor real-time detection, and inadequate robustness. Addressing these issues, this paper proposes a lane detection algorithm that combines an online re-parameterization ResNet with a hybrid attention mechanism. Firstly, we replaced standard convolution with online re-parameterization convolution, simplifying the convolutional operations during the inference phase and subsequently reducing the detection time. In an effort to enhance the performance of the model, a hybrid attention module is incorporated to enhance the ability to focus on elongated targets. Finally, a row anchor lane detection method is introduced to analyze the existence and location of lane lines row by row in the image and output the predicted lane positions. The experimental outcomes illustrate that the model achieves F1 scores of 96.84% and 75.60% on the publicly available TuSimple and CULane lane datasets, respectively. Moreover, the inference speed reaches a notable 304 frames per second (FPS). The overall performance outperforms other detection models and fulfills the requirements of real-time responsiveness and robustness for lane detection tasks.