Traffic Light Detection Research Articles

Deep traffic light detection by overlaying synthetic context on arbitrary natural images

Deep neural networks come as an effective solution to many problems associated with autonomous driving. By providing real image samples with traffic context to the network, the model learns to detect and classify elements of interest, such as pedestrians, traffic signs, and traffic lights. However, acquiring and annotating real data can be extremely costly in terms of time and effort. In this context, we propose a method to generate artificial traffic-related training data for deep traffic light detectors. This data is generated using basic non-realistic computer graphics to blend fake traffic scenes on top of arbitrary image backgrounds that are not related to the traffic domain. Thus, a large amount of training data can be generated without annotation efforts. Furthermore, it also tackles the intrinsic data imbalance problem in traffic light datasets, caused mainly by the low amount of samples of the yellow state. Experiments show that it is possible to achieve results comparable to those obtained with real training data from the problem domain, yielding an average mAP and an average F1-score which are each nearly 4 p.p. higher than the respective metrics obtained with a real-world reference model.

Real-Time Traffic Light Detection with Frequency Patterns Using a High-Speed Camera

LEDs are widely employed as traffic lights. Because most LED traffic lights are driven by alternative power, they blink at high frequencies, even at twice their frequencies. We propose a method to detect a traffic light from images captured by a high-speed camera that can recognize a blinking traffic light. This technique is robust under various illuminations because it can detect traffic lights by extracting information from the blinking pixels at a specific frequency. The method is composed of six modules, which includes a band-pass filter and a Kalman filter. All the modules run simultaneously to achieve real-time processing and can run at 500 fps for images with a resolution of 800 × 600. This technique was verified on an original dataset captured by a high-speed camera under different illumination conditions such as a sunset or night scene. The recall and accuracy justify the generalization of the proposed detection system. In particular, it can detect traffic lights with a different appearance without tuning parameters and without datasets having to be learned.

MBBNet: An edge IoT computing-based traffic light detection solution for autonomous bus

Abstract Traffic light detection is a key module in the autonomous driving system to enhance the interactions between drivers and unmanned vehicles. In recent studies, deep neural networks are widely used for traffic light detection and resource/power consumption is a major concern for model deployment in vehicular edge devices. This paper proposes a novel light-weight deep CNN model that integrates the multi-backbone of state-of-the-art architectures for the self-driving traffic light detection. The MBBNet (Multi-BackBone Network) consists of three common convolutional backbones, i.e., the normal, residual and highway (DenseNet) convolutional modules. Simple ensemble of those backbones may incur high computational load. Therefore, channel compression is adopted to control the model parameters, while guaranteeing the accuracy for mobile and embedded hardware. Evaluation of a dataset collected from real road conditions demonstrate the robustness of our detection system, and it achieves higher accuracy (accuracy > 0.94 and A v e r a g e _ I O U > 74.05 % ) for self-driving buses. In terms of resource consumption, the trained model size is 1.35 MB, and can process high-resolution images (1280 × 960) at 14 FPS (frames per second) on low-power edge devices.

Traffic Light Detection in Autonomous Driving Systems

Vision-only systems are currently very popular for use in autonomous driving systems and advanced driver-assistance systems. These systems operate by using input images from a camera and no other sensors. One of the tasks these systems needs to perform is the detection and understanding of traffic lights in a traffic environment, by localizing all relevant traffic lights in an image received from an on board camera mounted on the vehicle. This article proposes a traffic light recognition system where adaptive thresholding and deep learning are used for region proposal and traffic light localization, respectively. The LISA open-source dataset is used along with custom augmentation methods in order to increase the number of available data samples. Performance of the developed system is presented in the form of true and false positive rates obtained on the test data. The classification part of the algorithm gives a total of 89.60% true detection rate, while the regression part of the model produced a correct location of the traffic light in 92.67% of cases.

Understanding the Perception of Road Segmentation and Traffic Light Detection u sing Machine Learning Techniques

Advanced Driving Assistance System (ADAS) has seen tremendous growth over the past 10 years. In recent times, luxury cars, as well as some newly emerging cars, come with ADAS application. From 2014, Because of the entry of the European new car assessment programme (EuroNCAP) [1] in the AEBS test, it helped gain momentum the introduction of ADAS in Europe [1]. Most OEMs and research institutes have already demonstrated on the self-driving cars [1]. So here, a focus is made on road segmentation where LiDAR sensor takes in the image of the surrounding and where the vehicle should know its path, it is fulfilled by processing a convolutional neural network called semantic segmentation on an FPGA board in 16.9ms [3]. Further, a traffic light detection model is also developed by using NVidia Jetson and 2 FPGA boards, collectively named as 'Driving brain' which acts as a super computer for such networks. The results are obtained at higher accuracy by processing the obtained traffic light images into the CNN classifier [5]. Overall, this paper gives a brief idea of the technical trend of autonomous driving which throws light on algorithms and for advanced driver-assistance systems used for road segmentation and traffic light detection.

An Insight into Traffic Light Discernment and Cognizance using Support Vector Machine, Multi Class Learning and Deep Learning Concepts

This paper principally combines ideas of laptop vision, machine learning and deep learning for correct detection of traffic lights and their classifications. It checks for each circular and arrow stoplight cases. Color filtering and blob discover ion area unit principally to detect the candidates (traffic lights) [6]. Then, a PCA network is employed as a multiclass classifier which provides the result sporadically. MOT will used for more trailing method and prediction filters out false positives. Sometimes, vote theme can even be used rather than MOT. This method will be simply fitted into ADAS vehicles once hardware thinks about. Recognition is as vital as detective work the traffic lights. While not recognition, no full data will be transmitted [2]. Many complicated TLR’s will give advance functions like observing the most the most for a specific route (when there's quite one) and the way removed from the driving force [3]. Deep learning is additionally one among the rising techniques for analysis areas [7]. Object detection comes as associate integral a part of laptop vision. Object detection will be best utilized in create estimation, vehicle detection, police work etc. In detection algorithms, we tend to incline to draw a bounding box round the object of interest to find it among the image. Also, the drawing of the bounding box isn't distinctive and might hyperbolically looking on the need [9].

Hybrid strategy for traffic light detection by combining classical and self‐learning detectors

Detection of the traffic light is a key function of the automatic driving system for urban traffic. Considering the characteristics of classical and self-learning algorithms, a fusion logic is proposed to make up the shortcoming of learning algorithms by combining the known knowledge with the learning features to detect the red and yellow–green traffic light without turn indicator. The relationship of detection performance among different detectors is established analytically. Then the improvement of detection performance by fusion is analysed theoretically and optimised numerically. According to the analysis results, the hybrid detector is designed by using the colour information in hue-saturation-intensity to extract the candidate region, the hog feature to identify the shape information of traffic light classified by a support vector machine, and a comparatively simple convolutional neural network (CNN) with the classical AlexNet structure to act as the self-learned detector. The effectiveness of the hybrid method is validated by several comparative tests with single CNN detectors and other fusion methods on the training dataset, and the extensibility to new application conditions is evaluated by vehicle tests.

Robust Traffic Light and Arrow Detection Using Digital Map with Spatial Prior Information for Automated Driving.

Traffic light recognition is an indispensable elemental technology for automated driving in urban areas. In this study, we propose an algorithm that recognizes traffic lights and arrow lights by image processing using the digital map and precise vehicle pose which is estimated by a localization module. The use of a digital map allows the determination of a region-of-interest in an image to reduce the computational cost and false detection. In addition, this study develops an algorithm to recognize arrow lights using relative positions of traffic lights, and the arrow light is used as prior spatial information. This allows for the recognition of distant arrow lights that are difficult for humans to see clearly. Experiments were conducted to evaluate the recognition performance of the proposed method and to verify if it matches the performance required for automated driving. Quantitative evaluations indicate that the proposed method achieved 91.8% and 56.7% of the average f-value for traffic lights and arrow lights, respectively. It was confirmed that the arrow-light detection could recognize small arrow objects even if their size was smaller than 10 pixels. The verification experiments indicate that the performance of the proposed method meets the necessary requirements for smooth acceleration or deceleration at intersections in automated driving.

Traffic Light Detection and Recognition for Self Driving Cars using Deep Learning Survey

Traffic Light Detection and Recognition for Self Driving Cars using Deep Learning Survey

Deep CNN-Based Real-Time Traffic Light Detector for Self-Driving Vehicles

Due to the unavailability of Vehicle-to-Infrastructure (V2I) communication in current transportation systems, Traffic Light Detection (TLD) is still considered an important module in autonomous vehicles and Driver Assistance Systems (DAS). To overcome low flexibility and accuracy of vision-based heuristic algorithms and high power consumption of deep learning-based methods, we propose a lightweight and real-time traffic light detector for the autonomous vehicle platform. Our model consists of a heuristic candidate region selection module to identify all possible traffic lights, and a lightweight Convolution Neural Network (CNN) classifier to classify the results obtained. Offline simulations on the GPU server with the collected dataset and several public datasets show that our model achieves higher average accuracy and less time consumption. By integrating our detector module on NVidia Jetson TX1/TX2, we conduct on-road tests on two full-scale self-driving vehicle platforms (a car and a bus) in normal traffic conditions. Our model can achieve an average detection accuracy of 99.3 percent (mRttld) and 99.7 percent (Rttld) at 10Hz on TX1 and TX2, respectively. The on-road tests also show that our traffic light detection module can achieve $ ± 1 . 5 m errors at stop lines when working with other self-driving modules.

Design and Optimization of a Deep Neural Network Architecture for Traffic Light Detection

Autonomous Driving has recently become a research trend and efficient autonomous driving system is difficult to achieve due to safety concerns, Applying traffic light recognition to autonomous driving system is one of the factors to prevent accidents that occur as a result of traffic light violation. To realize safe autonomous driving system, we propose in this work a design and optimization of a traffic light detection system based on deep neural network. We designed a lightweight convolution neural network with parameters less than 10000 and implemented in software. We achieved 98.3% inference accuracy with 2.5 fps response time. Also we optimized the input image pixel values with normalization and optimized convolution layer with pipeline on FPGA with 5% resource consumption.

Dual Model-based Traffic Light and Sign Detection using Prior Information

Dual Model-based Traffic Light and Sign Detection using Prior Information

基于优化YOLOv3算法的交通灯检测

基于优化YOLOv3算法的交通灯检测

Coarse-to-fine Method for Vision-based Pedestrian Traffic Light Detection

Pedestrian traffic light detection is an important technique of the navigation system for the visually impaired during road crossing. In this paper, a three-stage coarse-to-fine method ...

Real-Time Traffic Light Detection and Interpretation using Circle Centroid

The paper proposes a new method to recognize the sequence of a traffic light using image processing algorithm. Invariant in factor lightning and weather condition that lead to misinterpret the color of traffic light is one of the factors of accident at traffic light conjunction besides the behavior of the driver itself. The process to identify the color and shape of traffic light are Image Acquisition, Pre-Processing, Detection, Feature Extraction and Interpretation. RGB normalization is performed and simple thresholding method that acts as color segmentation provides a better division of the traffic light colors. Circle Hough Transform and HSV color features based on the traffic light aspect are used to decide whether the spots on the frames are likely to be traffic lights’ color and shape. The detection of traffic light will be obtained after identifying the feature such as the centroid of the Circle Hough Transform that need to be extracted at the end of the result. The research has been improved by focusing on detection and interpretation of traffic light based on real time video rather than image sample as the input. The proposed algorithm can detect the green color accurately with maximum accuracy of 83.8%, yellow color of 75.6% and red color with minimum accuracy of 70.19%. This indicates that there is a possibility to use the proposed algorithm to detect the three different color of green, yellow and red color of traffic lights’ colour.

Detection of Traffic Light using Machine Vision for Autonomous Vehicles Application

Traffic light detection is crucial to decrease the traffic light accidents at intersections and to realize autonomous driving. There are so many existing methods to detect traffic light. However, these approaches have several limitations, such as not function well in complex driving environments. Hence, to overcome such constraints, the traffic light detection for the autonomous vehicle using image processing technique is proposed. The experiments are carried out using 114 scene images that consist of 209 traffic lights with different angles, weather conditions, and distance. An image processing technique, Hough Circle Transform is used in this traffic light detection system with the help of Gaussian blurring and Sobel filter. So, the overall accuracy rate for the proposed algorithm is 75.59%. This system is possible to be used in urban areas or complex environments, whether it is at night or day, and it able to detect the traffic light regardless of the colour changes.

Traffic Light Detection Method for Underground CO2 Injection–Induced Seismicity

AbstractPressure buildup induced by geological carbon sequestration (GCS) will decrease the effective stresses in the storage formation, and geomechanical effects of overpressure may affect fault s...

Real Time Traffic Light Detection by Autonomous Vehicles using Artificial Neural Network Techniques

Autonomous vehicles are the reality of the future, they will open up the way for future advanced systems where computers are expected to take over the decision making of driving. These automobiles are capable of sensing their environment and moving with little or no human input. The main goal of this research is to detect traffic light in real-time for autonomous vehicles. Apart from taking decisions to navigate in the right manner the autonomous vehicles important task is to detect traffic lights, so that it can obey the traffic rules with sufficient precision. The work carried out in this research makes use of two Artificial Intelligence technique, these techniques are compared in accomplishing the task of traffic light detection in real time. The two models that are designed and implemented are Convolution neural network (CNN) and Deep Convolution Inverse Graphics Network (DCIGN). The results clearly show that DCIGN out performance CNN by 8%.

Traffic Light Detection for Red Light Violation System

Traffic Light Detection for Red Light Violation System

Accurate traffic light detection using deep neural network with focal regression loss

This paper proposes a method that uses a deep neural network (DNN) to detect small traffic lights (TLs) in images captured by cameras mounted in vehicles. The proposed TL detector has a DNN architecture of encoder-decoder with focal regression loss; this loss function reduces loss of well-regressed easy examples. The proposed TL detector has freestyle anchor boxes that are placed at arbitrary locations in a grid cell of an input image, so it can detect small objects located at borders of the grid cell. We evaluate the proposed TL detector with a focal regression loss on two public TL datasets: Bosch small traffic light dataset, and LISA traffic lights dataset. Compared to state-of-the-art TL detectors, the proposed TL detector achieves 7.19%–42.03% higher mAP on the Bosch-TL dataset and 19.86%–49.16% higher AUC on the LISA-TL dataset.