Real-Time Traffic Congestion Information from Tweets Using Supervised and Unsupervised Machine Learning Techniques

Abstract

For many decades automated sensors, such as acoustic, optical, pneumatic, magnetic, inductive sensors and video-based image processing solutions were used for collecting data on traffic flow, speed, density, travel time etc. Using these data, the level of congestion is indirectly estimated. However, most of these sensors are costly and location-based. In addition, they cannot find the reason for congestion. To address these limitations, use of social media as a source of traffic information has been explored recently. Some of them, such as Twitter, are open source and popular throughout the world. Earlier studies that reported the use of Twitter feeds for traffic information are limited and used machine-learning techniques based on supervised learning, which needs labelled data that are difficult to obtain. Hence, this paper compares the unsupervised and supervised approaches to extract traffic-related tweets and develops a method to give the probability of level of congestion in real-time. The methods developed were applied to the tweets from Chennai city to extract the congestion information in real time, the results were validated through newspaper reports of heavy traffic congestion events. The obtained results showed a good correlation with the real congestion events.