Real-time classification of pedestrians and cyclists for intelligent counting of non-motorized traffic

Abstract

We propose a real-time method for counting pedestrians and bicyclists by classifying bulks of asynchronous events generated upon scene activities by an event-based 3D dynamic vision system. The inherent detection of moving objects offered by the 3D dynamic vision system comprising a pair of dynamic vision sensors allows event-based stereo vision in real-time and a 3D representation of moving objects. A clustering method exploits the sparse spatio-temporal representation of sensor's events for real-time detection and separation between moving objects. The method has been demonstrated for clustering the events and classification of pedestrian and cyclists moving across the sensor field of view based on their dimensions and passage duration. Tests on real scenarios with more than 100 cyclists and pedestrians yield a classification performance above 92%.