Ship imaging trajectory extraction via an aggregated you only look once (YOLO) model

Abstract

Maritime traffic community has paid a huge amount of focuses to establish maritime intelligent transportation infrastructure for the purpose of enhancing maritime traffic safety and efficiency. Maritime surveillance video is considered as a type of fundamental data sources for establishing intelligent maritime transportation infrastructure towards smart ship era. To that end, the study proposes an aggregated deep learning model-supported ship imaging trajectory extraction framework. The proposed framework starts by detecting ships from maritime images via a novel You Only Look Once (YOLO) model. More specifically, the proposed ship trajectory extraction framework obtains ship positions in a frame-by-frame manner via the proposed poly-YOLO module. Then, the proposed model maps ship positions in neighboring consecutive maritime images via an Enhanced Deep Sort (EDS) module. Experimental results suggest that the proposed ship trajectory extraction model achieves satisfactory performance due to that the average values of index multiple-object tracking accuracy (MOTa), recall rate (Rid) and index aggregated detection accuracy (Aggid) are larger than 89% (which outperform the comparison algorithms). The study can help varied maritime traffic participants obtain accurate on-site traffic situations in the smart ship era.