Abstract

In the maritime scene, visible light sensors installed on ships have difficulty accurately detecting the sea–sky line (SSL) and its nearby ships due to complex environments and six-degrees-of-freedom movement. Aimed at this problem, this paper combines the camera and inertial sensor data, and proposes a novel maritime target detection algorithm based on camera motion attitude. The algorithm mainly includes three steps, namely, SSL estimation, SSL detection, and target saliency detection. Firstly, we constructed the camera motion attitude model by analyzing the camera’s six-degrees-of-freedom motion at sea, estimated the candidate region (CR) of the SSL, then applied the improved edge detection algorithm and the straight-line fitting algorithm to extract the optimal SSL in the CR. Finally, in the region of ship detection (ROSD), an improved visual saliency detection algorithm was applied to extract the target ships. In the experiment, we constructed SSL and its nearby ship detection dataset that matches the camera’s motion attitude data by real ship shooting, and verified the effectiveness of each model in the algorithm through comparative experiments. Experimental results show that compared with the other maritime target detection algorithm, the proposed algorithm achieves a higher detection accuracy in the detection of the SSL and its nearby ships, and provides reliable technical support for the visual development of unmanned ships.

Highlights

  • In recent years, with the continuous development of artificial intelligence (AI), big data, and communication technology, unmanned driving technology has made breakthrough achievements.Unmanned aerial vehicles (UAVs) have gradually entered the civil field from the military field, and unmanned ground vehicles (UGVs) are continually testing on public roads around the world.The research on unmanned ships is developing rapidly

  • O at the sea level, r represents the radius of the earth, δ represents the angle of the ball, ε represents the difference of atmosphere refraction, the difference in the navigation is (1/13) δ, and the straight line OMwhich is expressed by De

  • The analysis results show that the LC estimation accuracy of the camera motion attitude model is 6–13 pixels, and the H estimation accuracy is 7–19 pixels. It can be seen from the experimental results that it is reasonable to estimate the rectangular area of the sea–sky line (SSL) by using the camera motion attitude model, and increase the height of 30 pixels above and below the estimate rectangular as the candidate region (CR) of the SSL, which can effectively ensure that the real SSL is in the CR

Read more

Summary

Introduction

With the continuous development of artificial intelligence (AI), big data, and communication technology, unmanned driving technology has made breakthrough achievements. The key technologies of unmanned ships mainly include situational awareness, intelligent decision-making, motion control, maritime communication, and shore-based remote control, etc., and situational awareness is the premise of all other technologies. Ships perceive the maritime environment mainly through two kinds of sensors, namely, radio detection and ranging (RADAR) and automatic identification system (AIS). They transmit the target information to the electronic chart display and information system (ECDIS), which realizes a certain degree of intelligent analysis and decision. With the continuous development of computer vision technology, visible light cameras as important situational awareness sensors are gradually being applied to unmanned ships, providing a reliable source of information for intelligent decision-making. This paper proposes an algorithm based on the motion attitude model of a visible light camera for the SSL and its nearby ships

Related Work
SSL Detection
Background Removal
Foreground Segmentation
Camera Six-Degrees-of-Freedom Motion Attitude Modeling
Influence of Camera Heaving and Pitching Motions on the Position of the SSL
Influence of Camera Heaving Motion
Influence of Camera Pitching Motion
Influence of Camera Rolling Motion on the Position of the SSL
Estimating the CR of the SSL
Edge Detection in the CR
Identifying the Optimal SSL with Improved Hough Transform
Visual Saliency Detection in the ROSD of the SSL
Experimental Results and Discussion
Dataset
Evaluation Metrics
Experimental Results and Discussion on SSL Detection
Experimental Results of Ship Detection in the Train Set
Experimental Results of Ship Detection in the Test Set
Conclusions
Full Text
Paper version not known

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call

Disclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.