Abstract Aiming at the problem of Unmanned Surface Vessel (USV) avoiding dynamic vessels on the sea surface, an Artificial Potential Field method based on Velocity Obstacle Method (VO-APF) was studied. Under the premise of complying with the Convention on the International Regulations for Preventing Collisions at Sea (COLREGs), the overlapping of ship domains is minimized. The Quaternion ship domain was introduced into VO to make it more suitable for collision avoidance judgment in the ship domain, and the collision avoidance time of the ship was predicted, and the reasonable obstacle avoidance point was finally obtained. The attraction function of the obstacle avoidance target point and the repulsion function of the ship domain based on the APF are set, and the USV is subjected to the repulsion force and attraction in the APF, and finally completes the whole dynamic ship collision avoidance task. In the simulation environment, VO, APF and VO-APF were compared in three different encounter situations. The results show that VO-APF can help USV to complete the collision avoidance task under the premise of complying with COLREGs, and the overlap time between USV’s own ship domain and the other ship domain is the shortest, and the safety degree is the highest.