Abstract
AbstractSewer sedimentation tanks accumulate a lot of sludge all year round and require a lot of labor and resources to clean up. Such underwater cleaning has many difficulties in cleaning works. Desilting robots are widely used in sludge cleaning to reduce labor. However, since this method is usually planned based on manual experience, the operation is inefficient, not intelligent, and requires a certain amount of labor. To enable the desilting robot to intelligently plan rational cleaning paths, it uses the complete coverage path planning (CCPP) algorithm. Existing CCPP cannot meet the requirements of various environments. Therefore, in this paper, we propose to use the deep reinforcement learning (DRL) algorithm to learn the sewer sedimentation tank environment and to find the optimal cleaning path. Experiments show that 2000 episodes are trained in a simplified simulation environment using deep Q network (DQN) and double DQN (DDQN), respectively. DQN only got a cumulative reward of 1000 in the 1228th episode, while DDQN got a cumulative reward of 8000 in the 343rd episode and completed the task. Therefore, the slag removal robot using DDQN as the control strategy can adaptively complete the CCPP problem.KeywordsSewer sedimentation tankDesilting robotCCPPDeep reinforcement learning
Published Version
Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have
Schedule a call