Applying QDSEGA to the multi legged robot

Abstract

Reinforcement learning is very effective for robot learning. Because it does not need priori knowledge and has higher capability of reactive and adaptive behaviors. In our previous works, we proposed new reinforcement learning algorithm: “Q-learning with Dynamic Structuring of Exploration Space Based on Genetic Algorithm (QDSEGA)”. It is designed for complicated systems with large action-state space like a robot with many redundant degrees of freedom. And we applied it to 50 link manipulator and effective behavior is acquired. However optimality and fault tolerance of the proposed algorithm were not considered and to demonstrate effectiveness of the proposed algorithm other applications are necessary. Acquiring of locomotion patterns by a multi-legged robot is a very interesting problem. As it has many redundant degrees of freedom, application of usual reinforcement learning is difficult and an optimal locomotion has not been acquired using previous reinforcement learning algorithm. And the redundancy of the robot is effective to the fault tolerance and various locomotion patterns can be acquired for adapting the faults of the legs. In this paper, we applied QDSEGA to acquiring of locomotion pattern by the multi-legged robot and considered the optimality and fault tolerance. Effective behavior has been obtained by using our proposed algorithm.