Novel method for using Q-learning in small microcontrollers

Abstract

A novel method for the utilizations of the Q-learning algorithm for small robot navigation is presented in this paper. The Q-learning algorithm usually requires a large amount of memory for its implementation. In this paper a novel method for implementing the Q-learning algorithm is proposed in order to reduce the amount of memory required. The benefit of using less memory is so that the algorithm can be implemented in systems with reduced amount of memory available, such as small mobile robots or robots that need a large size of memory devoted to other applications besides navigation. The Q-learning algorithm generates a map of the surrounding area by using inputs to sensors attached to the robot. The Q-learning algorithm developed makes a map of a static surrounding, the algorithm was developed using a BASIC Stamp.