Optimizing robotic arm control using deep Q-learning and artificial neural networks through demonstration-based methodologies: A case study of dynamic and static conditions

Abstract

This paper uses robot programming techniques, such as Deep Q Network, Artificial Neural Network, and Artificial Deep Q Network, to address challenges related to controlling robotic arms through demonstration learning. Static and dynamic states of the subjects were the subjects of experiments. Each method's classification accuracy process success values and experimental condition combination were evaluated. The DQN method demonstrated favourable classification accuracy outcomes, achieving an Accuracy value of 0.64 for the fixed dice and 0.52 for the moving dice. The Response value was 0.51 for the fixed dice and 0.41 for the moving dice, indicating a moderate level. The ANN method demonstrated lower accuracy, with Accuracy values of 0.59 and 0.56 and Response values of 0.61 and 0.58, respectively. The ADQN method demonstrated superior outcomes, with Accuracy values of 0.66 and 0.59 and Response values of 0.67 and 0.61. During the initial learning iterations, ADQN demonstrated the highest success rate at 33.67 %, whereas DQN and ANN achieved 28.39 % and 20.13 % success rates, respectively. As the number of iterations increased, all methods demonstrated improvement in their results. ADQN maintained a high success rate of 97.59 %, while DQN and ANN attained 82.16 % and 88.66 %, respectively. As the number of iterations increases, the results of all methods improve, but the success rate of the Artificial Deep Q Network remains high. As the number of iterations increases, both Deep Q Network and Artificial Neural Network demonstrate the potential to achieve good results. Overall, the findings support the efficacy of robot programming techniques that incorporate demonstration learning. The Artificial Deep Q Network is the most successful and fast-converging method suitable for various robot control tasks. These findings provide a foundation for future research and large-scale, comprehensive learning applications for complex rot control.