Review on the application of deep learning algorithms in video game AI agent

Abstract

AI algorithms have been applied in video games more than before. Since the early 2000s, the benchmark of the application of AI agent in video games has been put forward by researchers and engineers. This paper introduces the application of four different deep learning algorithms in video games, namely Component-based Hierarchical State Machine (CBHSM) algorithm, Monte Carlo Search Tree (MCTS) algorithm, Generative Adversarial Networks (GAN) algorithm, and the combination of A* algorithm and Q-learning algorithm. It can be summarized that both CBHSM and MCTS algorithms can modify and optimize the traditional Finite State Machine (FSM) algorithm applied in NPC (Non Player Characters) system. Additionally, A* algorithm can be combined with Q-learning algorithm to solve the problem of the difficulty on huge state space and limited time, and GAN algorithm, a model of unsupervised learning, can generate results by fewer training sets.