Making motion matching stable and fast with Lipschitz-continuous neural networks and Sparse Mixture of Experts

Abstract

Motion matching has become a widely adopted technique for generating high-quality interactive animation systems in video games. However, its current implementations suffer from significant computational and memory resource overheads, limiting its scalability in the context of modern video game performance profiles.Our method significantly reduces the computational complexity of approaches to motion synthesis, such as “Learned Motion Matching”, while simultaneously improving the compactness of the data that can be stored and the robustness of pose output. As a result, our method enables the efficient execution of motion matching that significantly outperforms other implementations, by 8.5× times in CPU execution cost and at 80% of the memory requirements of “Learned Motion Matching”, on contemporary video game hardware, thereby enhancing its practical applicability and scalability in the gaming industry and unlocking the ability to apply on large numbers of animated in-game characters.In this paper, we expand upon our published paper “Learning Robust and Scalable Motion with Lipschitz Continuity and Sparse Mixture of Experts”, where we successfully proposed a novel method for learning motion matching that combines a Sparse Mixture of Experts model architecture and a Lipschitz-continuous latent space for representation of poses. We present further details on our method, with extensions to our approach to expert utilization within our neural networks.