PhyCoVIS: A visual analytic tool of physical coordination for cheer and dance training

Abstract

AbstractProcessing and analyzing dance videos are important in the application of online cheer leading and dance training for physical coordination measurement. However, it is challenging for users to evaluate a massive amount of uploaded video, to precisely quantize and compare dance moves, and to visualize training results. To overcome these challenges, we propose a visualization‐driven approach for analyzing dance videos. We first encode extracted video frames into a set of heat maps via neural network, which calculates a skeleton structure for pose estimation with enhanced post‐processing to help capture dance moves. A subsequent pose similarity method allows users to quantize differences between student training videos and the standard one. Finally, an interactive visualization tool enables users and domain experts to interactively analyze the quality of dance moves along the time line. We demonstrate the applicability and effectiveness of our proposed tool using case studies involving physical coordination research.