Dance Movement Learning for Labanotation Generation Based on Motion-Captured Data

Min Li,Cong Ma,Zhenjiang Miao

doi:10.1109/access.2019.2951588

Min Li, Cong Ma + Show 1 more

Open Access

https://doi.org/10.1109/access.2019.2951588

Copy DOI

Abstract

Labanotation is a widely used notation system for recording body movements, especially dances. It has wide applications in choreography preservation, dance archiving, and so on. However, the manual creation of Labanotation scores is rather difficult and time-consuming. Therefore, research on the generation of Labanotation scores is of great interest. In this paper, we aim to generate Labanotation scores based on the motion-captured data obtained from real-world dance performances. First, to deal with challenges such as various dance movement patterns, different dancer shapes, and noises in the motion-captured data, we propose a novel feature that is invariant to anthropometric variation and body orientation. Then, we generate the notations of both lower-limb movements and upper-limb gestures. On the one hand, we utilize the hidden Markov model (HMM) to analyze the temporal dynamic characteristics of limb movements and map each lower limb movement to a corresponding dance notation. On the other hand, for upper limbs, we train a multi-class classifier based on the extremely randomized trees (Extra-Trees) to identify the notations for arm gestures. Finally, we generate the Labanotation symbols based on the above movement analysis and thus create Labanotation scores. The proposed methods can generate the spatial symbols describing directions and levels in both the support column and arm column based on motion-captured data. The generated scores are clear and reliable. Experimental results show an average recognizing accuracy of over 92% for the generated notations, which is significantly better than previous work.

Highlights

Folk dances and other performing arts are a valuable part of cultural heritage
We propose an anthropometric and orientation invariant dance movement feature based on the orientationnormalized relative joint position (ON-RJP) vector extracted from motion-captured data to represent the movement properties
In this paper, we aim to generate Labanotation scores based on motion-captured data

Summary

Introduction

Folk dances and other performing arts are a valuable part of cultural heritage. The recording and archiving of traditional folk dances have attracted considerable research interests in the recent decade [1]–[7]. In order to preserve and archive the performance of traditional dances, we need to record, process and reproduce human body motion by both quantitative and qualitative approaches. It is highly accepted that the Labanotation [8], [9] is a powerful tool for choreography, dance training, and the recording and analysis of the human body motion [10]–[14]. Labanotation [8] is one of the most popular standardized symbol systems for recording and analyzing human body movements in dances such as ballet. It was named after its inventor Rudolf Von Laban, who is an Austro-Hungarian dancer and choreographer. We hope to develop algorithms to generate the major Labanotation symbols from motion-captured data, alleviating the workload of dance recorders

Objectives

Methods

Findings

Discussion

Conclusion