Free-space human interface for interactive music, full-body musical instrument, and immersive media controller

Abstract

Method and apparatus entraining interactive media players into a sustained experience of 'Kinesthetic Spatial Sync' defined as a perceived simultaneity and spatial superposition between a non-tactile, full body input control process and immersive multisensory feedback. Asynchronous player input actions and clock-synchronous media feedback events exhibit a seamless synesthesia or multisensory events fused into an integral event perception, this being between musical sound (hearing), visual responses (sight), and body kinesthetic (radial extension, angular position, height, speed, timing and precision). This non-tactile interface process and multisensory feedback “look and feel” is embodied as an optimal ergonomic human interface for interactive music and as a six-degrees-of-freedom full-body-interactive immersive media controller 1. The invention provides for a wide scope of fully reconfigurable transfer functions between kinesthetic input features and media responses ( Creative Zone Behaviors) managed by means of MIDI protocol and/or display interface commands.