Implementation of Multimodal Interactive Continuous Scoring for 3D Quality of Experience

Abstract

When watching videos in 3D space, viewers perceive dynamic levels of quality of experience accompanied by visual immersion. To measure these dynamics, a reliable methodology is needed to gauge subjective viewer experience. This paper proposes a new methodology called multimodal interactive continuous scoring of quality (MICSQ). MICSQ is comprised of device interaction processes between the 3D display and tablet assessment tool and human interaction processes between the subject and tablet. When MICSQ device interaction takes place over wireless network protocols, such as TCP/IP or Bluetooth, it efficiently handles the diverse viewing environment. Therefore, there is a high degree of freedom to perform subjective assessment in certain viewing environments in terms of multimodal cues (aural and tactile senses), diverse illumination conditions including darkness, handheld portability over wireless networks, and real-time recording. Moreover, it is also possible for multiple subjects to simultaneously perform assessments in a large space, such as a movie theater. For the simulations, the server application in the 3D display was developed in Java, and the tablet device client application was developed with a mobile software development kit and functions optimally in commercial tablets. The experimental results demonstrate that MICSQ shows a higher reliability than the conventional single stimulus continuous quality evaluation method through the proposed implementation on a commercial tablet PC.