Abstract
Recently, innovative technologies such as Virtual Reality (VR), Augmented Reality (AR), Mixed Reality (MR), and Multi-Sensorial Media (mulsemedia) have introduced new sensorial effects including vibration, smell, airflow, etc. to human life. These effects which have been largely deployed for entertainment, and gaming have positively impacted user satisfaction. This paper explores the potential of mulsemedia in the education context. It describes a novel Dynamic Adaptive Streaming over HTTP (DASH)-based Multi-sensory Media Delivery Solution (DASHMS) which supports adaptive mulsemedia content distribution based on the operational environment which includes network, device, and user settings.DASHMS was evaluated in a real-life educational experiment involving 44 students in an Irish university. The evaluation focused on both learner satisfaction, and the impact on learning. The results demonstrate the potential of adaptive multi-sensorial media delivery to result in a statistically significant increase in user experience. In terms of benefit to learning outcomes however, it was only memory recall which was statistically improved in the experiment.
Highlights
According to the most recent Cisco Internet traffic statistics report [1], the global Internet video traffic over IP which accounted for 72% of all IP data traffic in 2017 is expected to reach 80% in 2022 and the virtual and augmented reality traffic will increase more than 12-fold between 2017 and 2022
DASHMS performs the adaptation according to user operational environment, which can include network, device characteristics and user settings
NEWTON has developed diverse solutions based on innovative technologies for adaptive and personalised multimedia, multi-sensorial media delivery, Virtual and Augmented Reality (VR/AR) learning, Virtual Teaching and Learning Labs (Virtual Labs), Fabrication Labs (Fab Labs) and Gamificationbased teaching and learning
Summary
According to the most recent Cisco Internet traffic statistics report [1], the global Internet video traffic over IP which accounted for 72% of all IP data traffic in 2017 is expected to reach 80% in 2022 and the virtual and augmented reality traffic will increase more than 12-fold between 2017 and 2022. Research and technology developments usually target two human senses and focus on improving the image and/or sound quality. This limitation stimulates the disconnection between the user and represented scene, undermining the enhancement of the interaction in digital media through combinations of audiovisual content with one or several types of other stimuli (e.g., haptic, olfactory). This paper describes the proposed DASH-based Multi-Sensory Media Delivery Solution (DASHMS) which extends DASH to support mulsemedia components. This paper describes a study which evaluated a real life student learning process, including user experience when classic audiovisual content was delivered along with multisensorial media elements such as tactile, wind and olfaction.
Sign-in/Register to view highlights & summary Sign-in/Register to access full text options 
Free) 
Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have
Schedule a call
