Abstract
Multiple sensorial media (mulsemedia) combines multiple media elements which engage three or more of human senses, and as most other media content, requires support for delivery over the existing networks. This paper proposes an adaptive mulsemedia framework (ADAMS) for delivering scalable video and sensorial data to users. Unlike existing two-dimensional joint source-channel adaptation solutions for video streaming, the ADAMS framework includes three joint adaptation dimensions: video source, sensorial source, and network optimization. Using an MPEG-7 description scheme, ADAMS recommends the integration of multiple sensorial effects (i.e., haptic, olfaction, air motion, etc.) as metadata into multimedia streams. ADAMS design includes both coarse- and fine-grained adaptation modules on the server side: mulsemedia flow adaptation and packet priority scheduling. Feedback from subjective quality evaluation and network conditions is used to develop the two modules. Subjective evaluation investigated users' enjoyment levels when exposed to mulsemedia and multimedia sequences, respectively and to study users' preference levels of some sensorial effects in the context of mulsemedia sequences with video components at different quality levels. Results of the subjective study inform guidelines for an adaptive strategy that selects the optimal combination for video segments and sensorial data for a given bandwidth constraint and user requirement. User perceptual tests show how ADAMS outperforms existing multimedia delivery solutions in terms of both user perceived quality and user enjoyment during adaptive streaming of various mulsemedia content. In doing so, it highlights the case for tailored, adaptive mulsemedia delivery over traditional multimedia adaptive transport mechanisms.
Highlights
T HE latest rich media services including video streaming, voice over IP, video conferencing, on-line gaming, social networking, etc, require high bandwidth networks for their distribution to users
This paper proposes an ADAptive MulSemedia delivery solution (ADAMS) for end-user quality of experience enhancement
The UDP agents carried traffic generated by Constant Bit Rate (CBR) applications and the TCP agents transported File Transfer Protocol (FTP) application traffic
Summary
T HE latest rich media services including video streaming, voice over IP, video conferencing, on-line gaming, social networking, etc, require high bandwidth networks for their distribution to users. Despite the increased bandwidth availability, the exponential growth in the number of users, coupled with growing network resource requirements of the most popular applications, makes for an uphill battle to support high quality for these services This is especially true for multimedia-based services, more sensitive to network delivery factors. Against this background, diverse solutions have been proposed to increase user perceived quality, including adaptive multimedia delivery schemes [1]–[3]. This system can be extended by including more human sensory-related media objects such as humidity, temperature, etc Making use of this mulsemedia presentation tool, subjective experimental tests were performed and their results indicate how ADAMS provides high levels of user experience, especially in terms of enjoyment of sensorial effects, under highly loaded network conditions.
Sign-in/Register to view highlights & summary Sign-in/Register to access full text options 
Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have
Schedule a callDisclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.
