Rendering Strategy to Counter Mutual Masking Effect in Multiple Tactile Feedback

Semin Ryu,Dong-Soo Kwon,Dongbum Pyo,Soo-Chul Lim

doi:10.3390/app10144990

Abstract

Recently, methods and devices that simultaneously utilize two or more tactile feedback types have been proposed for more immersive interaction with virtual objects. However, the masking effect, which makes us less sensitive to various stimuli presented at the same time, has scarcely been explored. In this study, we propose a novel tactile rendering algorithm that can eliminate the mutual masking effect at the user’s sensation level, when mechanical vibration and electrovibration are applied simultaneously. First, the masking functions of the two stimuli were investigated for various stimulus combinations. Based on these, a generalized form of the masking function was derived. We then tested and confirmed that the proposed algorithm, which calculates the required stimulus intensity to compensate for the mutual masking effect, could render the arbitrary stimulus intensity desired to be perceived by the users. The results of the user test revealed that the proposed rendering algorithm significantly improved the virtual object recognition rate by approximately 23% when geometry and texture were presented jointly. This finding suggests principal guidelines for the combined use of mechanical vibration and electrovibration, as well as for other combinations of different tactile feedback types.

Highlights

With the advancement of mobile devices and virtual reality systems, the demand for haptic technology is rapidly growing as it can drastically improve the user’s experience.methods and devices that simultaneously utilize two or more tactile feedback types have been recently proposed for more immersive interaction with virtual objects
In the current study, we focused on investigating and overcoming the mutual masking effect when two types of tactile information are provided at the same time, rather than on showing that the combination of EV and mechanical vibration (MV) is effective for texture and geometry representation
We proposed a rendering algorithm that can compensate for the mutual masking effect at the user’s sensation level, when MV and EV are presented simultaneously to the fingertip

Summary

Introduction

Methods and devices that simultaneously utilize two or more tactile feedback types have been recently proposed for more immersive interaction with virtual objects. There are four types of highly sensitive mechanoreceptive units in the human hand These units actively respond to different tactile feedback types, including pressure, shear stretch, and low- and high-frequency vibrations [1,2,3]. In this regard, researchers have proposed to simultaneously use two tactile feedback types, and the feasibility of presenting multiple tactile information, such as shape (geometry) and texture, has been demonstrated [4,5,6].

Objectives

Methods

Results

Discussion

Conclusion