Visualization of math expressions through modality-nonspecific signals

Abstract

Acquiring reasonable math skills is essential for the visually disabled pupils and students. Research in electro-tactile pattern perception has shown that involving the resources of visual cortex into acquisition of tactile percepts augments comprehension of the encoded information for users with a sensory limitation. This paper describes matching software designed to facilitate the learning process of 13 electro-tactile patterns (eTPs) denoting eight math numbers and five arithmetic operators. Electro-tactile unit and software were used to shape stabilized monophasic current pulses provided through the pen coated with embedded double-strip ring type electrode. The performance of ten subjects was investigated in terms of the number of repetitions required to memorize and match the eTPs, and in terms of the recognition error committed in the matching phase of the test. The analysis of the data collected indicated that the novice-to-expert transition was significantly above chance when the results obtained in the first and the last test sessions were statistically compared. A permutation puzzle game which was also designed to induce the same ten blindfolded players to mobilize the perceptive skills and deploy individual playing tactics to manipulate the eTPs encoding math numbers and expressions for rebuilding simple arithmetic equations. The results of the use of the proposed gameplay technique are discussed. Upon learning and training, the eTPs could be employed to assign math numbers and arithmetic operators to communicate mathematics content.