Abstract
Visually impaired visitors experience many limitations when visiting museum exhibits, such as a lack of cognitive and sensory access to exhibits or replicas. Contemporary art is evolving in the direction of appreciation beyond simply looking at works, and the development of various sensory technologies has had a great influence on culture and art. Thus, opportunities for people with visual impairments to appreciate visual artworks through various senses such as hearing, touch, and smell are expanding. However, it is uncommon to provide a multi-sensory interactive interface for color recognition, such as integrating patterns, sounds, temperature, and scents. This paper attempts to convey a color cognition to the visually impaired, taking advantage of multisensory coding color. In our previous works, musical melodies with different combinations of pitch, timbre, velocity, and tempo were used to distinguish vivid (i.e., saturated), light, and dark colors. However, it was rather difficult to distinguish among warm/cool/light/dark colors with using sound cues only. Therefore, in this paper, we aim to build a multisensory color-coding system with combining sound and poem such that poem leads to represent more color dimensions, such as including warm and cool colors for red, orange, yellow, green, blue, and purple. To do this, we first performed an implicit association test to identify the most suitable poem among the candidate poems to represent colors in artwork by finding the common semantic directivity between the given candidate poem with voice modulation and the artwork in terms of light/dark/warm/color dimensions. Finally, we conducted a system usability test on the proposed color-coding system, confirming that poem will be an effective supplement for distinguishing between vivid, light, and dark colors with different color appearance dimensions, such as warm and cold colors. The user experience score of 15 college students was 75.1%, that was comparable with the color-music coding system that received a user experience rating of 74.1%. with proven usability.
Highlights
The color sounds in each entry in the color map table were joined to form a single painting was divided into three rows and four columns, and played in min and
The way to use poems together when appreciating works has the advantage of enhancing the expressiveness of one work. These motivated us to develop a systematic algorithm to automate the generation of poetry that can be applied consistently to artworks, especially to help visually impaired users to perceive colors in the artworks
In this paper, we presented a methodology to create poetry that matched well with a given artwork to ascertain whether a person with a visual impairment can interact with color through sound and poetry together without a complex learning process
Summary
Synesthesia refers to figurative language that includes a mixing of senses. She siftseleven inThe sunlight down boils stars This is with how colors,melwhen they’re few and pure, straight the eye. A constant of thigh is clumsy, to push children,thresh like a god, and mountains over- be gross be ongross thigh-ange irons ange irons be gross. Her lips imprint the swingon thigh-push children, like a god, and mountains overonto thigh-but friendly. Whelm the view, is clumsy, is clumsy, to push children, to push children, andlips mountains overimprint the swinglike a god, like a god, and mountains overing airHer but friendly Her lips imprint the swingfrom its eye. The old unseen serpent swalbut colors, when they’re ing air beatbuilt the frame; and old lows up the stars. Five images found in poetry, for example, are as follows
Sign-in/Register to view highlights & summary Sign-in/Register to access full text options 
Free) 
Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have
Schedule a call
