A model of synesthetic metaphor interpretation based on cross-modality similarity

Abstract

Synesthesia focuses on the cross-modality connections between different perceptual modalities (visual, auditory, olfactory, gustatory, and haptic). It presents the aesthetics and creativity of our language and cognitive systems. A model that automatically interprets synesthetic metaphor is proposed in this paper. The interpretation model can learn the semantic knowledge of a feature, and simulate the cross-modality semantic similarity. The semantic knowledge has three parts: feature, the perceptual modality of the feature, and its sentimental orientation. They are used for supervising feature generation and expansion. By multi-step synonyms expansion, our model explores the cross-modality associations between the source and target domains which belong to different modalities. The appropriate feature is selected by a heuristic way to describe the latent meaning of the target domain in the current context. The experimental result shows that our model can fully consider the semantic knowledge and embody the cross-modality relations. It achieves an accuracy of 84%.