Synesthetic Colors Research Articles

Synesthesia and learning: a critical review and novel theory

Learning and synesthesia are profoundly interconnected. On the one hand, the development of synesthesia is clearly influenced by learning. Synesthetic inducers – the stimuli that evoke these unusual experiences – often involve the perception of complex properties learned in early childhood, e.g., letters, musical notes, numbers, months of the year, and even swimming strokes. Further, recent research has shown that the associations individual synesthetes make with these learned inducers are not arbitrary, but are strongly influenced by the structure of the learned domain. For instance, the synesthetic colors of letters are partially determined by letter frequency and the relative positions of letters in the alphabet. On the other hand, there is also a small, but growing, body of literature which shows that synesthesia can influence or be helpful in learning. For instance, synesthetes appear to be able to use their unusual experiences as mnemonic devices and can even exploit them while learning novel abstract categories. Here we review these two directions of influence and argue that they are interconnected. We propose that synesthesia arises, at least in part, because of the cognitive demands of learning in childhood, and that it is used to aid perception and understanding of a variety of learned categories. Our thesis is that the structural similarities between synesthetic triggering stimuli and synesthetic experiences are the remnants, the fossilized traces, of past learning challenges for which synsethesia was helpful.

The interaction of synesthetic and print color and its relation to visual imagery

Synesthetic color induced by graphemes is well understood to be an automatic perceptual phenomenon paralleling print color in some ways, but also differing in others. We addressed this juxtaposition by asking how synesthetes are affected by synesthetic and print colors that are the same. We tested two groups of grapheme-color synesthetes using a basic color-priming method in which a grapheme prime was presented, followed by a color patch (probe), the color of which was to be named as quickly and accurately as possible. The primes induced either no color, print color only, synesthetic color only, or both forms of color (e.g., a letter "A" printed in red that also triggered synesthetic red). As expected, responses to name the probe color were faster if it was congruent with the prime color than if it was incongruent. The new finding (Exp. 1) was that a prime that induced the same print and synesthetic colors led to substantially larger priming effects than did either type of color individually, an effect that could not be attributed to semantic priming (Exp. 2). In addition, the synesthesia effects correlated with a standard measure of visual imagery. These findings are discussed as being consistent with the hypothesis that print and synesthetic color converge on similar color mechanisms.

Visual search based on synesthetic color without overt attention

Visual search based on synesthetic color without overt attention

Is “Σ” purple or green? Bistable grapheme-color synesthesia induced by ambiguous characters

People with grapheme-color synesthesia perceive specific colors when viewing different letters or numbers. Previous studies have suggested that synesthetic color experience can be bistable when induced by an ambiguous character. However, the exact relationship between processes underlying the identity of an alphanumeric character and the experience of the induced synesthetic color has not been examined. In the present study, we explored this by focusing on the temporal relation of inducer identification and color emergence using inducers whose identity could be rendered ambiguous upon rotation of the characters. Specifically, achromatic alphabetic letters (W/M) and digits (6/9) were presented at varying angles to 9 grapheme-color synesthetes. Results showed that grapheme identification and synesthetically perceived grapheme color covary with the orientation of the test stimulus and that synesthetes were slower naming the experienced color than identifying the character, particularly at intermediate angles where ambiguity was greatest.

Real color captures attention and overrides spatial cues in grapheme-color synesthetes but not in controls

Grapheme-color synesthetes perceive color when reading letters or digits. We investigated oscillatory brain signals of synesthetes vs. controls using magnetoencephalography. Brain oscillations specifically in the alpha band (∼10Hz) have two interesting features: alpha has been linked to inhibitory processes and can act as a marker for attention. The possible role of reduced inhibition as an underlying cause of synesthesia, as well as the precise role of attention in synesthesia is widely discussed.To assess alpha power effects due to synesthesia, synesthetes as well as matched controls viewed synesthesia-inducing graphemes, colored control graphemes, and non-colored control graphemes while brain activity was recorded. Subjects had to report a color change at the end of each trial which allowed us to assess the strength of synesthesia in each synesthete.Since color (synesthetic or real) might allocate attention we also included an attentional cue in our paradigm which could direct covert attention. In controls the attentional cue always caused a lateralization of alpha power with a contralateral decrease and ipsilateral alpha increase over occipital sensors. In synesthetes, however, the influence of the cue was overruled by color: independent of the attentional cue, alpha power decreased contralateral to the color (synesthetic or real). This indicates that in synesthetes color guides attention. This was confirmed by reaction time effects due to color, i.e. faster RTs for the color side independent of the cue. Finally, the stronger the observed color dependent alpha lateralization, the stronger was the manifestation of synesthesia as measured by congruency effects of synesthetic colors on RTs.Behavioral and imaging results indicate that color induces a location-specific, automatic shift of attention towards color in synesthetes but not in controls. We hypothesize that this mechanism can facilitate coupling of grapheme and color during the development of synesthesia.

Short- and Long-range Neural Synchrony in Grapheme–Color Synesthesia

Grapheme-color synesthesia is a perceptual phenomenon where single graphemes (e.g., the letter "E") induce simultaneous sensations of colors (e.g., the color green) that were not objectively shown. Current models disagree as to whether the color sensations arise from increased short-range connectivity between anatomically adjacent grapheme- and color-processing brain structures or from decreased effectiveness of inhibitory long-range connections feeding back into visual cortex. We addressed this issue by examining neural synchrony obtained from EEG activity, in a sample of grapheme-color synesthetes that were presented with color-inducing versus non-color-inducing graphemes. For color-inducing graphemes, the results showed a decrease in the number of long-range couplings in the theta frequency band (4-7 Hz, 280-540 msec) and a concurrent increase of short-range phase-locking within lower beta band (13-20 Hz, 380-420 msec at occipital electrodes). Because the effects were both found in long-range synchrony and later within the visual processing stream, the results support the idea that reduced inhibition is an important factor for the emergence of synesthetic colors.

Executive functions in synesthesia

In grapheme-color synesthesia, a number or letter can evoke two different and possibly conflicting (real and synesthetic) color sensations at the same time. In this study, we investigate the relationship between synesthesia and executive control functions. First, no general skill differences were obtained between synesthetes and non-synesthetes in classic executive control paradigms. Furthermore, classic executive control effects did not interact with synesthetic behavioral effects. Third, we found support for our hypothesis that inhibition of a synesthetic color takes effort and time. Finally, individual differences analyses showed no relationship between the two skills; performance on a 'normal' Stroop task does not predict performance on a synesthetic Stroop task. Across four studies, the current results consistently show no clear relationship between executive control functions and synesthetic behavioral effects. This raises the question of which mechanisms are at play in synesthetic 'management' during the presence of two conflicting (real and synesthetic) sensations.

Impaired acquisition of novel grapheme-color correspondences in synesthesia

Grapheme-color synesthesia is a neurological phenomenon in which letters and numbers (graphemes) consistently evoke particular colors (e.g., A may be experienced as red). These sensations are thought to arise through the cross-activation of grapheme processing regions in the fusiform gyrus and color area V4, supported by anatomical and functional imaging. However, the developmental onset of grapheme-color synesthesia remains elusive as research in this area has largely relied on self-report of these experiences in children. One possible account suggests that synesthesia is present at or near birth and initially binds basic shapes and forms to colors, which are later refined to grapheme-color associations through experience. Consistent with this view, studies show that similarly shaped letters and numbers tend to elicit similar colors in synesthesia and that some synesthetes consciously associate basic shapes with colors; research additionally suggests that synesthetic colors can emerge for newly learned characters with repeated presentation. This model further predicts that the initial shape-color correspondences in synesthesia may persist as implicit associations, driving the acquisition of colors for novel characters. To examine the presence of latent color associations for novel characters, synesthetes and controls were trained on pre-defined associations between colors and complex shapes, on the assumption that the prescribed shape-color correspondences would on average differ from implicit synesthetic associations. Results revealed synesthetes were less accurate than controls to learn novel shape-color associations, consistent with our suggestion that implicit form-color associations conflicted with the learned pairings.

Why are there different types of synesthete?

For people with synesthesia, sensations in two modalities are experienced when only one is stimulated (e.g., auditory stimuli might trigger colors and sounds). Synesthetes are manifestly different to the general population, but can also be different to each other. First, the condition is widely heterogeneous in that 60–150 different manifestations of synesthesia have been identified (e.g., auditory stimuli might trigger colors, shapes, flavors and so on; Cytowic and Eagleman, 2009). Second, synesthetes can differ on the quality of their synesthetic perceptions even within a given variant. Some experience their synesthetic percepts as being similar in quality to a real-world perceptions (e.g., synesthetic colors might be projected onto external objects and be difficult to dissociate from real-world colors) while other synesthetes experience less “veridical” percepts (see below). In this opinion piece I ask whether this particular difference—known as the “projector” vs. “associator” distinction—might fall out naturally from another, independent psychological quality.

Color and texture associations in voice-induced synesthesia

Voice-induced synesthesia, a form of synesthesia in which synesthetic perceptions are induced by the sounds of people's voices, appears to be relatively rare and has not been systematically studied. In this study we investigated the synesthetic color and visual texture perceptions experienced in response to different types of “voice quality” (e.g., nasal, whisper, falsetto). Experiences of three different groups—self-reported voice synesthetes, phoneticians, and controls—were compared using both qualitative and quantitative analysis in a study conducted online. Whilst, in the qualitative analysis, synesthetes used more color and texture terms to describe voices than either phoneticians or controls, only weak differences, and many similarities, between groups were found in the quantitative analysis. Notable consistent results between groups were the matching of higher speech fundamental frequencies with lighter and redder colors, the matching of “whispery” voices with smoke-like textures, and the matching of “harsh” and “creaky” voices with textures resembling dry cracked soil. These data are discussed in the light of current thinking about definitions and categorizations of synesthesia, especially in cases where individuals apparently have a range of different synesthetic inducers.

Grapheme learning and grapheme-color synesthesia: toward a comprehensive model of grapheme-color association

Recent progress in grapheme-color synesthesia research has revealed that certain regularities, as well as individual differences, figure into grapheme-color associations. Although several factors are known to regulate grapheme-color associations, the impact of factors, including their interrelationships, on synesthesia remains unclear. We investigated determinants of synesthetic color for graphemes (characters, letters) of Hiragana, a phonetic script in the Japanese language, and the English alphabet. Results revealed that grapheme ordinality was the strongest predictor of synesthetic colors for Hiragana characters, followed by character sound, and visual shape. Ordinality and visual shapes also significantly predicted synesthetic colors for English alphabet letters, however, sounds did not. The relative impact of grapheme properties on grapheme-color associations and the differences between these two writing systems are accounted for by considering the way graphemes are processed in the brain and introduced during an individual's development. A new model is proposed which takes into account the developmental process of grapheme learning. The model provides comprehensive explanation of synesthetic grapheme-color association determination processes, including the differences across writing systems.

Metacontrast masking is processed before grapheme–color synesthesia

We investigated the physiological mechanism of grapheme-color synesthesia using metacontrast masking. A metacontrast target is rendered invisible by a mask that is delayed by about 60 ms; the target and mask do not overlap in space or time. Little masking occurs, however, if the target and mask are simultaneous. This effect must be cortical, because it can be obtained dichoptically. To compare the data for synesthetes and controls, we developed a metacontrast design in which nonsynesthete controls showed weaker dichromatic masking (i.e., the target and mask were in different colors) than monochromatic masking. We accomplished this with an equiluminant target, mask, and background for each observer. If synesthetic color affected metacontrast, synesthetes should show monochromatic masking more similar to the weak dichromatic masking among controls, because synesthetes could add their synesthetic color to the monochromatic condition. The target-mask pairs used for each synesthete were graphemes that elicited strong synesthetic colors. We found stronger monochromatic than dichromatic U-shaped metacontrast for both synesthetes and controls, with optimal masking at an asynchrony of 66 ms. The difference in performance between the monochromatic and dichromatic conditions in the synesthetes indicates that synesthesia occurs at a later processing stage than does metacontrast masking.

Patterns of neural activity associated with synesthetic color perception: a case study

Patterns of neural activity associated with synesthetic color perception: a case study

Synesthésie, expression subjective d’un palimpseste neuronal ?

Synesthetes, a small fraction of the population, experience systematic, additional associations. For example, they may arbitrarily associate a specific color to each letter or number. Synesthesia has offered for the last ten years to cognitive science a unique opportunity to study the neural bases of subjective experience, drawing on individual differences just like in neuropsychology, but with healthy people. Here we review the current knowledge and propose a new theory, the "palimpsest hypothesis", a variant of the recycling hypothesis for reading. The neural development of written language expertise (a recent cultural invention acquired without any genetic modification) requires indeed the recycling of brain regions predisposed to expertise acquisition into reading regions. The palimpsest hypothesis supposes that for synesthetes recycling involves neuronal networks that were already specialized for color perception. Synesthetic colors would be the remains of this former expertise.

Synesthetic colors for Japanese late acquired graphemes

Determinants of synesthetic color choice for the Japanese logographic script, Kanji, were studied. The study investigated how synesthetic colors for Kanji characters, which are usually acquired later in life than other types of graphemes in Japanese language (phonetic characters called Hiragana and Katakana, and Arabic digits), are influenced by linguistic properties such as phonology, orthography, and meaning. Of central interest was a hypothesized generalization process from synesthetic colors for graphemes, learned prior to acquisition of Kanji, to Kanji characters learned later. Results revealed that color choices for Kanji characters depend on meaning and phonological information. Some results suggested that colors are generalized from Hiragana characters and Arabic digits to Kanji characters via phonology and meaning, respectively. Little influence of orthographic information was observed. The findings and approach of this study contributes to a clarification of the mechanism underlying grapheme-color synesthesia, especially in terms of its relationship to normal language processing.

Second-order mappings in grapheme–color synesthesia

Typically, the search for order in grapheme-color synesthesia has been conducted by looking at the frequency of certain letter-color associations. Here, we report stronger associations when second-order similarity mappings are examined--specifically, mappings between the synesthetic colors of letters and letter shape, frequency, and position in the alphabet. The analyses demonstrate that these relations are independent of one other. More strikingly, our analyses show that each of the letter-color mappings is restricted to one dimension of color, with letter shape and ordinality linked to hue, and letter frequency linked to luminance. These results imply that synesthetic associations are acquired as the alphabet is learned, with associations involving letter shape, ordinality, and frequency being made independently and idiosyncratically. Because these mappings of similarity structure between domains (letters and colors) are similar to those found in numerous other cognitive and perceptual domains, they imply that synesthetic associations operate on principles common to many aspects of human cognition.

The Effect of Attention on Context Dependent Synesthetic Experiences

Here we report the results of a brief experiment investigating the role of attention in mediating contextual effects on synesthetic experiences. Specifically, we examine a grapheme-color synesthete for whom the grapheme letter 'O' and number '0' are associated with two very different colors. We presented the grapheme '0' in an array of graphemes that provided ambiguous contextual cues, such that the same grapheme could be perceived either as the number '0' or as the letter 'O'. We find that an attentional cue that draws attention to one or the other of the contexts biases the perceived synesthetic color of the '0' grapheme to that associated with the cued context. This is true even when the physical color of the grapheme corresponds to the un-cued context.

Precision of synesthetic color matching resembles that for recollected colors rather than physical colors.

Grapheme-color synesthesia is an atypical condition in which individuals experience sensations of color when reading printed graphemes such as letters and digits. For some grapheme-color synesthetes, seeing a printed grapheme triggers a sensation of color, but hearing the name of a grapheme does not. This dissociation allowed us to compare the precision with which synesthetes are able to match their color experiences triggered by visible graphemes, with the precision of their matches for recalled colors based on the same graphemes spoken aloud. In six synesthetes, color matching for printed graphemes was equally variable relative to recalled experiences. In a control experiment, synesthetes and age-matched controls either matched the color of a circular patch while it was visible on a screen, or they judged its color from memory after it had disappeared. Both synesthetes and controls were more variable when matching from memory, and the variance of synesthetes' recalled color judgments matched that associated with their synesthetic judgments for visible graphemes in the first experiment. Results suggest that synesthetic experiences of color triggered by achromatic graphemes are analogous to recollections of color.

Synesthetic Colors for Japanese Scripts in Japanese Synesthetes

The determinants of synesthetic colors for Japanese scripts were studied in six Japanese grapheme-color synesthetes. We investigated the influence of linguistic properties such as phonology, orthography, and meaning on synesthetic colors for logographic characters (Kanji), phonetic characters (hiragana and katakana), and digits. From a palette of 138 colors, the synesthetes selected colors for 79 Kanji, 71 hiragana, and 71 katakana characters, and 9 digits. The results revealed that the color choices for hiragana and katakana characters representing the same sound were remarkably consistent, indicating that color selection depended on phonology and not visual form. On the other hand, synesthetic colors for Kanji characters, which are usually learned later, depended on meaning and phonology. Kanji characters representing concepts that are highly related to colors (eg, names of objects with typical colors) were associated with those colors. Digits and corresponding Kanji numerals elicited strikingly similar colors. Colors for Kanji and hiragana characters sharing the same sound were likely to be similar. These results suggest that synesthetic colors are generalized from digits and phonetic scripts to Kanji characters via meaning and phonology. This study provides insights into the generalization of synesthetic colors to later acquired sets of graphemes within a language.

The interaction of synesthetic and print color and the role of visual imagery

Synesthesia is understood to be an automatic perceptual phenomenon paralleling print color in some ways but also differing in others. We examined this juxtaposition in a group of 13 grapheme-color synesthetes using a color priming paradigm where one of four prime types appeared for 750 msec on each trial followed immediately by a colored patch (probe). Primes induced either no color, print color only, synesthetic color only, or both forms of color simultaneously (e.g., a letter “A” printed in red that also triggers synesthetic red). Synesthetes named the probe color out loud as quickly and accurately as possible. All stimuli appeared foveally and probes were printed in the same or different color (where relevant) as that induced by primes. Replicating previous work, subjects were faster to name a probe color that was congruent with the prime color than if it was incongruent. Importantly, we found that synesthetes primed with a grapheme that induced the same print and synesthetic color showed significantly larger priming effects than when primed with either individual forms of color, suggesting an additive interaction of the two color types. Additionally, synesthetes exhibited a strong positive correlation between color priming effects (synesthetic and combination color only) and the vividness of self reported imagery as assessed with the Vividness of Visual Imagery Questionnaire (Marks, 1973). Yoked non-synesthete controls run on the same paradigm showed significant color priming effects only for primes printed in color and showed no correlations with VVIQ. These results suggest that synesthetic and print colors operate through separate but overlapping networks of color perception, with grapheme-color synesthetes possessing an extra dimension of visual space that can be bound like “normal” color but remains perceptually independent to normal color. This additional synesthetic color space may operate through a unique mechanism tied to visual mental imagery.