Sie sind auf Seite 1von 27

THE YEAR IN COGNITIVE NEUROSCIENCE 2009

Attention, Automaticity, and Awareness


in Synesthesia
Jason B. Mattingley
The University of Queensland, Australia

The phenomenon of synesthesia has occupied the thoughts of philosophers and artists
for decades. With the advent modern behavioral and brain imaging techniques, scientific
research on synesthesia has also moved into the mainstream of thought. Here I provide
a cognitive neuroscience perspective on the condition, with a particular emphasis on
grapheme-color synesthesia, the most common variant, in which individuals report vivid
and consistent experiences of color in association with numerals, letters, and words.
Behavioral studies have revealed several fundamental properties of induced synesthetic
colors. First, although they seem to arise automatically, without the need for voluntary
control, they are strongly modulated by selective attention. Second, they attain salience
relatively early in visual processing, and so can influence perceptual judgments and
guide focal attention in cluttered, achromatic displays. Third, brain activity during
synesthetic color experiences arises from within the ventral temporal lobe, including
color-selective area V4. It has been speculated that grapheme-color synesthesia arises
from disinhibited feedback or abnormal cross-wiring between brain regions involved
in extracting visual form and color.

Key words: attention; blood oxygen level-dependent (BOLD); color perception;


grapheme; event-related potential (ERP); functional magnetic resonance imaging
(fMRI); masking; Stroop effect; transcranial magnetic stimulation (TMS); visual im-
agery; visual search; V4

Introduction the phenomenon on television, radio, and in


the print media worldwide. Clearly the condi-
The last two decades have seen a resurgence tion has captured the imagination of scientists,
of interest in the phenomenon of synesthesia artists and the lay public alike, and perhaps not
(Mattingley & Ward 2006; Rich & Mattingley surprisingly. There is something intriguing and
2002; Robertson & Sagiv 2005), a condition slightly unnerving about the idea that there is a
in which individuals report unusual sensory, significant minority of people, individuals with
cognitive, or affective experiences associated whom we live or work, whose sensory, cognitive
with seen, heard, felt, smelled, or tasted stim- and emotional responses differ fundamentally
uli. In the last two years alone there have been from the way most of us—that is to say, those
more than 100 scientific papers on synesthesia of us who are not synesthetes—experience the
in the scientific literature (ISI Web of Science, world.
October 2008). Roughly the same number of In this article I review evidence that bears
works again have appeared in the arts and hu- upon two central questions in research on
manities (e.g., music, literature, creative arts), synesthesia. First, at what level does synesthe-
and there have been countless stories about sia emerge in the perceptual processing hier-
archy, from the initial registration of inputs at
the sensory epithelia to the extraction of mean-
Address for correspondence: Jason B. Mattingley, The University of ing and the emergence of conscious experi-
Queensland, Queensland Brain Institute and School of Psychology, St
Lucia, Queensland 4072, Australia. Voice: +61 7 3346 6331, fax. +61 7
ence? Second, what are the neurophysiolog-
3346 6301. j.mattingley@uq.edu.au ical correlates of synesthetic experience, and
The Year in Cognitive Neuroscience 2009: Ann. N.Y. Acad. Sci. 1156: 141–167 (2009).
doi: 10.1111/j.1749-6632.2009.04422.x  C 2009 New York Academy of Sciences.

141
142 Annals of the New York Academy of Sciences

what light is shed on the phenomenon by the stimuli”) is perhaps not sufficiently precise,
application of techniques such as functional but it is intended to capture the heterogene-
brain imaging, electroencephalography, and ity of synesthetic phenomena that have been
neurostimulation? Given the vast and grow- reported. The number of subtypes of the con-
ing literature in the area, I shall deliberately dition seems virtually limitless (Grossenbacher
focus on research that bears more or less di- & Lovelace 2001; Rich et al. 2005).
rectly on these two central questions. I shall also Several studies have sought to catalogue
focus almost exclusively on data pertaining to the various stimuli that trigger synesthesia
so-called grapheme-color synesthesia, in which (so-called inducers) as well as the types of
individuals report vivid experiences of color sensory, cognitive, or emotional experiences
in association with graphemes (digits, letters, that are elicited by them (“concurrents”)
and words in their printed form) (Baron-Cohen (Grossenbacher & Lovelace 2001). By far the
et al. 1987; Galton 1880; Grossenbacher & most common inducers, accounting for 80–
Lovelace 2001; Smilek et al. 2007; Ward et al. 90% of all cases, are digits, letters, and words,
2007). There is now good evidence that the either heard, read, or evoked internally via im-
grapheme-color variant is by far the most com- agery or thought (Barnett et al. 2008; Rich et al.
mon form of synesthesia, accounting for up to 2005). On the other hand, synesthetic concur-
90% of all self-reported cases (Barnett et al. rents almost invariably involve color (around
2008; Rich et al. 2005; Simner et al. 2006b). 90% of all cases, Barnett et al. 2008; Rich
I will not discuss recent work on the heritabil- et al. 2005; Simner et al. 2006b), either ex-
ity of synesthesia (Barnett et al. 2008; Baron- perienced “in the mind’s eye” or externalized
Cohen et al. 1996; Rich et al. 2005; Simner onto the body or into peripersonal or extrap-
et al. 2006b; Smilek et al. 2005), or on the hy- ersonal space (Ward et al. 2007). Less com-
pothesized developmental determinants of the monly, individuals may report colors for music,
condition (Marks & Odgaard 2005; Maurer & odors, tastes, or experiences of intense plea-
Mondloch 2005, 2006), nor will I deal with sure or pain (Rich et al. 2005). At a conser-
evidence concerning the causal link between vative estimate there are probably more than
language and synesthetic experiences (Simner 50 individual variants in the published litera-
2007; Simner et al. 2006a; Simner & Ward ture. It is noteworthy, however, that a recent
2006; Ward et al. 2005). Readers interested in study of 500 individuals recruited opportunisti-
learning more about these important topics are cally from two universities in Scotland revealed
referred to recent reviews by Hochel and Milán just nine different manifestations of synesthe-
(2008), Rich and Mattingley (2002), Robertson sia, representing only 7% of the total possible
(2003), and Simner (2007). combinations of inducer and concurrent tested
for (Simner et al. 2006b). In that study the most
common manifestation of synesthesia was the
What Is Synesthesia? grapheme-color variant, which occurred in 1%
of a further opportunistic sample of more than
It has proven remarkably difficult to arrive at 1,000 adults and children (Simner et al. 2006b).
a definition of synesthesia that is both precise Just as the types of inducers and concur-
and widely accepted. The word comes from rents vary considerably across individuals, so it
the Greek syn- meaning “together” and aisthe- seems can the manner in which synesthetic con-
meaning “to feel, perceive” or “of the senses.” currents are experienced. Individuals with the
The definition I offered at the outset (“a con- grapheme-color variant might perceive their
dition in which individuals report unusual sen- synesthetic colors as a “mist” or “haze” floating
sory, cognitive, or affective experiences associ- out in space, some see their colors as hovering
ated with seen, heard, felt, smelled or tasted above a printed character, or perhaps attached
Mattingley: Attention, Automaticity and Awareness in Synesthesia 143

to its surface, and many experience colors in proponents (see Edquist et al. 2006; Ward et al.
their mind’s eye as a kind of vivid mental image. 2007). Moreover, most authors who have di-
Considerable recent interest has focused on vided their synesthete groups into projectors
whether these variations in subjective reports and associators have done so on the basis of
might reflect fundamentally different types of subjective reports rather than empirical data,
synesthesia, with distinct cognitive and neural and so these reports must be considered with a
substrates. According to Dixon et al. (2004), in- degree of caution.
dividuals with grapheme-color synesthesia can Despite the evident heterogeneity of synes-
be divided into two distinct groups: “projec- thesia there are three underlying features that
tors” and “associators.” Projectors, according seem relatively consistent across cases. First,
to their hypothesis, are those individuals who synesthetic experiences are typically reported
experience synesthetic colors as “projected” out as arising involuntarily and without mental ef-
beyond the body and into external space. By fort (Dixon et al. 2000; Mattingley et al. 2001;
contrast, associators are those who experience Wollen & Ruggiero 1983). Second, the concur-
synesthetic colors “internally,” or in the mind’s rents associated with particular inducers tend
eye, as a kind of mental image. to be consistent over time, as documented by
Note that the dichotomy suggested by test−retest scores on questionnaire measures
Dixon et al. (2004) concerns the manner taken over months or years (Asher et al. 2006;
in which synesthetic concurrents are expe- Baron-Cohen et al. 1987). Third, synesthetic
rienced. An analogous framework, suggested experiences often begin in early childhood, and
by Ramachandran and Hubbard (2001a), has might be associated with the development of
been advanced for the way in which inducers language abilities (Rich et al. 2005; Simner
trigger synesthetic experiences. According to 2007; Simner et al. 2005). There have been at-
this model the color experiences of “higher” tempts to establish diagnostic criteria for synes-
synesthetes are triggered at a conceptual or se- thesia, but none is currently widely accepted,
mantic level of analysis. Thus, a person might and until more is known about the causes of
experience the same color green for the num- the condition it seems premature to accept
ber “5,” the Roman numeral “V,” and a cluster any particular taxonomy. The first two features
of five dots; or colors might be induced specif- of synesthesia—its involuntary or “automatic”
ically for ordinal sequences, such as days of nature and its consistency—have provided the
the week or months of the year (Rich et al. basis for the empirical work I discuss in this
2005). By contrast, the colors experienced by article. If synesthesia arises automatically, with-
“lower” synesthetes are assumed to arise from out the need for voluntary control, it should be
an analysis of the physical form of the stimulus, possible to measure the effect of its presence on
which might arise initially from visual process- perceptual, cognitive, and affective tasks. Like-
ing within the grapheme area of the ventral wise, the fact that the link between inducers and
occipito−temporal cortex (Ramachandran & their concurrent experiences remains fairly sta-
Hubbard 2001b). ble over time means that synesthetes can be
Both the “projector−associator” dichotomy tested repeatedly with the same stimulus sets,
and the “lower−higher” dichotomy have re- thus allowing verification and replication.
ceived empirical support from behavioral and
brain imaging studies (Dixon et al. 2004;
Hubbard et al. 2005; Ramachandran & Hub- How Common Is Synesthesia?
bard 2001b), as discussed in the following sec-
tions. It should be noted, however, that not all There have been numerous attempts to esti-
authors have agreed with these distinctions, at mate the prevalence of synesthesia, and these
least as they were originally framed by their have yielded highly variable outcomes. Two
144 Annals of the New York Academy of Sciences

influential studies suggested a prevalence of 1 experiences for a set of inducers, and then
in every 2,000 people, with approximately six retesting them weeks, months, or years later
females for every one male (Baron-Cohen et al. (Asher et al. 2006; Baron-Cohen et al. 1987). As
1996; Rich et al. 2005). These studies counted mentioned previously, the data overwhelmingly
responses to newspaper articles about synes- suggest that synesthetic experiences, at least by
thesia and based their estimates of prevalence self-report, are remarkably consistent over time.
on the average circulation of the newspaper on Unfortunately, such self-report measures say
the day the article appeared. The figure of 1 little about the mechanisms underlying synes-
in 2,000 is likely to be a conservative estimate, thesia. Fortunately, however, the problem of
however, since this approach will not count in- interrogating synesthetes’ unusual perceptual,
dividuals with the condition who do not re- cognitive, or affective experiences has been
spond. More recently, a prospective study of overcome by measuring their performance for
two large groups—one composed of university objective stimuli that have been manipulated
students and the other of adults and children at- to have some consistent, formalized relation-
tending a public science exhibition—estimated ship with their synesthetic experiences.
a prevalence of around 4.0% overall and about By far the most widely applied empirical
1% for the most common grapheme-color vari- measure of synesthesia is based upon the clas-
ant (Simner et al. 2006b). Interestingly, the sic Stroop task, in which observers are re-
same study found no evidence for a difference quired to identify the color of letter strings
in the ratio of males to females, suggesting that that compose familiar words, and in particular
males might be less likely to respond to adver- color names (MacLeod 1991; Stroop 1935). In
tisements or surveys than females. the standard version of this task, color-naming
There is, however, convincing evidence for times are significantly slower for color names
the long-held belief that synesthesia runs in printed in nonmatching (incongruent) colors
families (Rich et al. 2005; Ward & Simner (e.g., the word RED displayed in green) than
2005). In one recent investigation of 53 synes- for color names printed in matching (congru-
thetes, 42% of the probands reported at least ent) colors (e.g., the word GREEN displayed
one first-degree relative with the condition in green). The Stroop effect (Stroop 1935),
(Barnett et al. 2008). Interestingly, the same measured as the difference in response times
study found that different manifestations of and errors for incongruent versus congruent
synesthesia occurred within the same family, conditions, is thought to be due to interfer-
and that the ratio of females to males was 4:1, ence between an automatic and rapid word-
both in probands and their first-degree relatives reading process, and a more controlled, effort-
(cf. Simner et al. 2006b). ful, and therefore slower color identification
process (MacLeod 1991). Compatibility effects
of this sort are observed in numerous behavioral
How Can We Measure domains, and researchers have determined that
Synesthesia’s Effects on Behavior? they represent a general index of interference
between concurrent perceptual, cognitive, or
While early studies of synesthesia were con- motor processes.
cerned principally with cataloguing its varia- In a pioneering study Wollen and Ruggiero
tions and the nature of the individuals’ subjec- (1983) had synesthetes perform rapid color-
tive experiences, research over the last decade naming of lists of letters selected to elicit synes-
has focused on providing objective, empiri- thetic experiences of color. The investigators’
cal evidence for its existence. The emphasis key manipulation was to color some of the
initially was on verifying the consistency of items congruently (i.e., the print color to be
synesthesia by having individuals report their named matched the synesthetic color elicited
Mattingley: Attention, Automaticity and Awareness in Synesthesia 145

trary associations (Elias et al. 2003; MacLeod &


Dunbar 1988). While it is true that the conven-
tional application of the Stroop task cannot de-
termine whether synesthetic interference arises
early or late in processing, the paradigm lends
itself to modifications that can potentially reveal
the influence of fundamental processes such as
attention and cognitive set (MacLeod 1991), as
I describe below. Moreover, it is not clear that
any test yet devised can unambiguously deter-
mine whether synesthesia is experienced as a
sensory event, an overlearned association, or a
Figure 1. Colored letters and the synesthetic vivid mental image.
Stroop task. (A) Colors of letters experienced by Dixon et al. (2004) used the Stroop paradigm
synesthete E.S. (B) Displays showing letters col- also to determine whether projector and as-
ored congruently with E.S.’s synesthetic colors. (C) sociator synesthetes, classified on the basis of
Displays showing letters colored incongruently with
subjective reports, can be distinguished objec-
E.S.’s synesthetic colors.
tively based on cognitive performance. In one
task they had synesthetes name the print color
by the letter) and to color others incongruently, of individual graphemes presented on a com-
thus establishing a kind of “synesthetic Stroop” puter display, as per the original Wollen and
effect (Fig. 1). The synesthetes were significantly Ruggiero (1983) study. In a second task, they
slower to name the print colors of incongruent asked synesthetes to name their synesthetic color
items than congruent items, whereas controls for each grapheme and to ignore its print color.
showed no such difference. Their findings pro- The projectors showed greater Stroop inter-
vided the first objective evidence that synes- ference from synesthetic colors when naming
thesia has a measurable influence on behavior real colors than they did from real colors when
and prompted a range of subsequent stud- naming synesthetic colors, whereas the associ-
ies in which Stroop-like tasks have been used ators tended to show the reverse pattern (i.e.,
to measure automaticity in synesthesia (Beeli greater interference from real colors than from
et al. 2005; Dixon et al. 2000; Mattingley et al. synesthetic colors). Dixon et al. (2004) con-
2001). Almost without exception these studies cluded that for projectors the mechanisms giv-
have reported interference effects analogous to ing rise to synesthetic concurrents are triggered
those observed by Wollen and Ruggiero’s study more automatically and thus earlier than those
(1983), thus providing one of the most repli- supporting the naming of real colors, whereas
cated behavioral effects in the area. for associators real colors enjoy a processing
Some authors have objected that since advantage over synesthetic colors.
Stroop interference might in principle arise Dixon et al. (2004) speculated that pro-
anywhere in the processing hierarchy, from jected synesthetic colors might be more dif-
the initial stages of sensory registration to ficult to ignore than the internal colors ex-
the final selection of an appropriate response, perienced by associators because projected
such approaches cannot verify the “percep- colors are more perceptually intense, or be-
tual reality” of the condition (Palmeri et al. cause they occupy the same spatial position
2002; Ramachandran & Hubbard 2001a, as the colored graphemes that elicit them.
Ramachandran & Hubbard 2003). Indeed, it Indeed, Ward et al. (2007) have suggested
is known that even nonsynesthetes can show that the projector−associator dichotomy in
interference effects after training with arbi- fact reflects the different spatial reference
146 Annals of the New York Academy of Sciences

frames within which synesthetes experience Finally, a recent study found that the
their colors, rather than the internalized ver- magnitude of the interference effect elicited by
sus externalized nature of the experiences per the Stroop task is larger for incongruent trials
se. In their study Ward et al. (2007) observed when the hue of the grapheme and the hue
greater Stroop interference effects among in- of the synesthetic color it elicits are opponent
dividuals who projected their synesthetic col- colors (i.e., red−green, blue−yellow), compared
ors onto the viewing surface (e.g., a page with incongruent trials in which the colors are
of text or a computer display) than among not from within the same opponent “channel”
those who projected their colors externally but (e.g., red−blue, green−yellow; Nikolić et al.
away from the surface upon which the in- 2007). This opponent-color effect, though
ducer was displayed. (Interestingly, the latter present in all six synesthetes tested, was
group of projectors showed synesthetic Stroop particularly pronounced in the two who were
effects that were comparable to those of the classified as projectors based upon subjective
associators.) report. The authors suggest that the additional
Despite these demonstrations of objective interference generated in the opponent-color
individual differences between projector and condition was caused by competition within
associator synesthetes, there are some caveats early color-opponent areas of the visual system
worth mentioning. First, for synesthetes who (from V1 to V4) and that this in turn confirms
project their colors onto the graphemes that that the color experiences of projector synes-
elicit them, one would expect significantly pro- thetes are truly perceptual in nature. Despite
longed responses in the Stroop task when in- the authors’ claims, however, several aspects
dividuals have to identify the real color of an of their interpretation are rather speculative.
incongruent grapheme, since in this condition For instance, no explanation is offered for
there should be more perceptual competition how competition between opponent channels
than is encountered by associators or by in- within early color-selective visual neurons
dividuals who do not see colors attached to could exert a knock-on effect for accessing the
the graphemes that elicit them. In fact, Dixon appropriate color name from the lexicon, as
et al. (2004) found that response times in their required by the Stroop task. Moreover, it is
incongruent trials were the same for projec- entirely plausible that color names get stored
tors and associators (the reader can verify this within, or are accessed from, the lexicon in a
by comparing the left and right panels in their manner that preserves the opponent organi-
Fig. 1). In fact, the group difference in the Dixon zation of earlier perceptual stages of analysis.
et al. (2004) study occurred because the projec- Such an arrangement would only become
tors were significantly faster on congruent tri- evident in synesthetes during Stroop-type tasks
als than the associators, rather than slower on in which there is competition for access to the
incongruent trials, a result that is not readily lexicon from both real and synesthetic colors.
explained by perceptual interactions. A second In summary, the question of individual dif-
caveat is that many synesthetes spontaneously ferences in synesthesia remains controversial,
change the way in which they describe their but research on the issue has yielded findings
color experiences, making classification based that promise to drive the field forward.
on verbal reports particularly problematic. For
instance, Edquist et al. (2006) found that some
synesthetes could not say with any confidence Attention, Automaticity, and
precisely where in space they experienced their Awareness in Synesthesia
colors, while others changed from internalizing
to externalizing their colors, or vice versa, after Over the last 10 years a considerable
a 12-month interval. body of behavioral research has examined
Mattingley: Attention, Automaticity and Awareness in Synesthesia 147

issues concerning the potential influence of on form and proximity. In the visual search
synesthesia on perceptual processes, the extent task, participants inspected an array of black
to which synesthetic concurrents can influence letters, a subset of which formed a single ge-
attentional processes, and whether synesthesia ometric shape of the same letter. Participants
can be triggered without the synesthete’s had to identify the embedded shape, basing
conscious awareness of an inducing stimulus. their decision upon grouping of the local ele-
A parallel line of work has used physio- ments. The synesthetes tended to be faster than
logical approaches such as scalp-recorded controls in identifying the embedded shape, a
event-related potentials (ERPs), functional result that suggests the shape had a pop-out
magnetic resonance imaging (fMRI), and effect for them by virtue of the unique synes-
transcranial magnetic stimulation (TMS) to thetic colors triggered by the letter stimuli. The
uncover the neural correlates of synesthesia. authors attributed their results to grouping pro-
In the sections that follow I review recent cesses being driven by the sensory properties of
behavioral investigations relating to the issues perceived synesthetic colors. It is equally plausi-
of attention, automaticity, and awareness ble, however, that the synesthetes’ reports were
and draw upon relevant findings from brain based upon semantic associations in the group-
imaging and neurostimulation studies. In ing study (much as one would recognize a fa-
doing so, I consider evidence from individuals miliar telephone number or PIN), and that pro-
with grapheme-color synesthesia, since this is longed viewing in the visual search task (one
the most commonly encountered form of the second) permitted more efficient rejection of
condition and there are more published reports distractor items based on their synesthetic color,
on this synesthetic variant than any other. as opposed to a pop-out effect of the target
(Robertson 2003).
Despite these interpretative issues, subse-
Can Synesthetic Colors Act Like quent studies have focused on whether synes-
Real Colors in Perceptual Tasks? thetic colors can act like “real” colors in per-
ceptual tasks. To date the findings have been
As mentioned earlier, several studies have fo- tantalizing, but not always easy to explain or en-
cused on the question of whether synesthetic tirely convincing. For instance, Hubbard et al.
experiences of color are akin to those involved (2005) claimed that synesthetic colors can re-
in the perception of real color in the world. In duce visual crowding effects for graphemes
an attempt to move beyond subjective reports presented in the visual periphery, just as what
investigators have adapted well-known percep- occurs for such tasks when the target and dis-
tual and cognitive tasks to answer questions tractors are actually displayed in different col-
about the level at which synesthetic concurrents ors (Kooi et al. 1994). They had a group of
are generated in the brain. synesthetes try to identify a black target letter
In an influential study, Ramachandran and positioned in peripheral vision. The target was
Hubbard (2001b) tested two synesthetes and surrounded by black distractor letters of a dif-
a group of nonsynesthetic controls on tests ferent identity, thus inducing a crowding effect
of visual grouping and visual search. In their that would normally render the target difficult
grouping task, participants examined displays to identify. Three of the six synesthetes per-
containing a matrix of black digits arranged formed better than nonsynesthetes on this task,
in rows and columns on a white background. suggesting that somehow the unique color as-
The synesthetes tended to group the matrix sociated with the target helped unmask it from
into rows or columns on the basis of the synes- the distractors. Superficially, the results imply
thetic colors elicited by the digits, whereas non- a direct effect of synesthetic colors on percep-
synesthetes grouped the items based exclusively tion; but, for this conclusion to hold one must
148 Annals of the New York Academy of Sciences

assume that the color is triggered before the tar- faint opponent color aftereffects (a greenish
get grapheme is identified, and it remains un- tinge or pinkish tinge) while looking at an
clear how any such precategorical effect might achromatic test display composed of nonalpha-
arise (though see Smilek et al., 2001, for a clever betic characters arranged in rows and columns.
but untested account). These striking results for two individuals imply
In a different approach to the question of that synesthetic colors might act like real colors
whether synesthetic colors arise early in sensory under some conditions. As highlighted earlier,
processing, Kim et al. (2006) had two synes- however, the findings must now be replicated
thetes judge the direction of motion in bistable and quantified using a criterion-free measure of
apparent motion displays. The approach in this performance. It will also be important to con-
study was to examine interactions between real sider the extent to which mental imagery might
and synesthetic colors in successive visual dis- contribute to such aftereffects, since some ac-
plays, one of which contained pairs of achro- counts of synesthesia have suggested that the
matic graphemes that induced specific colors condition is associated with abnormally vivid
and the other of which contained items that visual imagery (Barnett & Newell 2008).
appeared in real (but matching) colors. Non- Another approach to examining whether
synesthetes perceived the direction of apparent synesthetic colors behave like real colors in per-
motion in these displays as completely ambigu- ceptual tasks is to ask whether an achromatic
ous (equally either clockwise or counterclock- character experienced as colored can affect the
wise). By contrast, the synesthetes tended to appearance of a nearby chromatic character.
report a motion path in which synesthetic col- It is known that perceived hue and brightness
ors induced by the achromatic display corre- are systematically influenced by light and color
sponded with the real (matched) colors in the from neighboring regions of the visual field,
chromatic display. While the findings appear to and that these effects arise early in the visual
suggest an early sensory influence of induced processing hierarchy (i.e., within primary vi-
colors on perception, the task used by Kim sual cortex and earlier; Palmer 1999). Do synes-
et al. (2006) was not criterion-free, and thus thetic color experiences have analogous effects?
is open to the criticism that high-level strategies This question was addressed recently by Hong
could have influenced the synesthetes’ judg- and Blake (2008), who had four synesthetes
ments. For instance, a bias in apparent motion perform a variety of visual matching tasks de-
judgments could readily arise from purely con- signed to assess brightness contrast and chro-
ceptual grouping strategies across chromatic matic adaptation, two phenomena thought to
and achromatic displays, per the grouping re- be resolved at the earliest stages of cortical
sults of Ramachandran and Hubbard (2001b). vision.
Another study by the same group (Blake et al. In one task, Hong and Blake (2008) found
2005) examined whether synesthetic colors as- that the perceived brightness of chromatic
sociated with graphemes are able to induce the test patches decreased as the brightness of a
McCollough effect, an orientation-contingent surrounding annulus increased (a well-known
color aftereffect that occurs when observers are effect called brightness contrast), but that synes-
exposed to colored contours over several min- thetic colors induced by an achromatic charac-
utes (McCollough 1965). The authors showed ter showed no influence of their surround (i.e.,
synesthetes achromatic adapting displays con- the character was unaffected by brightness
taining vertical columns of letters that induced contrast). In a second task the synesthetes were
a red color experience and horizontal rows of adapted to an array of identical graphemes
letters that induced a green color experience. over several minutes. Some of these arrays
After several minutes of adapting to these two, contained chromatic characters, whereas
achromatic, displays the synesthetes reported others contained achromatic characters that
Mattingley: Attention, Automaticity and Awareness in Synesthesia 149

induced a single synesthetic color. Following of being overwhelmed by colors “jumping out”
adaptation, synesthetes adjusted the color of a from signs and billboards in shopping malls.
chromatic test patch until it was perceived as a If synesthetically induced colors are so salient,
specified hue (known as “equilibrium yellow”) they should exert a measurable influence on
(Shevell 1982). Whereas prolonged exposure behavior. Having synesthetes perform visual
to an array of colored graphemes shifted the search tasks, in which they are required to lo-
participants’ perception of the test hue, expo- cate an achromatic target grapheme in an ar-
sure to the achromatic, synesthesia-inducing ray of achromatic distractors, provides a simple
arrays had no such effect. There was also no way of addressing this question. If an achro-
difference in equilibrium yellow judgments for matic target generates a synesthetic color pre-
graphemes that induced synesthetic colors of attentively, and that color is distinct from any
red and green compared with a neutral symbol colors elicited by the distractors, then the ob-
that induced no synesthetic color. Taken server should experience pop-out of the target.
together these results indicate that the neural Several investigators have asked whether synes-
correlates of synesthetic color experiences thetic colors might be elicited preattentively in
must arise downstream from the processes that otherwise cluttered displays, perhaps even in
give rise to brightness contrast and chromatic the absence of any conscious experience of the
adaptation. stimuli that induce them.
To summarize, evidence is somewhat mixed The visual grouping study of Ramachandran
on the question of whether synesthetic colors and Hubbard (2001b), in which participants
are represented in the brain in the same way had to identify a geometric shape made up of
as real colors. Clearly, synesthetic colors can letters of one identity (e.g., H) from among
be used by synesthetes to influence decisions distractor letters of a different identity (e.g.,
about grouping and the direction of ambiguous F and P), found an advantage for synes-
motion, but this does not necessarily imply an thetes over controls. But since the displays
early sensory locus for the effect. Based on sub- were visible for a full second each, faster re-
jective reports, one may conclude that synes- sponses by the synesthetes might simply have
thetic colors can induce an orientation con- reflected their ability to extract the colors of
tingent color aftereffect, but this result needs target and distractor items after a serial search,
to be quantified objectively and distinguished rather than indicating true preattentive pop-
from any potential influence of color imagery. out of the target shape. In a subsequent study,
Finally, synesthetic colors seem to be immune Palmeri et al. (2002) used a more traditional
to brightness contrast and fail to induce chro- visual search paradigm to test whether synes-
matic aftereffects, suggesting that they are not thetic colors confer some advantage for dis-
treated like real colors at the earliest stages of plays that would yield serial search in non-
visual processing. synesthetes. They asked a synesthete, W.O., to
search for a 2 among 5s, which elicited or-
ange and green, respectively; or an 8 among
Do Synesthetic Colors Pop Out 6s, which both elicited blue. The displays were
in Visual Search Displays? entirely achromatic, and the Arabic numer-
als were “digitalized” (i.e., composed of ver-
Even if synesthetic colors do not arise from tical and horizontal line segments only) so that
neural processes akin to those associated with they could not be distinguished on the basis of
the perception of real color, they evidently can individual features. For nonsynesthetes search
have a potent effect on the subjective sensory times increased over larger set sizes, as ex-
lives of those who experience them. We have pected for this difficult serial search task and
had synesthetes describe to us their experiences for both target/distractor pairings. A similar
150 Annals of the New York Academy of Sciences

effect was found for W.O. when the target and that it matched the synesthetic color induced by
distractors elicited the same synesthetic color the target (the congruent condition) or so that it
(a blue 8 among blue 6s). But when the numer- was not matched (the incongruent condition).
als elicited distinct synesthetic colors (an orange The authors reasoned that a target appearing
2 in green 5s), W.O. showed a shallower search on a congruently colored background might
slope. Interestingly, however, the search slope be more difficult to identify, by virtue of some
was not completely flat, as is typically the case sort of color camouflage, than one presented
in feature-search tasks. Thus, despite W.O.’s on an incongruent background. C. did in fact
spontaneous report that the target seemed to make more errors for congruent versus incon-
pop out of the display, it is clear that his pro- gruent displays, in support of the authors’ pre-
cessing of synesthetic colors did not occur in diction. In a further experiment, C. performed
parallel across the visual field. a more conventional visual search task in which
At present the consensus is that synesthetic she had to indicate the presence of an achro-
colors do not arise preattentively during visual matic target digit (a 2 or 4) among achromatic
search (Treisman 2005). Indeed, it seems likely distractors (8s). Once again, the target elicited
that in most synesthetes induced colors do not a synesthetic color that was either congruent
normally confer any measurable advantage at or incongruent with respect to the background
all in serial search tasks. Edquist et al. (2006) color. C. showed a somewhat shallower search
tested 14 grapheme-color synesthetes using tai- slope for the incongruent condition relative to
lored, achromatic displays of the kind intro- the congruent condition, though this difference
duced by Palmeri et al. (2002) (see Fig. 2). They was not statistically reliable. A subsequent study
found no evidence for shallower search slopes in (Smilek et al. 2003), which employed a similar
synesthetes compared with controls, either for paradigm with a different synesthete, yielded a
the group as a whole or for any of the individ- significant slope difference, with search being
uals, despite all participants showing reliable more efficient for incongruent than congruent
pop-out effects for chromatic variants of the trials.
same displays. One factor that might play an The findings of these “color camouflage”
important mediating role during visual search experiments are intriguing but difficult to in-
is the location of the target item within the dis- terpret unambiguously. Superficially, they sug-
play. Synesthetes are seemingly more efficient gest that synesthetic colors are triggered prior
at searching within an entirely achromatic dis- to character identification, or at least that the
play if the target happens to fall at fixation or two representations emerge in parallel. This
within the current focus of attention (Laeng seems counterintuitive because it implies that a
et al. 2004; Sagiv et al. 2006). synesthetic color that depends on an identified
Traditional visual search tasks, such as those grapheme for its existence can itself render the
described above, aim to measure effects of in- inducing grapheme difficult to perceive against
duced synesthetic colors on target detection a similarly colored background. The authors
within entirely achromatic displays. By con- offer a clever explanation for the effect, one
trast, Smilek et al. (2001) examined whether which posits an important role for feedforward
target identification could be affected by the re- and feedback pathways within the extrastriate
lationship between a synesthetic color and the visual system; but this account remains to be
background upon which the inducer appears. tested. Although the existence of such pathways
In one experiment the investigators asked their is not disputed, their putative role in synesthesia
synesthete, C., to identify a briefly flashed tar- has yet to be established. Several aspects of the
get digit that was immediately followed by a data themselves are also puzzling. For instance,
pattern mask. The digit was achromatic, and C.’s performance in the congruent conditions
appeared on a background that was colored so of the two experiments, in which the target item
Mattingley: Attention, Automaticity and Awareness in Synesthesia 151

Figure 2. Target and distractor stimuli used in the visual search tasks of Edquist et al.
(2006). In each trial participants indicated which of two target items (T1 or T2) was present
among 7, 15, or 23 distractors (D). (A) Chromatic and achromatic stimuli for each of the 14
synesthetes (Syn). Note that the colors used in the chromatic displays were selected to match
the synesthetic colors for each individual. (B) Example of an achromatic display for the largest
set size (24 items). (C) Example of a chromatic display for the largest set size. Reproduced
from Edquist et al. 2006.

should have been effectively camouflaged by characters were presented on matching or non-
the real background color, was in fact no worse matching backgrounds. Such a condition was
than that of several of the nonsynesthetic con- not included in either investigation.
trols. In addition, it is not clear what outcome A recent study revisited the color camou-
one would expect in these tasks if chromatic flage effect in a group of seven grapheme-color
152 Annals of the New York Academy of Sciences

synesthetes. Instead of using colored back- whether limiting or diverting selective atten-
grounds, however, Gheri et al. (2008) used a tion from an inducing character can modulate
4 × 4 matrix of Arabic numerals within which the synesthetic concurrent. Some synesthetes
a single, achromatic target numeral appeared. we tested admit that their colors often fade or
The identity of the target was chosen so that are absent altogether when they are absorbed
it elicited a unique synesthetic color for each in reading a book or listening to dialogue on
individual. The identities of the distractors, on the radio or during a movie. One of our synes-
the other hand, were chosen such that they thetes, KP, said:
evoked a single but distinct color relative to the It’s kind of like looking at your own nose. If you try,
target (in the “unique” condition), or so that you can see it clearly, but you don’t walk around
at least one distractor evoked the same color the whole time ‘seeing’ your nose. But it’s always
as that of the target (the “nonunique” con- there and you can see it, just that you don’t unless
dition). If synesthetic colors pop out, then in you’re attending to it. (Rich et al. 2005 p. 67)
the unique condition the distinct color of the Anecdotal observations like this one suggest
target, relative to the distractor(s), should have that synesthetic colors, while apparently elicited
rendered search more efficient. By contrast, the involuntarily under some conditions (such as
nonunique condition should have yielded less the synesthetic Stroop task), are strongly sup-
efficient search, due to competition between pressed from awareness when the individual is
similarly colored target and distractor items attending elsewhere.
(i.e., a color camouflage effect. Gheri et al. A striking illustration of this effect in the
(2008) in fact found no evidence for a differ- laboratory emerges from having synesthetes
ence in search efficiency between synesthetes view Navon-type stimuli, in which the local
and controls across the two conditions, imply- characters (e.g., As) elicit one synesthetic color
ing that synesthetic colors do not arise in par- (red) and the global figure (e.g., B) elicits an-
allel across the visual field. other (green). When synesthetes are instructed
To summarize, several different visual search to attend selectively to the scale of the smaller
tasks have been designed to test whether synes- elements, they report experiencing the color
thetic colors are sufficiently salient to pop out triggered by the local elements only (red in this
from among achromatic distractors. To date example); by contrast, when they attend to
there is no compelling evidence for the kind the global shape they experience the color
of pop-out effect that is known to occur for for the global figure (green) (Palmeri et al.
targets defined by real colors. Moreover, the 2002). This attentional effect has been quanti-
weight of evidence suggests that the perfor- fied experimentally by having grapheme-color
mance of most synesthetes faced with achro- synesthetes name the print color of local or
matic displays is not reliably different from that global letters that are colored congruently or
of controls. Thus, despite synesthetes’ subjec- incongruently with the synesthetic colors they
tive reports of vivid color experiences, the po- elicit (Rich & Mattingley 2003, see Fig. 3).
tency of their experiences fails to translate into Responses were slowest for stimuli in which
measurable effects in the lab, at least for the items at both spatial scales were colored incon-
visual search tasks that have been implemented gruently and fastest when items at both scales
to date. were colored congruently. Response speed was
intermediate between these two conditions
Can Voluntary Attention Influence when the local elements made a different
Synesthetic Color Experiences? global letter and the display color was congru-
ent with only one of the two letters (either local
Beyond the realm of visual search, sev- or global). A further notable finding: When
eral studies have investigated the question of synesthetes actively ignored an incongruently
Mattingley: Attention, Automaticity and Awareness in Synesthesia 153

Figure 3. Examples of the four stimulus types used to study the effect of attentional com-
petition between multiple synesthetic inducers, using the colors of synesthete E.S. The task
was to name the stimulus color as quickly as possible. Note that participants never had to
name the alphanumeric characters, which were irrelevant and nonpredictive with respect to
the display color. (A) Local and global letters consistent; display color matches the synesthetic
color elicited by the letter. (B) Local and global letters consistent; display color is different
from the synesthetic color elicited by the letter. (C) Local and global letters inconsistent; dis-
play color matches the synesthetic color elicited by the local letters but is incongruent with the
global letter. (D) Local and global letters inconsistent; display color matches the synesthetic
color elicited by the global letter but is incongruent with the local letters. Reproduced from
Rich and Mattingley (2003).

colored global stimulus and focused instead on press synesthetic concurrents, a finding that
congruently colored local elements, the Stroop has emerged from other studies, as outlined
effect was significantly attenuated relative to below.
when participants were not cued to the local Another approach to examining the effect of
level in advance. The same reduction was attention on synesthetic colors is to have par-
apparent when synesthetes ignored the incon- ticipants engage in a secondary task while they
gruently colored local elements and were cued view inducing characters, and to measure the
to attend to just the congruently colored global magnitude of any color experience with and
form. These findings indicate that voluntary without the secondary task. In one such study
attention modulates induced color experiences, (Mattingley et al. 2006), we had grapheme-
as measured by the synesthetic Stroop task. color synesthetes perform a variant of the synes-
It should be noted, however, that there was thetic Stroop task. In each trial an achromatic
still some residual cost of having incongruently letter prime appeared briefly (for 400 ms) at fix-
colored items at the ignored level, implying ation, followed by a congruent or incongruent
that attentional control might not fully sup- color patch that participants had to name as
154 Annals of the New York Academy of Sciences

Figure 4. Sequence of displays in a typical trial of the attentional load task of Mattingley
et al. (2006). Participants attended to diagonally opposite sides of the diamond throughout
a block of trials. In this example, focusing attention on the top-left and bottom-right gaps
constituted the low-load condition (a relatively easy discrimination); focusing attention on the
top-right and bottom-left gaps constituted the high-load condition (a difficult discrimination).
Participants first named the color of the target display as quickly as possible (“green” in
this case), and then indicated which gap in the attended pair was larger. Reproduced from
Mattingley et al. (2006).

quickly as possible (Fig. 4). The letter prime (RTs) for incongruent versus congruent trials—
was encompassed within a diamond-shaped in the absence of any attentional load, consis-
surround, into which small gaps were inserted tent with previous reports. Crucially, with the
midway along all four sides. These gaps, which introduction of a secondary task, the magnitude
were used for the secondary task, appeared and of the synesthetic Stroop effect was significantly
disappeared with the prime letter. At the begin- smaller under high-attentional load than un-
ning of each block, participants were instructed der low-attentional load. Note that the displays
to attend to opposite limbs of the diamond (e.g., and task demands remained identical across
upper left and lower right) in order to judge the two load conditions, ruling out any expla-
which of the attended gaps was larger. They nation for the difference in terms of working
made an unspeeded response at the end of the memory or response competition with the gap
trial, after their speeded response to the color of discrimination task. The findings suggest that
the target. “Low-attentional load” blocks were diverting visual attention from a synesthetic in-
those for which the sizes of the gaps were ad- ducer attenuates synesthetic colors (or at least a
justed to be relatively easy to distinguish; “high- measurable effect of their occurrence), consis-
attentional load” blocks were those where the tent with many synesthetes’ subjective reports
gaps were much harder to discriminate. (Rich et al. 2005).
We measured the magnitude of the synes- Rather than having synesthetes divide their
thetic Stroop effect under conditions of low and perceptual resources across multiple elements
high load in the secondary task, and compared of a common display, investigators have also
this with the effect when participants were in- measured the influence of the temporal allo-
structed to ignore the gaps altogether (a “no cation of attention by embedding an inducer
load” condition). We found a robust synesthetic within a rapid serial visual presentation (RSVP)
Stroop effect—that is, slower reaction times of distractor items. Using this design and having
Mattingley: Attention, Automaticity and Awareness in Synesthesia 155

participants identify an initial target item (T1) guess the identity of a partially processed T2
in the stream enables the investigators to ask digit, but were nevertheless prepared to guess
if synesthetic colors can arise for inducers that its color. Although the authors instructed their
appear within the period of the “attentional participants to report stimuli only if they were
blink” (AB) (Raymond et al. 1992). Johnson certain they had seen them, it is impossible to
et al. (2007) had grapheme-color synesthetes rule out such a criterion shift. A second exper-
monitor an RSVP stream of non-alphanumeric iment, in which the T2 digit was now colored
distractors, such as #, %, and ?, selected so as congruently or incongruently with the synes-
not to elicit any synesthetic colors. Each stream thetic color it elicited, revealed that T2 was
also contained a single, achromatic letter (T1), more likely to be identified if it was colored
chosen for each synesthete so that it would not congruently than if it was colored incongru-
elicit a synesthetic color, plus a single achro- ently. This finding provides some evidence for
matic digit (T2), at different lags, chosen from an interaction between real and synesthetic col-
a set of digits, each of which elicited a distinct ors during RSVP streams in which attention
synesthetic color. Participants were to iden- must be rapidly deployed over multiple stim-
tify T1 and T2, and then to indicate whether uli. However, the effect was reliable for only 3
they had been aware of any color during the of the 10 synesthetes, and it does not speak at
trial. Note that the Johnson et al. (2007) de- all to the issue of whether synesthetic colors can
sign ensured that any synesthetic color should be elicited by unseen inducers presented within
only be attributable to the digit, which was the period of the AB.
always T2. We recently examined this question (Rich &
Synesthetes and nonsynesthetic controls Mattingley 2005) using an achromatic RSVP
showed comparable AB effects, both in terms stream of nonalphanumeric distractors within
of duration and depth (roughly 88% correct which an inducing letter was positioned on 50%
T2 identification). The crucial data, however, of trials at a variable lag following presenta-
concerned the synesthetes’ color responses. tion of T1 (an achromatic grating at one of
When they correctly identified T2 they virtu- four orientations; see Fig. 5). Our aim was to
ally always reported the appropriate synesthetic establish whether a T2 letter presented dur-
color. When T2 was missed, the synesthetes ing the AB would influence the time required
typically reported no color. But on a small pro- to identify a congruently or incongruently col-
portion of “miss” trials, a color was reported, ored target patch at the end of the stream. In
and this was significantly more likely to be the separate blocks of trials participants performed
color normally elicited by the T2 digit than one of three tasks. First, we verified an AB ef-
that elicited by any of the other possible digits. fect by having participants detect T2 after first
Superficially, these findings would seem to sup- identifying the orientation of the T1 grating. In
port the authors’ claim that synesthetic colors this task both controls and synesthetes exhib-
can arise unconsciously, during a time period ited a significant dual-task decrement at lags 2
in which the relevant inducer was present but and 3 (stimulus onset asynchronies [SOAs] of
rendered invisible due to the AB. On closer in- 233 and 350 ms). Second, we established that a
spection, however, the results seem less convinc- synesthetic Stroop effect was present for T2 let-
ing. First, the AB effect was very small overall, ters by having participants detect T2 and then
and so the color-report data were based on just identify the color of the patch at the end of the
138 of 3,200 trials over the group of 10 synes- RSVP stream. For this task, synesthetes were
thetes. Moreover, only 4 of the 10 individuals significantly slower to name incongruent ver-
exhibited reliable color reports for unseen T2 sus congruent color targets across all SOAs (up
digits. Finally, and perhaps most importantly, to 816 ms). In the critical task we determined
the synesthetes might have been less willing to the influence of attention on the congruency
156 Annals of the New York Academy of Sciences

Figure 5. Appearance and timing of displays in the attentional blink task of Rich and
Mattingley (2005). (A) Schematic representation of the trial sequence. Each display was
presented for 100 ms and was followed by a blank screen for 17 ms (not shown). The color
of the probe was either congruent or incongruent with the synesthetic color elicited by the
T2 letter-prime. (B) Timing of displays within a trial, and the number of target and distractor
items. SOA = stimulus onset asynchrony; ISI = interstimulus interval.

effect by measuring color-naming times when Can Synesthetic Color Experiences


participants first identified the orientation of Arise from Unconsciously
the T1 grating. We found a reliable but atten- Processed Inducers?
uated congruency effect for T2 items falling
outside of the AB, but not for T2 items that The attentional blink studies reviewed above
appeared at the deepest point in the AB (i.e., yielded conflicting results on whether unat-
at a T1-T2 SOA of 350 ms). Taken together, tended inducing characters can trigger synes-
the findings suggest that synesthetic colors, and thetic experiences of color, as outlined above.
the effect they exert on color identification, can Johnson et al. (2007) found that synesthetic col-
be effectively eliminated when visual attention ors were reported occasionally when the induc-
is completely occupied in processing a visual ing character could not be overtly identified,
distractor. whereas Rich and Mattingley (2005) found that
Mattingley: Attention, Automaticity and Awareness in Synesthesia 157

synesthetic interference was eliminated for in- Both synesthetes and matched nonsynesthetic
ducers that appeared during the AB. In both controls were significantly slower to name the
these studies participants were unable to con- target letters on incongruent than congru-
sciously identify the critical inducers because of ent trials, indicating that the unseen primes
an attentional bottleneck in information pro- were processed at least to the stage of letter
cessing induced by the requirement to report recognition.
a preceding target within the RSVP stream The findings of Mattingley et al. (2001)
(Raymond et al. 1992). Despite this discrep- suggest that explicit recognition of inducing
ancy, it is widely agreed that many perceptual characters is required for the induction of
and cognitive processes can proceed in the ab- synesthetic colors (or at least for any effects of
sence of subjective awareness. There is a wealth synesthetic colors to be measured objectively).
of evidence, for example, that visual stimuli that This conclusion has been challenged on the
are presented briefly and masked from aware- grounds that the synesthetic priming effect
ness can nevertheless exert a measurable influ- might be weak or variable in comparison with
ence on behavior (Snow & Mattingley 2003). the letter-identity priming effect measured in
Mattingley et al. (2001) addressed this issue their control task (Blake et al. 2005). If so, then
by having grapheme-color synesthetes perform many more trials of the synesthetic priming
a variant of the synesthetic Stroop task, in which task might be needed to uncover a subtle effect
achromatic inducing characters were flashed of an unconscious prime on color-naming
briefly and masked to limit conscious percep- performance. A further issue is that there is
tion. In the main experiment a forward mask no reason to expect that all synesthetes will
was followed immediately by a letter prime, exhibit an unconscious priming effect, and so
and then a colored backward mask that acted analysis of group data might miss any reliable
as a target. Participants ignored the prime and individual differences. We have examined the
concentrated exclusively on naming the color performance of each individual who partici-
of the target mask, which could be congru- pated in the Mattingley et al. (2001) study and
ent or incongruent with the letter prime, as found no evidence for reliable color priming
quickly as possible. When the prime appeared effects in any of the synesthetes. Nevertheless,
for 500 ms, and thus was clearly visible, there it would be useful to repeat the study in a
was a robust synesthetic Stroop effect such that small number of synesthetes, using individually
color-naming times were slower in the incon- titrated prime durations and many more trials,
gruent trials than in the congruent trials. For to determine whether synesthetic colors can
primes of 56 and 28 ms duration, however, the be elicited by inducers that are not consciously
Stroop effect disappeared. To check whether perceived.
the primes could be identified explicitly at these
shorter presentation durations a further experi-
ment was conducted in which participants were How Might Synesthetic Experiences
instructed instead to identify the prime and ig- Arise within the Brain?
nore the colored target. In this experiment, par-
ticipants could readily identify the prime when In the context of the behavioral data re-
it appeared for 500 ms but were unable to do viewed above, it seems reasonable to ask how
so reliably at 56 and 28 ms. To verify that the synesthesia might arise from coordinated brain
primes were being processed at these shorter activity. It is now more or less taken for granted
durations, a control experiment was performed that grapheme-color synesthetes do not have
in which the colored target was replaced by any kind of recognized psychiatric or neurolog-
an uppercase letter that either matched or did ical illness (Rich et al. 2005). Moreover, de-
not match the identity of the lowercase prime. spite the evidence for significant Stroop-like
158 Annals of the New York Academy of Sciences

interference effects in laboratory studies, most to spoken words, whereas in a control task they
synesthetes clearly lead completely normal—if heard pure tones. In the spoken-word condi-
slightly more colorful—lives. Early suggestions tion, synesthetes showed significantly greater
of a higher incidence of left-handedness have activation than did controls in several extras-
proven unfounded (Rich et al. 2005), and al- triate regions, including the superior occipital
though some synesthetes report difficulties with lobe, bilateral parietal cortex, and the posterior
tasks such as mathematical reasoning (Rich portion of the left inferior temporal cortex. This
et al. 2005), others have been shown objec- pattern implies some contribution of higher
tively to have superior abilities in areas such as level associative brain areas, and perhaps lan-
new learning and recent memory (Smilek et al. guage centers, in phonemically driven synes-
2002). thetic color experiences. Interestingly, there was
Any neural explanation for synesthesia must no differential activity within the human homo-
be able to account both for the unusual per- logue of area V4, located in the fusiform gyrus,
ceptual experiences and for the absence of con- which in humans is assumed to be crucial for
comitant abnormalities in the perceptual, cog- color perception (Lueck et al. 1989; Zeki &
nitive, and affective domains. To date there Marini 1998).
have been two dominant accounts. One sug- The results of the Paulesu et al. (1995) study
gests that synesthesia arises as a consequence are intriguing because they imply a relatively
of disinhibited feedback from higher associa- high level locus for synesthetic color experi-
tive areas of the cortex to lower perceptual ences. Unfortunately, it is difficult to draw firm
and sensory areas (Grossenbacher & Lovelace conclusions from the findings for two reasons.
2001); the other suggests that there is anoma- First, the authors did not have participants en-
lous or additional cross-wiring between one gage in a relevant behavioral task, so it is impos-
or more brain areas responsible for processing sible to determine what they actually perceived
graphemes and color (Harrison & BaronCo- during the scanning runs. Second, the baseline
hen 1996; Ramachandran & Hubbard 2001a). task of listening to pure tones, while presum-
The behavioral data reviewed here do not re- ably effective in not eliciting synesthetic colors,
ally offer direct evidence for or against either did not control for the various linguistic and
model. Nor is it clear what kind of behav- cognitive processes engaged while listening to
ioral experiment would actually allow a rig- words.
orous test of the models, since neither has A similar limitation applies to the study
yielded predictions specific enough to permit by Nunn et al. (2002), who used fMRI to
falsification. Since both the disinhibited feed- compare brain activity in synesthetes and
back and anomalous cross-wiring hypotheses nonsynesthetic controls, using spoken words
are couched in terms of neural architectures, versus pure tones as stimuli. In addition to
a more fruitful approach might be to seek an- extensive activation of language areas, as
swers from brain imaging and neurostimulation expected from their experimental and baseline
techniques. conditions, these authors found a significant
cluster of activity in the vicinity of area V4/V8
Evidence from Brain Imaging Studies in the left hemisphere of synesthetes only. In-
terestingly, in a second experiment the authors
One early study conducted by Paulesu et al. had participants view colored Mondrians and
(1995) employed positron emission tomogra- found a similar left-sided V4/V8 cluster in
phy (PET) to examine cerebral activity in six nonsynesthetic controls, but no such activity
individuals who experienced colors when they for these chromatic stimuli in the synesthetes
heard spoken phonemes or words. In the ex- (though the synesthetes did show a significant
perimental condition the participants listened color-related response in the right V4/V8
Mattingley: Attention, Automaticity and Awareness in Synesthesia 159

region). Based upon these findings, the authors experiment is difficult to interpret, since the
suggested that area V4/V8 in the left hemi- nonsynesthetic controls received only a handful
sphere of synesthetes is no longer available for of trials in which to learn the word−color asso-
processing real, chromatic stimuli because it ciations, whereas synesthetes presumably have
has been annexed for generating synesthetic had a lifetime of such associations. Moreover, it
color experiences instead. Such modularity is impossible to rule out that the control partic-
of color processing has some appeal, since it ipants actually generated color images in both
might explain why synesthetes rarely confuse the imagery task and the word-association con-
real and synesthetic colors, and why they dition (the intended baseline), especially since
report experiencing both concurrently. On the training regime involved explicit pairings of
the other hand, such radical “rewiring” of the display colors and color names.
extrastriate visual system would be expected to At least one other fMRI study examined
have measurable consequences for synesthetes’ the neural correlates of color imagery in
ability to process real colors, but to date there synesthesia (Rich et al. 2006). During scan-
is no evidence to support this prediction. ning, synesthetes and nonsynesthetic controls
A further feature of the fMRI study by Nunn viewed pairs of grayscale photographs of fruits
et al. (2002) is worthy of mention. It is often sug- and vegetables (Fig. 6). In the experimental
gested that the experiences of grapheme-color trials the participants’ task was to indicate
synesthetes are akin to a vivid form of mental which of the two items, if viewed in their
imagery. Indeed, one recent study of a group natural state, would be darker in color (the
of 38 synesthetes found that self-rated visual color−imagery condition). In the control trials
imagery, as indexed by the Vividness of Visual participants viewed the identical photographs
Imagery Scale (VVIQ) (Marks 1973), was sig- but now judged which of the pair, if viewed
nificantly higher for the synesthetes than it was in their natural state, would be larger in size
for a group of nonsynesthetic controls (Barnett (the size−imagery condition). A comparison
& Newell 2008). Moreover, nonsynesthetes with between the two tasks revealed significant ac-
high scores on the VVIQ show increased ac- tivity in the right inferior occipital lobe, around
tivation in visual cortex during imagery tasks area V4, in both synesthetes and controls. This
(Cui et al. 2007). It is therefore important to occipital cluster was much larger in the synes-
know whether the patterns of brain activation thetes than the controls, perhaps implying a
revealed in fMRI studies of synesthesia can be greater capacity for color imagery in this group
distinguished from those one might expect to (see also Barnett & Newell 2008). Interestingly,
see in nonsynesthetes who are instructed to in a separate task in which participants viewed
imagine colors. Nunn et al. (2002) addressed colored letters versus achromatic placeholders
this issue by training nonsynesthetes to asso- that did not induce synesthesia, the synesthetes
ciate colors with words. Following training, the showed significant activity in the left medial
participants underwent fMRI scans in which lingual gyrus, but not area V4/V8.
they were instructed, in separate blocks, ei- Several other fMRI studies have examined
ther to imagine the color associated with each different aspects of synesthetic color experi-
spoken word presented over headphones or to ences, with varying results (Aleman et al. 2001;
imagine the name of the color associated with Hubbard et al. 2005; Steven et al. 2006; Weiss
each word. The controls showed no differential et al. 2001, 2005). Due to space constraints,
activity within V4/V8, unlike the synesthetes in the findings of these studies will not be covered
the word-versus-tone experiment, leading the here; instead the reader is referred to the excel-
authors to conclude that the V4/V8 result in lent review by Hubbard and Ramachandran
synesthetes could not be due to color imagery. (2005). Before concluding this section, however,
Unfortunately, the null effect from the imagery it is worth mentioning two studies that have
160 Annals of the New York Academy of Sciences

Figure 6. Example stimuli and fMRI activations for the voluntary color imagery experiment
of Rich et al. (2006). (A) Example stimuli for the color imagery and size (baseline) tasks.
Participants were asked to judge which object would be darker in color or larger in size. (B)
Activity within the functionally defined ROIs for the color imagery versus baseline contrast.
Brain slices show regions of significantly greater activity for control participants (yellow) and
synesthetes (red). For controls significant activation was found in the right inferior occipital
lobe (x, y, z: 26, −90, −18; p = 0.016); for synesthetes significant activation occurred in
the right inferior occipital lobe (red; x, y, z : 34, −88, −20; p < 0.001) and right fusiform
gyrus (x, y, z: 30, −94, −26; p = 0.001). Coordinates in this and all subsequent figures
have been calculated using the MNI three-dimensional space.

provoked considerable interest for their novelty ioral tasks involved visual search for an embed-
and rigor. ded figure composed of achromatic graphemes
Hubbard et al. (2005) conducted a study in (Hubbard et al. 2005) and identification of a pe-
which six synesthetes and a group of matched, ripheral grapheme under conditions of visual
nonsynesthetic controls completed two behav- crowding (Ramachandran & Hubbard 2001b).
ioral tasks and a series of fMRI scans, with the The fMRI studies involved fine-grained retino-
researchers’ aim being that of uncovering any topic mapping of striate and extrastriate ar-
parametric changes in brain activity as a func- eas, as well as a separate delineation of regions
tion of behavioral performance. The behav- that responded selectively to graphemic forms.
Mattingley: Attention, Automaticity and Awareness in Synesthesia 161

Hubbard et al. (2005) found that color-selective responses to the color-inducing graphemes in
area V4 was uniquely active in synesthetes rela- the group of synesthetes. These data provide
tive to controls when participants viewed achro- the first evidence in favor of the hypothesis that
matic graphemes. Moreover, they showed that abnormal cross-activation of grapheme- and
V4 activity in the synesthetes tended to be color-processing areas gives rise to synesthetic
greater for those individuals who performed experiences of color.
better on the visual crowding task. The authors
interpreted their findings as consistent with the Evidence from Event-Related
notion of abnormal cross-activation between Potential Studies
grapheme-processing areas in the ventral tem-
poral lobe and the nearby color-selective area Brain imaging techniques such as PET and
V4, though fMRI data alone do not permit fMRI provide a reasonably good estimate of
firm conclusions regarding patterns of neural the location of brain activity corresponding
connectivity. with perceptual, cognitive, and motor states,
Direct evidence for the cross-wiring hypoth- but are less sensitive to subtle changes in the
esis has proven elusive, but a recent study by timing of involvement of brain regions. The
Rouw and Scholte (2007) has gone some way significant BOLD activity observed within ex-
toward addressing this issue. They used diffu- trastriate cortex (including the color selective
sion tensor imaging (DTI) to measure fractional area V4) in association with synesthetic color
anisotropy in the brains of 18 grapheme-color experiences might be interpreted as evidence
synesthetes and a group of nonsynesthetic con- for the involvement of this area in the initial
trols. In DTI magnetic resonance imaging is feedforward sweep of input from the primary
used to measure the diffusion properties of wa- visual cortex. In principle, however, such acti-
ter molecules. Regions in which white matter vation might be due to later feedback signals
tracts are organized in a common direction will arising from temporal, parietal, or frontal as-
tend to have higher fractional anisotropy val- sociation areas. To address this interpretative
ues than those in which the white matter is limitation, a small number of studies have used
arranged more heterogeneously with respect scalp-recorded, event-related potentials to ex-
to direction. DTI thus provides a means of amine moment to moment changes in neural
assessing the relative coherence of white mat- activity associated with synesthetic experiences.
ter connectivity within and between brain ar- An early study by Schiltz et al. (1999) had 17
eas. Rouw and Scholte (2007) performed DTI grapheme-color synesthetes view achromatic
scans in their synesthetes and controls, as well letters and digits that appeared briefly on a
as an fMRI study in which the same individuals computer display. The researchers asked sub-
viewed achromatic graphemes selected to elicit jects to respond to occasional predefined targets
strong, intermediate, or weak color experiences (a subset of the letters and digits). They found a
for the synesthetes. Significantly higher values significant enhancement in the P300 response
of fractional anisotropy, indicating a greater over frontal electrode sites in the synesthetes
strength of connectivity within white matter compared with a group of nonsynesthetic con-
tracts, were found for synesthetes versus con- trols. This result is somewhat surprising in light
trols in two distinct areas of interest: the left of the early perceptual effects that synesthetic
superior parietal cortex and the right inferior colors appear to have on behavioral perfor-
temporal cortex, immediately adjacent to the mance and considering the unique brain ac-
fusiform gyrus. Moreover, the authors observed tivity associated with synesthetic experiences in
a significant correlation between the strength of color-selective area V4.
connectivity within the right inferior temporal A more recent ERP study was conducted
site and blood oxygen level-dependent (BOLD) by Sagiv et al. (2006). Their grapheme-color
162 Annals of the New York Academy of Sciences

synesthete was shown letters colored congru- ing, perhaps after the initial feedforward sweep
ently or incongruently with her synesthetic ex- of inputs from the primary visual cortex. A fur-
periences. During the experiment she was in- ther recent ERP study used contextual priming,
structed to monitor for the appearance of an in which sentences used to invoke a particular
occasional target letter (an “I,” which was ex- color concept (e.g., “The sky is. . .”) ended with
perienced as white) and to report the number a grapheme (e.g., the number “7”) that elicited
of times this target appeared at the comple- a congruent or incongruent synesthetic color
tion of each block. Averaged ERPs showed a (Brang et al. 2008). Averaged waveforms for
significantly larger negative amplitude in the the synesthetes showed a significant congru-
N1/N170 component for congruent relative to ency effect for early ERP components, includ-
incongruent trials. This difference was appar- ing the N1 and P2, consistent with other rele-
ent for posterior parietal electrodes, and was vant findings (Beeli et al. 2008; Sagiv & Ward
larger over the right hemisphere than the left. 2006), plus a significant congruency effect for
These findings suggest a much earlier emer- the N400 component, which is widely recog-
gence of synesthetic color experiences than sug- nized as providing an index of the extent to
gested by Schiltz et al. (1999), or at least a which a meaningful stimulus matches a primed
much earlier onset for the congruency effect context.
that arises from such experiences. To summarize, data from ERP studies sug-
Broadly similar findings were reported by gest that differences attributable to synesthetic
Beeli et al. (2008), who measured ERPs in a colors can arise as early as 120 ms after the pre-
group of 13 synesthetes and 13 nonsynesthetic sentation of an appropriate auditory or visual
controls in response to spoken words and let- inducer. Later components, perhaps reflecting
ters presented over headphones. Their partic- a more conceptual level of analysis, have also
ipants performed a cued, one-back task to en- been found as a distinguishing feature of ERPs
sure they maintained attention on the stimuli in synesthetes versus controls. Future studies
(though performance for the group was at ceil- will need to focus carefully on source localiza-
ing so it is impossible to know to what extent tion, which is a perennial problem with ERP
the task actually taxed attentional resources). A research. This could be achieved by combining
direct comparison of the averaged ERP data ERP and fMRI, as has been done in a recent
for synesthetes revealed longer latencies for the case study of an individual with digit−color
N1 and P2 components and a significantly re- synesthesia (Kadosh et al. 2007). It will also be
duced amplitude for the P2 component relative important to characterize the influence of at-
to those of controls. Source localization sug- tention on ERPs, since attention clearly exerts
gested stronger activity for synesthetes within a profound influence both on subjective reports
the posterior region of the left inferior tempo- of synesthetic experiences, and on objective be-
ral cortex, including area V4, and in the lat- havioral measures of the phenomenon.
eral and medial prefrontal cortex, and these ef-
fects emerged as early as 122 ms after stimulus Evidence from Transcranial Magnetic
presentation. Stimulation Studies
These findings are broadly consistent with
those of fMRI studies in which inferior tem- Despite numerous insights into the neural
poral regions were found to be active during underpinnings of synesthesia offered by fMRI
synesthetic color experiences (Hubbard et al. and ERP studies, these two approaches suffer
2005; Nunn et al. 2002; Paulesu et al. 1995; from a fundamental limitation, namely, that
Rich et al. 2006). Moreover, the ERP data of they can only identify patterns of neural ac-
Beeli et al. (2008) imply that such color experi- tivity that are correlated with behavior, rather
ences can emerge quite early in cortical process- than regions that have played a causal role in
Mattingley: Attention, Automaticity and Awareness in Synesthesia 163

the phenomenon. To address this limitation two left and right hemispheres: a region neighbor-
recent studies have used transcranial magnetic ing the parieto−occipital junction and a region
stimulation (TMS) to transiently disrupt corti- just anterior to this, roughly in the vicinity of the
cal areas thought to be involved in synesthe- angular gyrus location targeted by Esterman
sia (see Chambers & Mattingley 2005). Both et al. (2006). The cost of incongruently colored
studies examined the potential contributions of graphemes was significantly reduced following
subregions of the inferior parietal cortex, since rTMS of the right parieto−occipital area, again
this area has been implicated, both directly and implicating the right inferior parietal lobe in the
indirectly, in attentional binding of visual form anomalous binding of form and color in synes-
and color in normals and neuropsychological thesia. Closer inspection of the results, however,
patients (Robertson 2003). indicates that stimulation of the right angular
Esterman et al. (2006) tested two grapheme- gyrus and left parieto−occipital area also re-
color synesthetes on a standard version of the sulted in a substantially reduced Stroop effect,
synesthetic Stroop task, in which participants suggesting that the effect might be mediated via
named the colors of congruent, incongruent, a fairly widespread, bilateral network of cortical
and neutral letters. Participants received repet- areas.
itive TMS (rTMS) for 8 min at 115% of motor Future studies using TMS should focus on
threshold, with the stimulating coil positioned early visual areas, including V1, and elsewhere
over the left or right angular gyrus (near the within ventral and dorsal extrastriate pathways
junction of the intraparietal sulcus and trans- to help determine where in the cortical process-
verse occipital sulcus). Baseline performance ing hierarchy synesthetic colors arise. It will also
was measured in two control conditions: a pari- be important to use time-locked TMS protocols
etal “sham” condition, in which the coil was to reveal the fine-grained temporal dynamics
oriented at 90◦ from the scalp so that the mag- involved in the integration of visual form and
netic pulse was directed away from the brain; color.
and an active control, in which the coil was
positioned over the occipital pole, close to the
primary visual cortex (V1). Both synesthetes Conclusion
showed a significant reduction in the magni-
tude of Stroop interference following rTMS In this article I have provided a selective
over the right angular gyrus relative to the size overview of recent research on the role of atten-
of the effect following the sham treatment. This tion, automaticity, and awareness in the behav-
reduction was not apparent following stimula- ioral and neural manifestations of grapheme-
tion of the left angular gyrus, or for stimulation color synesthesia. The picture that emerges is
of area V1. The findings suggest that right pari- that synesthetic color experiences are typically
etal stimulation transiently disrupts the neural triggered automatically, in the absence of vol-
binding of form and color, thereby reducing untary effort. Synesthetic colors might help to
any perceptual or cognitive conflict between guide attention during visual search of achro-
the synesthetic and real colors on incongruent matic displays, but there is no convincing evi-
trials. dence to suggest they “pop out” like unique col-
A conceptually similar study was reported ors in chromatic displays. On the other hand,
by Muggleton et al. (2007), who tested five synesthetic colors can be strongly attenuated
grapheme-color synesthetes on the synesthetic by demanding secondary tasks or when induc-
Stroop task. Their participants received rTMS ers must compete with one another for selec-
at 10Hz for 500 ms following the onset of tion. Indeed, it seems likely that mechanisms
each target grapheme. Stimulation was deliv- of attention play a causal role in synesthesia by
ered over one of two parietal sites in both the acting to bind, in an obligatory fashion, visual
164 Annals of the New York Academy of Sciences

representations of graphemic form and color. that can be falsified by suitably designed exper-
Whether synesthetic colors can be triggered iments. Arguably, no such model currently ex-
without explicit awareness of the inducing stim- ists. Nevertheless, given the enormous progress
ulus is still debated, but currently the evidence made in the last decade, there is reason for
suggests that inducers must be consciously per- optimism.
ceived to exert a measurable influence on be-
havior. These behavioral findings are mirrored Acknowledgments
by data from brain imaging studies, which have
shown modulations of neural activity associated My sincere thanks to Anina Rich for stimu-
with synesthetic color experiences within ex- lating my interest in synesthesia and for her sub-
trastriate regions, including the color-selective stantial contributions to much of the research
area V4. Transient disruption of the inferior reviewed in this article. Thanks also to Mike
parietal lobule, a region widely recognized as Dixon for his helpful comments on an earlier
a key node in the attention network, can selec- version of the manuscript.
tively reduce the otherwise automatic binding
of form and color in synesthesia. Conflicts of Interest
Clearly there are many questions yet to be
answered. For example, are all grapheme-color The author declares no conflicts of interest.
synesthetes alike, or are there important indi-
vidual differences? In this article I considered
References
evidence for the proposed distinction between
“projector” synesthetes, for whom colors are
Aleman, A., Rutten, G. J. M., Sitskoorn, M. M., et al.
said to be experienced “out in the world,” and (2001). Activation of striate cortex in the absence
“associator” synesthetes, who see colors in their of visual stimulation: an fMRI study of synesthesia.
mind’s eye (Dixon et al. 2004). Although the Neuroreport, 12(13), 2827–2830.
dichotomy has been widely used in the liter- Asher, J. E., Aitken, M. R. F., Farooqi, N., et al. (2006).
ature, recent evidence suggests that the man- Diagnosing and phenotyping visual synesthesia: A
preliminary evaluation of the revised Test of Gen-
ner in which individuals use language to de- uineness (TOG-R). Cortex, 42(2), 137–146.
scribe their color experiences can change over Barnett, K. J., Finucane, C., Asher, J. E., et al. (2008).
time (Edquist et al. 2006). It has also been sug- Familial patterns and the origins of individual
gested that the projector−associator distinction differences in synaesthesia. Cognition, 106, 871–
reflects the engagement of different spatial ref- 893.
Barnett, K. J., & Newell, F. N. (2008). Synaesthesia is
erence frames for synesthetic color experiences,
associated with enhanced, self-rated visual imagery.
rather than fundamentally different underlying Consciousness & Cognition, 17(3), 1032–1039.
neural processes. The same caveats apply to Baron-Cohen, S., Burt, L., SmithLaittan, F., et al. (1996).
the proposed distinction between “lower” and Synaesthesia: Prevalence and familiarity. Perception,
“higher” synesthetes (Ramachandran & Hub- 25(9), 1073–1079.
bard 2001a). Baron-Cohen, S., Wyke, M. A., & Binnie, C. (1987). Hear-
ing words and seeing colours: An experimental in-
The danger faced by synesthesia researchers vestigation of a case of synaesthesia. Perception, 16(6),
is that we will be reduced to cataloguing new 761–767.
and unusual variants of the condition, rather Beeli, G., Esslen, M., & Jancke, L. (2005). Synaesthesia –
than constructing scientific accounts for the When coloured sounds taste sweet. Nature, 434(7029),
phenomena based upon currently accepted 38–38.
Beeli, G., Esslen, M., & Jancke, L. (2008). Time course
principles of brain structure and function.
of neural activity correlated with colored-hearing
What is desperately needed is a model of synes- synesthesia. Cerebral Cortex, 18(2), 379–385.
thesia that can generate testable predictions Blake, R., Palmeri, T. J., Marois, R., et al. (2005).
with respect to brain activity and behavior, and On the perceptual reality of synesthetic color. In
Mattingley: Attention, Automaticity and Awareness in Synesthesia 165

L. Robertson & N. Sagiv (Eds.), Synesthesia: Perspectives Hubbard, E. M., & Ramachandran, V. S. (2005). Neu-
from Cognitive Neuroscience (pp. 47–73). Oxford: Oxford rocognitive mechanisms of synesthesia. Neuron, 48(3),
University Press. 509–520.
Brang, D., Edwards, L., Ramachandran, V. S., et al. Johnson, A., Jepma, M., & de Jong, R. (2007). Colours
(2008). Is the sky 2? Contextual priming in sometimes count: Awareness and bidirectionality in
grapheme-color synaesthesia. Psych. Sci., 19(5), 421– grapheme-colour synaesthesia. Quar. J. Exp. Psych.,
428. 60, 1406–1422.
Chambers, C. D., & Mattingley, J. B. (2005). Neurodisrup- Kadosh, R. C., Kadosh, K. C., & Henik, A. (2007).
tion of selective attention: Insights and implications. The neuronal correlate of bidirectional synesthesia:
Trends Cogn. Sci., 9, 542–550. A combined event-related potential and functional
Cui, X., Jeter, C. B., Yang, D., et al. (2007). Vivid- magnetic resonance Imaging study. J. Cogn. Neurosci.,
ness of mental imagery: Individual variability can 19, 2050–2059.
be measured objectively. Vision Res., 47, 474– Kim, C. Y., Blake, R., & Palmeri, T. J. (2006). Percep-
478. tual interaction between real and synesthetic colors.
Dixon, M. J., Smilek, D., Cudahy, C., et al. (2000). Five Cortex, 42(2), 195–203.
plus two equals yellow. Nature, 406, 365. Kooi, F. L., Toet, A., Tripathy, S. P., et al. (1994). The
Dixon, M. J., Smilek, D., & Merikle, P. M. (2004). Not effect of similarity and duration on spatial interaction
all synaesthetes are created equal: Projector versus in peripheral vision. Spatial Vision, 8, 255–279.
associator synaesthetes. Cogn. Affective Behav. Neurosci., Laeng, B., Svartdal, F., & Oelmann, H. (2004). Does color
4(3), 335–343. synesthesia pose a paradox for early-selection theo-
Edquist, J., Rich, A. N., Brinkman, C., et al. (2006). Do ries of attention? Psych. Sci., 15(4), 277–281.
synaesthetic colours act as unique features in visual Lueck, C. J., Zeki, S., Friston, K. J., et al. (1989). The
search? Cortex, 42(2), 222–231. color centre in the cerebral cortex of man. Nature,
Elias, L. J., Saucier, D. M., Hardie, C., et al. (2003). 340, 386–389.
Dissociating semantic and perceptual components MacLeod, C. M. (1991). Half a century of research on
of synaesthesia: Behavioural and functional neu- the Stroop effect: An integrative review. Psych. Bull.,
roanatomical investigations. Cogn. Brain Res., 16(2), 109, 163–203.
232–237. MacLeod, C. M., & Dunbar, K. (1988). Training and
Esterman, M., Verstynen, T., Ivry, R. B., et al. (2006). Stroop-like interference: Evidence for a continuum
Coming unbound: Disrupting automatic integration of automaticity. J. Exp. Psych.: Learning, Memory &
of synesthetic color and graphemes by transcranial Cognition, 14, 126–135.
magnetic stimulation of the right parietal lobe. J. Marks, D. F. (1973). Visual imagery differences in the
Cogn. Neurosci., 18(9), 1570–1576. recall of pictures. Brit. J. Psych., 64, 17–24.
Galton, F. (1880). Visualised numerals. Nature, 21, 252– Marks, L. E., & Odgaard, E. C. (2005). Developmental
256. constraints on theories of synesthesia. In L. Robert-
Gheri, C., Chopping, S., & Morgan, M. J. (2008). Synaes- son & N. Sagiv (Eds.), Synesthesia: Perspectives from Cog-
thetic colours do not camouflage form in visual nitive Neuroscience (pp. 214–236). Oxford: Oxford Uni-
search. Proc. R. Soc. B—Biolog. Sci., 275(1636), 841– versity Press.
846. Mattingley, J. B., Payne, J. M., & Rich, A. N. (2006).
Grossenbacher, P. G., & Lovelace, C. T. (2001). Mech- Attentional load attenuates synaesthetic priming ef-
anisms of synesthesia: Cognitive and physiological fects in grapheme-colour synaesthesia. Cortex, 42(2),
constraints. Trends Cogn. Sci., 5(1), 36–41. 213–221.
Harrison, J., & BaronCohen, S. (1996). Acquired and in- Mattingley, J. B., Rich, A. N., Yelland, G., et al. (2001).
herited forms of cross-modal correspondence. Neuro- Unconscious priming eliminates automatic binding
case, 2(3), 245–249. of colour and alphanumeric form in synaesthesia.
Hochel, M., & Milan, E. G. (2008). Synaesthesia: The Nature, 410(6828), 580–582.
existing state of affairs. Cogn. Neuropsych., 25(1), 93– Mattingley, J. B., & Ward, J. (Eds.). (2006). Cognitive Neuro-
117. science Perspectives on Synaesthesia. Milano: Masson.
Hong, S. W., & Blake, R. (2008). Early visual mechanisms Maurer, D., & Mondloch, C. J. (2005). Neonatal synes-
do not contribute to synesthetic color experience. thesia: a re-evaluation. In L. Robertson & N. Sagiv
Vision Res., 48(8), 1018–1026. (Eds.), Synesthesia: Perspectives from Cognitive Neuroscience
Hubbard, E. M., Arman, A. C., Ramachandran, V. (pp. 193–213). Oxford: Oxford University Press.
S., et al. (2005). Individual differences among Maurer, D., & Mondloch, C. J. (2006). The infant as
grapheme-color synesthetes: Brain-behavior corre- synesthete? Processes of Change in Brain and Cognitive
lations. Neuron, 45(6), 975–985. Development: Attention and Performance XXI , 449–471.
166 Annals of the New York Academy of Sciences

McCollough, C. (1965). Color adaptation of edge- ral correlates of imagined and synaesthetic colours.
detectors in the human visual system. Science, 149, Neuropsychologia, 44(14), 2918–2925.
1115–1116. Robertson, L., & Sagiv, N. (Eds.). (2005). Synesthesia: Per-
Muggleton, N., Tsakanikos, E., Walsh, V., et al. (2007). spectives from Cognitive Neuroscience. Oxford: Oxford
Disruption of synaesthesia following TMS of the University Press.
right posterior parietal cortex. Neuropsychologia, 45(7), Robertson, L. C. (2003). Binding, spatial attention and
1582–1585. perceptual awareness. Nat. Rev. Neurosci., 4(2), 93–
Nikolić, D., Lichti, P., & Singer, W. (2007). Color oppo- 102.
nency in synaesthetic experiences. Psychol. Sci., 18(6), Rouw, R., & Scholte, H. S. (2007). Increased struc-
481–486. tural connectivity in grapheme-color synesthesia.
Nunn, J. A., Gregory, L. J., Brammer, M., et al. (2002). Nat. Neurosci., 10(6), 792–797.
Functional magnetic resonance imaging of synes- Sagiv, N., Heer, J., & Robertson, L. (2006). Does binding
thesia: Activation of V4/V8 by spoken words. Nat. of synesthetic color to the evoking grapheme require
Neurosci., 5(4), 371–375. attention? Cortex, 42(2), 232–242.
Palmer, S. E. (1999). Vision Science: From Photons to Phe- Sagiv, N., & Ward, J. (2006). Crossmodal interactions:
nomenology. Cambridge, MA: MIT Press. Lessons from synesthesia. In S. Martinez-Conde,
Palmeri, T. J., Blake, R., Marois, R., et al. (2002). The per- S. Macknik, L.M. Martinez, et al. (Eds.), Visual Per-
ceptual reality of synesthetic colors. Proc, Nat. Acad. ception, Pt 2: Fundamentals of Awareness: Multi-Sensory
Sci. USA, 99(6), 4127–4131. Integration and High-Order Perception (Vol. 155, pp. 259–
Paulesu, E., Harrison, J., Baroncohen, S., et al. (1995). 271). Amsterdam: Elsevier Science Bv.
The physiology of colored hearing—A PET acti- Schiltz, K., Trocha, K., Wieringa, B. M., et al. (1999).
vation study of color-word synaesthesia. Brain, 118, Neurophysiological aspects of synesthetic experi-
661–676. ence. J. Neuropsych. Clin. Neurosci., 11(1), 58–65.
Ramachandran, V., & Hubbard, E. M. (2001a). Shevell, S. K. (1982). Color perception under chromatic
Synaesthesia—A window into perception, thought adaptation: Equilibrium yellow and long-wavelength
and language. J. Consc. Stud., 8(12), 3–34. adaptation. Vision Res., 22, 279–292.
Ramachandran, V., & Hubbard, E. M. (2003). The phe- Simner, J. (2007). Beyond perception: Synaesthesia as a
nomenology of synaesthesia. J. Consc. Stud., 10(8), psycholinguistic phenomenon. Trends Cogn. Sci., 11(1),
49–57. 23–29.
Ramachandran, V. S., & Hubbard, E. M. (2001b). Psy- Simner, J., Glover, L., & Mowat, A. (2006a). Linguistic
chophysical investigations into the neural basis of determinants of word colouring in grapheme-colour
synaesthesia. Proc, R. Soc. Lond. Ser. B—Biolog. Sci., synaesthesia. Cortex, 42(2), 281–289.
268(1470), 979–983. Simner, J., Mulvenna, C., Sagiv, N., et al. (2006b). Synaes-
Raymond, J. E., Shapiro, K. L., & Arnell, K. M. (1992). thesia: The prevalence of atypical cross-modal expe-
Temporary suppression of visual processing in an riences. Perception, 35(8), 1024–1033.
RSVP task: An attentional blink? J. Exp. Psych.: Hum. Simner, J., & Ward, J. (2006). Synaesthesia—The taste
Percep. Perf., 18, 849–860. of words on the tip of the tongue. Nature, 444(7118),
Rich, A. N., Bradshaw, J. L., & Mattingley, J. B. (2005). A 438–438.
systematic, large-scale study of synaesthesia: Implica- Simner, J., Ward, J., Lanz, M., et al. (2005). Non-random
tions for the role of early experience in lexical-colour associations of graphemes to colours in synaesthetic
associations. Cognition, 98(1), 53–84. and non-synaesthetic populations. Cogn. Neuropsych.,
Rich, A. N., & Mattingley, J. B. (2002). Anomalous percep- 22(8), 1069–1085.
tion in synaesthesia: A cognitive neuroscience per- Smilek, D., Carriere, J. S. A., Dixon, M. J., et al.
spective. Nat. Rev. Neurosci., 3(1), 43–52. (2007). Grapheme frequency and color luminance
Rich, A. N., & Mattingley, J. B. (2003). The effects of stim- in grapheme-color synaesthesia. Psychol. Sci., 18(9),
ulus competition and voluntary attention on colour- 793–795.
graphemic synaesthesia. Neuroreport, 14(14), 1793– Smilek, D., Dixon, M., Cudahy, C., et al. (2001). Synaes-
1798. thetic photisms influence visual perception. J. Cogn.
Rich, A. N., & Mattingley, J. B. (2005). Can atten- Neurosci., 13, 930–936.
tion modulate colour-graphemic synaesthesia? In L. Smilek, D., Dixon, M., & Merikle, P. (2003). Synaesthetic
Robertson & N. Sagiv (Eds.), Synesthesia: Perspectives photisms guide attention. Brain and Cognition, 53, 364–
from Cognitive Neuroscience (pp. 108–123). Oxford: Ox- 367.
ford University Press. Smilek, D., Dixon, M. J., Cudahy, C., et al. (2002). Synes-
Rich, A. N., Williams, M. A., Puce, A., Syngeniotis, A., thetic color experiences influence memory. Psychol.
Howard, M. A., McGlone, F., et al. (2006). Neu- Sci., 13(6), 548–552.
Mattingley: Attention, Automaticity and Awareness in Synesthesia 167

Smilek, D., Dixon, M. J., & Merikle, P. M. (2005). Synaes- nomenological and behavioural differences. Con-
thesia: Discordant male monozygotic twins. Neuro- sciousness and Cognition, 16, 913–931.
case, 11(5), 363–370. Ward, J., & Simner, J. (2005). Is synaesthesia an X-linked
Snow, J. C., & Mattingley, J. B. (2003). Perception, un- dominant trait with lethality in males? Perception,
conscious. In L. Nadel (Ed.), Encyclopedia of Cognitive 34(5), 611–623.
Science (pp. 517–526). London: Macmillan. Ward, J., Simner, J., & Auyeung, V. (2005). A comparison
Steven, M. S., Hansen, P. C., & Blakemore, C. (2006). of lexical-gustatory and grapheme-colour synaesthe-
Activation of color-selective areas of the visual sia. Cogn. Neurophysiol., 22(1), 28–41.
cortex in a blind synesthete. Cortex, 42(2), 304– Weiss, P. H., Shah, N. J., Toni, I., et al. (2001). Associat-
308. ing colours with people: A case of chromatic-lexical
Stroop, J. R. (1935). Studies of interference in se- synaesthesia. Cortex, 37(5), 750–753.
rial verbal reactions. J. Exp. Psych., 18, 643– Weiss, P. H., Zilles, K., & Fink, G. R. (2005). When visual
662. perception causes feeling: Enhanced cross-modal
Treisman, A. (2005). Synesthesia: Implications for atten- processing in grapheme-color synesthesia. Neuroim-
tion, binding and consciousness–A commentary. In age, 28(4), 859–868.
L. Robertson & N. Sagiv (Eds.), Synesthesia: Perspec- Wollen, K. A., & Ruggiero, F. T. (1983). Coloured-letter
tives from Cognitive Neuroscience (pp. 239–254). Oxford: synaesthesia. J. Mental Imagery, 7, 83–86.
Oxford University Press. Zeki, S., & Marini, L. (1998). Three cortical stages of
Ward, J., Li, R., Salih, S., et al. (2007). Varieties of colour processing in the human brain. Brain, 121,
grapheme-colour synaesthesia: A new theory of phe- 1669–1685.

Das könnte Ihnen auch gefallen