Beruflich Dokumente
Kultur Dokumente
COGNITIVE NEUROSCIENCE OF
HUMAN SOCIAL BEHAVIOUR
Ralph Adolphs
We are an intensely social species it has been argued that our social nature defines what
makes us human, what makes us conscious or what gave us our large brains. As a new field,
the social brain sciences are probing the neural underpinnings of social behaviour and have
produced a banquet of data that are both tantalizing and deeply puzzling. We are finding new
links between emotion and reason, between action and perception, and between representations
of other people and ourselves. No less important are the links that are also being established
across disciplines to understand social behaviour, as neuroscientists, social psychologists,
anthropologists, ethologists and philosophers forge new collaborations.
COGNITIVELY IMPENETRABLE A new field has emerged to investigate the cognitive not monolithic, but rather it consists of several tracks of
Processes that are not influenced neuroscience of social behaviour, the popularity of information processing that can be variously recruited
strategically by cognition. They which is attested by recent conferences, special issues depending on the circumstances. Specifying those
cannot be influenced at will,
and their engagement is beyond
of journals1,2 and by books3,4. But the theoretical tracks, the conditions under which they are engaged,
our control. underpinnings of this new field derive from an uneasy how they interact, and how they must ultimately be
marriage of two different approaches to social behav- coordinated to regulate social behaviour in an adaptive
SELF-REGULATION iour: sociobiology and evolutionary psychology on the fashion, is the task faced by a neuroscientific approach
The ability to control ones
one hand, and social psychology on the other. The first to social cognition.
behaviour effortfully and often
in opposition to emotional drive approach treats the study of social behaviour as a topic
(for example, controlling an in ethology, continuous with studies of motivated Social cognition and emotion
anger outburst). Most behaviour in other animals. The second approach has What is social cognition? If the social is ubiquitous, we
prominent in adult humans, often emphasized the uniqueness of human behav- face the problem of including all aspects of cognition
self-regulation depends on
regions in the prefrontal cortex.
iour, and the uniqueness of the individual person, as social. If it is special, we have to explain why and how
their environment and their social surroundings. (BOX 1). As a matter of practice, social brain science has
These two different emphases do not need to con- indeed carved out a restricted domain of cognition. The
flict with one another. In fact, neuroscience might offer bulk of studies emphasize motivational and emotional
a reconciliation between biological and psychological factors. Whereas other aspects of cognition such as
approaches to social behaviour in the realization that language, for example contribute substantially to
its neural regulation reflects both innate, automatic the regulation of social behaviour, the intuition has
and COGNITIVELY IMPENETRABLE mechanisms, as well as been that emotion stands in a privileged position. This
acquired, contextual and volitional aspects that include intuition has its basis in our observations of other
Deparment of Neurology, SELF-REGULATION. We share the first category of features species and of human infants, whose social behaviour
University of Iowa, with other species, and we might be distinguished from seems to be tightly coupled to emotion a coupling
200 Hawkins Drive, Iowa them partly by elaborations on the second category of that is heavily regulated in adults. But the intuition also
City, Iowa 52242, USA.
e-mail:
features. In a way, an acknowledgement of such an has a functional explanation. Emotions can be thought
ralph-adolphs@uiowa.edu architecture simply provides detail to the way in which of as states that coordinate homeostasis in a complex,
doi:10.1038/nrn1056 social cognition is complex it is complex because it is dynamic environment; in so far as one aspect of the
a b c
d e
Figure 2 | Visual stimuli for investigating social cognition. These range from a | point-light walkers and b | dynamic geometric
figures, to c | actual human social interactions. Facial expressions have been one of the most commonly used stimuli. d | They can
be morphed from, say, fear to sadness and e | their eye region can signal specific social information, such as guilt, fear or
flirtatiousness. Stimuli are from sets developed by: F. Heider (b), P. Ekman (d) and S. Baron-Cohen (e).
a b z-values
2
JM R
4
Normal Right Left Control
0
Bilat. Normal Bilat. Right Left Control 3
2
1
1
2 0
Implicit Explicit
6 JM 6 SM 0.4
normal mean (in s.d.)
Difference from
4 4
Signal change in
2 2
0.2
0 0
0.1
2 2
0 20 40 60 80 100 0 20 40 60 80 100
Face stimulus (rank-ordered Face stimulus (rank-ordered 0.0
Low Med High Low Med High
by mean normal rating) by mean normal rating)
3
RH Implicit Explicit
6 0.4
2
normal mean (in s.d.)
by normal subjects
Mean rating given
Difference from
4 1
Signal change in
0
2
1 0.2
0
2
0.1
2 3
0 20 40 60 80 100 0 20 40 60 80 100
Face stimulus (rank-ordered Face stimulus (rank-ordered 0.0
by mean normal rating) by mean normal rating) Low Med High Low Med High
Figure 4 | Investigating social judgement with two different methods. Investigations of the neural basis of judging
trustworthiness have yielded convergent results from functional imaging studies in normal people, and from lesion studies in
neurological patients. a | Evidence from lesion studies. Bilateral damage to the amygdala selectively impairs the ability to judge
untrustworthiness of faces. These data, from three patients (JM, SM and RH), show that the amygdala is not only involved when we
normally make social judgements, but that amygdala dysfunction precludes normal social judgement. This does not mean that the
amygdala is sufficient for judging trustworthiness, but that it is necessary. Bilat., bilateral amygdala damage (n = 3); Control, brain-
damaged controls with no damage to the amygdala (n = 10, standard error shown); Left, unilateral left amygdala damage (n = 3);
Normal, neurologically normal controls ( n = 46), standard deviation shown; Right, unilateral right amygdala damage (n = 4). The
lower panels show individual scores from the three patients and the mean rating given by normal subjects. Modified, with
permission, from Nature REF. 58 (1998) Macmillan Magazines Ltd. b | Evidence from functional imaging. The top image shows the
activation in the amygdala observed when viewing untrustworthy faces is contrasted with viewing trustworthy faces. The z-values
(colour scale) observed in the amygdala correspond to p < 0.025. The bar graphs below show the activation in the left and right
amygdala for those faces that received the lowest (Low), medium (Med) or highest (High) ratings of trustworthiness. These
activations were measured under two task conditions: an implicit task in which viewers were asked to judge the gender of the face,
and an explicit task in which viewers were asked to judge the trustworthiness of the face. R, right hemisphere. Reproduced, with
permission, from Nature Neuroscience REF. 59 (2002) Macmillan Magazines Ltd.
of the menstrual cycle62, as do other aspects of their cat- and the orbitofrontal cortex66. These structures proba-
egorization of men63, possibly providing a link between bly have a broad role in processing the motivational
mate preference and probability of conception. properties of stimuli. For example, they are also acti-
Judgements of attractiveness can reflect both aesthetic vated when males find pictures of sports cars more
judgements (for example, males can judge faces of both rewarding than pictures of limousines or small
males and females to look beautiful), as well as motiva- cars67.The ventral striatum and the orbitofrontal cortex
tional aspects (for example, heterosexual males prefer are reciprocally connected with the amygdala; all three
to look at beautiful female faces rather than at beautiful structures can be thought of as components of a neural
NEOTENY
The retention of juvenile
male faces). These two aspects have been dissociated in system that links sensory representations of stimuli
characteristics in the adults of functional imaging studies64. The motivational aspects with the social judgements we make about them on the
a species. of facial attractiveness activate the ventral striatum64,65 basis of their motivational value. Given that the same
a b
structures that mediate social judgements also mediate Theory of mind. Abilities that have been dubbed
basic reward processing, we are led to question whether theory of mind68 allow us to attribute mental states to
the former might be reducible to the latter, an issue that other people69. Attributions of beliefs, specifically false
I take up in the concluding section of this review. beliefs, to other subjects have been particularly studied
(FIG. 5a). Such abilities, which emerge at about four
Thinking about other people years of age, might be unique to humans, and might
Several of the processes discussed in the preceding sec- be assembled out of a collection of more basic skills by
tion involve more than perception; they bring in addi- which we assign animacy, actions, goals and intentions
tional information beyond what is conveyed by the to stimuli, an issue that has seen intense recent investi-
stimulus to guide our social decisions and judgements gation using visual motion stimuli70. In addition to the
about it. Primates, and especially humans, stand out in reliable activation of superior temporal gyrus that I
their ability to take into account what others are think- mentioned earlier, several functional imaging studies
ing an ability that requires representing what might have shown activation of the medial frontal lobe and
be going on in other peoples minds. A varied collection inferior parietal lobule when people view visual
of processes comprise such higher-level manipulation of motion38,71,72 or gaze stimuli73 that signal such directed
social information. mental states.
Although there is convergent evidence that theory- relationships, social cooperativity, moral behaviour, and
of-mind abilities emerge in a coordinated fashion social aggression9396. In this case, its role has been
during development, so far there is only preliminary stressed particularly in the context of social develop-
evidence to indicate that they are a neuroanatomical ment and its pathologies (see the section on neuro-
package. The evidence for a role for the amygdala in the- psychiatry below). It could be that the integration of
ory-of-mind abilities comes from a small number of information about other people and oneself 97, and the
patients with amygdala lesions74,75. A single functional social relationship between the two, are the hallmarks of
imaging study has argued for amygdala activation in a medial prefrontal processing.
theory-of-mind task requiring judgements about facial Many of the same stimuli that engage the superior
expressions76, and another study has found impairments temporal gyrus, and lead viewers to attribute actions,
after amygdala damage using the same stimuli77. The intentions and goals, also activate regions of the neo-
evidence is stronger for the medial prefrontal cortex, cortex that are involved in representing actions70. These
as several functional imaging studies have found that it regions include premotor- and somatosensory-related
is activated when subjects perform theory-of-mind cortices the efferent and afferent sides of actions,
tasks71,78,79 (FIG. 5c). In addition, a few studies have found respectively. A series of recent studies have investigated
that patients with damage to the frontal lobes are the role of the right somatosensory-related cortices
impaired on theory-of-mind tasks69,80. Furthermore, and the left premotor cortex in making emotional and
there is some evidence that the role of the medial pre- personality attributions from point-light displays
frontal cortex in theory-of-mind tasks can be dissociated and movements of geometric shapes. Damage in both
from its broader role in behavioural control and execu- regions impairs the ability to make such attributions98.
tive function that is also engaged by most of the tasks
that are commonly used81,82. Simulation. There is a rapidly growing literature sup-
Rather than attempting to assign the whole set of porting the idea that we understand other peoples
theory-of-mind abilities to a particular neural struc- behaviour, in part, by simulation99. Observing another
ture or system, it might be more promising to explore persons actions results in desynchronization of motor
the dependency of specific components of this ability cortex activity measured with MEG100. Imitating another
on specific neural structures. In one study, it was subjects actions through observation activates the pre-
found that damage to orbitofrontal cortex impaired motor cortex in functional imaging studies101; such acti-
the ability to detect a faux pas 83, perhaps indicating vation is somatotopic with respect to the body part that
that this brain region contributes to our understand- is observed to perform the action, even in the absence of
ing of other people in part by engaging the emotions any overt action on the part of the observing subject102.
and feelings that accompany social interaction. In sup- In fact, in both humans103 and monkeys104, so-called
port of this idea, it was found that appreciation of mirror neurons have been discovered. These neurons
humour84, social-norm transgression resulting in respond both when the subject is doing something spe-
embarrassment85, viewing of erotic stimuli86 and elici- cific, and when he or she observes another person doing
tation of other moral emotions87, all activate the the same thing. Damage restricted to somatosensory cor-
medial prefrontal cortex. The role for the medial tex impairs the ability to recognize complex blends of
orbital and anterior cingulate regions in monitoring emotions in facial expressions105 (FIG. 6), and there is an
and regulating social emotions is consistent with their association between the impaired somatic sensation of
ALEXITHYMIA activation during interactions between attention, ones own body and the impaired ability to judge other
Cognitive disturbance that is
characterized by the difficulty in
awareness and emotion8890. peoples emotions105. Functional imaging studies also
describing ones own emotions. The data can be interpreted along two different support a role for right somatosensory-related cortices in
directions: the specialization of prefrontal cortices for representing the actions that we observe other people
WASON SELECTION TASK aspects of social cognition, or the reliance of social cog- performing, as being distinct from those that we perform
The most popular experimental
nition on more general resources that are provided by ourselves106.
design for probing deductive
reasoning. It consists of a this region of the brain. In line with the second interpre- So, there is good evidence that we can figure out
conditional statement, the truth tation, sectors of prefrontal cortex seem to be crucial for how others are feeling, what they intend and how they
of which the subject must integrating the allocation of cognitive resources on the are likely to act, in part by putting ourselves in their
decide. Typically, conditionals basis of automatic emotional evaluation and volitional, shoes, so to speak. This process could be entirely auto-
about social rules, threats and
promises all show a facilitation
effortful direction90,91. These mechanisms might there- matic and covert, but it seems likely that there are con-
in the proportion of logically fore reflect aspects of a more general function in regulat- siderable differences in how skilled different people are
correct choices, and it has been ing the fit between goals and behaviour. There could at employing it. These differences would be expected to
argued that humans evolved a then be specific examples of such domain-general pro- correlate with differences in empathy, emotional
specialized skill to detect
cessing on which social behaviour draws: contextual awareness or their dysfunction (as seen in sociopathy
deception in the context of social
contracts (for example, inhibition by prefrontal cortex of emotional responses and ALEXITHYMIA, for example). There are also some
cheating). triggered by the amygdala92, or response inhibition and unanswered questions about the extent of simulation
reversal in the face of a changing social context82. that is necessary to construct social knowledge. For
SOMATIC MARKERS In line with the alternative interpretation that sectors example, does the recognition of emotions from facial
Emotional states that are
triggered during the
of the prefrontal cortex are specialized for processing expressions rely on the internal generation of a motor
consideration of potential future social information, medial and orbital prefrontal cor- or somatosensory representation of the face alone? Or
outcomes of choices. tices have been linked to the regulation of interpersonal does it rely on the generation of a more comprehensive
WMS age 10: (Laughs). Oh no. The mommy left the tap on
(pointing to the water). And the boy is trying to get a cookie but
the chair is tipping over. (In a high voice, as if addressed to the
mother) Mom, wont you save the boy? (Returning to normal
tone) Gosh. She better quickly save her boy. Her son and her
daughter. Oh, theres going to be a flood on her floor. The boys
in the cookies. Maybe its after supper. Maybe. Oh, the mommy
is drying the towel. Poor boy, he could get hurt and break his
arm. Poor boy, oh poor thing.
DNS age 10: Mom wash dishes. A bowl fell. Boy slips, boy
pushed. Boy helps mom with dishes. Mom big mess in water.
Pushing. (Examiner: Can you tell me anything else about the
picture?) (Shakes head.)
Figure 7 | Hypersocial function in subjects with Williams syndrome. Williams syndrome results from the deletion of a small set
of genes on one copy of chromosome 7. Although the patients are mentally retarded and severely impaired in visuospatial function,
they show an exaggerated interest in other people and remarkable expressiveness and social communicative abilities. When shown
a picture, such as the cookie theft picture that is commonly used in neuropsychology, people with Williams syndrome tell stories
(top) that are not only longer and more complex than those told by same-age subjects with Down syndrome (bottom), but their
narratives are also infused with expressive details and social attention devices. DNS, Down syndome subject; WMS, Williams
syndrome subject. Modified, with permission, from REF. 127 (2000) MIT Press.
Social phobia is a debilitating fear of others, public us a better approximation to real life, an issue that is
places or public social interaction that might arise from vital for investigating social behaviour. In addition to
a fear of losing a fundamental aspect of social behaviour the examination of the genetic contributions to specific
the need to belong to a social group135. Increased cognitive abilities (for example, in rare human diseases,
amygdala activation has been found in subjects with transgenic mice or different dog breeds), there are also
social phobia when viewing neutral136 or angry 137 faces, genetic techniques on the horizon that might offer new
or when preparing to give a public speech138. People ways of reversibly lesioning specific brain structures143.
with psychopathy or social phobia show inverse extremes Even once future technology shows us more clearly
of emotional responsiveness to social stimuli, and there how neural events co-vary with stimuli and behaviour,
is evidence that they feature, respectively, exaggerated how to interpret such data will remain a deep theoreti-
and reduced activation in the amygdala and the cal challenge144. One view is that there are specialized
orbitofrontal cortex139. processes for social cognition; another is that social cog-
The neuropsychiatric aspects of social cognition nition arises out of more basic components that are
that I have discussed so far focus on disabilities. Much not so specialized themselves (TABLE 1). This raises the
less work has been done on exceptional social abilities, question of whether social cognition is reducible to
although research into Williams syndrome127 and emotional or motivational processing. For example,
140
TURNER SYNDROME tackle an angle of this issue. But it when we find a face attractive or trustworthy, do we
would be interesting to study what happens in the engage the same mechanisms as when our behaviour
brains of people who are especially kind, empathic, (and that of other animals) is reinforced by food? Or
altruistic or socially skilled. There is a growing interest does the way in which social stimuli are processed dif-
in enhancement of normal social cognitive skills fer fundamentally from reward and punishment for
through interventions ranging from educational strate- nonsocial stimuli? There is some indication that the
gies during development to pharmacological manipu- orbitofrontal cortex might be more specialized for
lation in adults, but the paucity of data makes their social and moral judgements, whereas the amygdala
application to real life premature. might subserve a broader role in emotional processing
that includes basic emotions145,146.
Conclusions On the one hand, all behaviour can be dichotomized
Progress in our understanding of the neural basis of as some form of approach or withdrawal, and some the-
social behaviour has been rapid. We have identified oretical schemes have attempted to map all emotions
collections of processes and neural structures that par- onto a two-dimensional space of reward and punish-
TURNER SYNDROME ticipate in our perceptions and judgements of social ment147. On the other hand, all the different basic and
A genetic disease in which stimuli, the ways in which we reason about and decide social emotions, and all the different words that we have
females carry only one healthy
among them, and the ways in which individual and col- for describing patterns in social behaviour, differentiate
X chromosome. It is
characterized by an inhibition lective behaviour is guided. Further progress crucially such behaviour at a considerably finer grain. So the
of sexual development and is depends on advances on two fronts: the development of question is: what is the appropriate level of grain at
accompanied by infertility. methods and of theory. which we should describe social behaviour and the cen-
There is some evidence from In the near future, we will see more studies that use tral states that regulate it? Although it is implausible that
patients with Turner syndrome
for the existence of an imprinted
virtual-reality stimuli141, and new techniques such as we will find a distinct neural substrate for every differ-
X-linked locus that affects simultaneous scanning of multiple subjects engaged in ent emotion and personality factor, it also seems that
social cognition. mutual social interactions142. Both approaches will give there must be systems more differentiated than just
Table 1 | Different ways of classifying behaviour re-describe events from several points of view an
ability that might fuel the emergence of science, art and
Category of behaviour Example
culture in general. Just as we can think about other peo-
Social disposition Personality traits (extraversion, neuroticism)
ple, we can step outside ourselves and think about our-
Strategic Deception, reconciliation selves, have conversations with ourselves, and imagine
Ecological Attachment, aggression things happening to ourselves in the future.
Moral Social emotions (guilt, embarrassment, pride, jealousy) The data that are available at present raise as many
Emotional response Basic emotions (happiness, fear, anger, disgust, sadness) questions as they provide answers. How can the diverse
Reinforcement Motivational state (reward, punishment)
findings that we accumulate be situated under a single
functional framework? Specifically, how can causal net-
works explain the many correlations between brain and
reward and punishment148. We might need to invent a behaviour that we are discovering? What are the relative
new set of terms that can translate between the different contributions of innate and acquired factors, culture
ways of describing social behaviour, and that correspond and individual differences to social cognition? To what
more closely to the neural processes that underlie them. extent do these factors contribute to psychopathology?
It might be that certain social cognitive skills Can large-scale social behaviour, as studied by political
notably the ability to represent other peoples minds science and economics, be understood by studying
distinguish humans and perhaps apes from all other social cognition in individual subjects? Finally, what
animals. If we understand other people in part by simu- power will insights from cognitive neuroscience give us
lating processes within ourselves, the converse is also to influence our social behaviour, and hence society?
true: we understand ourselves in part by observing other And to what extent would such pursuit be morally
people and their reactions to us. Our ability to think defensible? How we approach these questions will
about other people might be an aspect of our ability to largely shape social brain science in the coming decades.
1. Adolphs, R. (ed.) Special issue on cognitive neuroscience of 18. Wicker, B., Perrett, D. I., Baron-Cohen, S. & Decety, J. 33. Dittrich, W. H., Troscianko, T., Lea, S. E. & Morgan, D.
social behavior. Neuropsychologia 41, 117 (2003). Being the target of anothers emotion: a PET study. Perception of emotion from point-light displays represented
2. Harmon-Jones, E. & Devine, T. (eds) Special issue on social Neuropsychologia 41, 139146 (2003). in dance. Perception 25, 727738 (1996).
neuroscience. J. Pers. Soc. Psychol. (in the press). 19. Mouchetant-Rostaing, Y., Giard, M.-H., Bentin, S., Aguera, 34. Runeson, S. & Frykholm, G. Kinematic specification of
3. Cacioppo, J. T. et al. (eds) Foundations in Social P.-E. & Pernier, J. Neurophysiological correlates of face dynamics as an informational basis for person-and-action
Neuroscience (MIT Press, Cambridge, Massachusetts, gender processing in humans. Eur. J. Neurosci. 12, perception: expectation, gender recognition, and deceptive
2001). 303310 (2000). intention. J. Exp. Psychol. Gen. 112, 585615 (1983).
4. Heatherton, T. F. & Macrae, C. N. Social Cognitive 20. Pizzagalli, D., Regard, M. & Lehmann, D. Rapid emotional 35. Grezes, J. et al. Does perception of biological motion rely on
Neuroscience: A Reader (Blackwell, Cambridge, face processing in the human right and left brain specific brain regions? Neuroimage 13, 775785 (2001).
Massachusetts, 2003). hemispheres: an ERP study. Neuroreport 10, 26912698 36. Bonda, E., Petrides, M., Ostry, D. & Evans, A. Specific
5. Trivers, R. The evolution of reciprocal altruism. Q. Rev. Biol. (1999). involvement of human parietal systems and the amygdala in
46, 3557 (1971). 21. Halgren, E., Raij, T., Marinkovic, K., Jousmaki, V. & Hari, R. the perception of biological motion. J. Neurosci. 16,
6. Fehr, E. & Gaechter, S. Altruistic punishment in humans. Cognitive response profile of the human fusiform face 37373744 (1996).
Nature 415, 137140 (2002). area as determined by MEG. Cereb. Cortex 10, 6981 37. Grossman, E. & Blake, R. Brain areas active during visual
7. Edwards, K. The face of time: temporal cues in facial (2000). perception of biological stimuli. Neuron 35, 11671175
expressions of emotion. Psychol. Sci. 9, 270277 (1998). 22. Smith, N. K., Cacioppo, J. T., Larsen, J. T. & Chartrand, T. L. (2002).
8. Ambady, N. & Rosenthal, R. Thin slices of expressive May I have your attention, please: electrocortical responses 38. Castelli, F., Happe, F., Frith, U. & Frith, C. Movement and
behavior as predictors of interpersonal consequences: to positive and negative stimuli. Neuropsychologia 41, mind: a functional imaging study of perceptions and
a meta-analysis. Psychol. Bull. 111, 256274 (1992). 171183 (2003). interpretation of complex intentional movement patterns.
9. McCarthy, G. in The New Cognitive Neurosciences (ed. 23. Allison, T. et al. Face recognition in human extrastriate Neuroimage 12, 314325 (2000).
Gazzaniga, M. S.) 393410 (MIT Press, Cambridge, cortex. J. Neurophysiol. 71, 821825 (1994). 39. Blakemore, S.-J. et al. How the brain perceives causality:
Massachusetts, 1999). 24. Liu, J., Harris, A. & Kanwisher, N. Stages of processing in an event-related fMRI study. Neuroreport 12, 37413746
10. Haxby, J. V., Hoffman, E. A. & Gobbini, M. I. The distributed face perception: an MEG study. Nature Neurosci. 5, (2001).
human neural system for face perception. Trends Cogn. Sci. 910916 (2002). 40. Adolphs, R., Tranel, D., Damasio, H. & Damasio, A. Impaired
4, 223233 (2000). Demonstrates that superordinate categorization of a recognition of emotion in facial expressions following
11. Wicker, B., Michel, F., Henaff, A. & Decety, J. Brain regions face as distinct from other objects at 100 ms is bilateral damage to the human amygdala. Nature 372,
involved in the perception of gaze: a PET study. Neuroimage followed by subordinate categorization of individual 669672 (1994).
8, 221227 (1998). peoples faces around 170 ms. The first study showing impaired recognition of fear
12. Hoffman, E. A. & Haxby, J. V. Distinct representations of eye 25. Sugase, Y., Yamane, S., Ueno, S. & Kawano, K. Global and from facial expressions in a patient with bilateral
gaze and identity in the distributed human neural system for fine information coded by single neurons in the temporal amygdala damage.
face perception. Nature Neurosci. 3, 8084 (2000). visual cortex. Nature 400, 869872 (1999). 41. Calder, A. J. et al. Facial emotion recognition after bilateral
This paper shows that the superior temporal and 26. Heider, F. & Simmel, M. An experimental study of apparent amygdala damage: differentially severe impairment of fear.
fusiform cortices are differentially activated by eye behavior. Am. J. Psychol. 57, 243259 (1944). Cogn. Neuropsychol. 13, 699745 (1996).
gaze and static face stimuli, respectively. A classic study showing that people make social 42. Morris, J. S. et al. A differential neural response in the human
13. Puce, A., Allison, T., Bentin, S., Gore, J. C. & McCarthy, G. attributions to moving geometric shapes. amygdala to fearful and happy facial expressions. Nature
Temporal cortex activation in humans viewing eye and 27. Michotte, A. La Perception de la Causalite (Institut Superieur 383, 812815 (1996).
mouth movements. J. Neurosci. 18, 21882199 (1998). de Philosophie, Louvain, France, 1946). The first functional imaging study showing amygdala
14. Vaina, L. M., Solomon, J., Chowdhury, S., Sinha, P. & 28. Scholl, B. J. & Tremoulet, P. D. Perceptual causality and activation to facial expressions of fear.
Belliveau, J. W. Functional neuroanatomy of biological animacy. Trends Cogn. Sci. 4, 299308 (2000). 43. Hamann, S. B., Ely, T. D., Hoffman, J. M. & Kilts, C. D.
motion perception in humans. Proc. Natl Acad. Sci. USA 98, 29. Dittrich, W. H. & Lea, S. E. G. Visual perception of intentional Ecstasy and agony: activation of the human amygdala in
1165611661 (2001). motion. Perception 23, 253268 (1994). positive and negative emotion. Psycholog. Sci. 13, 135141
15. Iacoboni, M. et al. Reafferent copies of imitated actions in 30. Johansson, G. Visual perception of biological motion and a (2002).
the right superior temporal cortex. Proc. Natl Acad. Sci. model of its analysis. Percept. Psychophys. 14, 202211 44. Yang, T. T. et al. Amygdalar activation associated with
USA 98, 1399513999 (2001). (1973). positive and negative facial expressions. Neuroreport 13,
16. Vuilleumier, P., Armony, J. L., Driver, J. & Dolan, R. J. Effects Classic study showing that we perceive peoples 17371741 (2002).
of attention and emotion on face processing in the human bodies from point-light displays. 45. Anderson, A. K. & Phelps, E. A. Lesions of the human
brain. An event-related fMRI study. Neuron 30, 829841 31. Cutting, J. E. & Kozlowski, L. T. Recognizing friends by their amygdala impair enhanced perception of emotionally salient
(2001). walk: gait perception without familiarity cues. Bull. Psychon. events. Nature 411, 305309 (2001).
17. Pelphrey, K. A., Singerman, J. D., Allison, T. & McCarthy, G. Soc. 9, 353356 (1977). Shows that the ability of emotional stimuli to override
Brain activation evoked by the perception of gaze shifts: the 32. Kozlowski, L. T. & Cutting, J. E. Recognizing the sex of a the attentional blink depends on the amygdala.
influence of timing and context. Neuropsychologia 41, walker from a dynamic point-light display. Percept. 46. Ochsner, K., Bunge, S. A., Gross, J. J. & Gabrieli, J. D. E.
156170 (2003). Psychophys. 21, 575580 (1977). Rethinking feelings: an fMRI study of the cognitive
regulation of emotion. J. Cogn. Neurosci. 14, 12151229 72. Brunet, E., Sarfati, Y., Hardy-Bayle, M. C. & Decety, J. A PET 100. Hari, R. et al. Activation of human primary motor cortex
(2002). investigation of the attribution of intentions with a nonverbal during action observation: a neuromagnetic study. Proc.
Shows modulation of amygdala activation during task. Neuroimage 11, 157166 (2000). Natl Acad. Sci. USA 95, 1506115065 (1998).
reappraisal. 73. Calder, A. J. et al. Reading the mind from eye gaze. 101. Iacoboni, M. et al. Cortical mechanisms of human imitation.
47. Schaefer, S. M. et al. Modulation of amygdalar activity by the Neuropsychologia 40, 11291138 (2002). Science 286, 25262528 (1999).
conscious regulation of negative emotion. J. Cogn. Neurosci. 74. Fine, C., Lumsden, J. & Blair, R. J. R. Dissociation between 102. Buccino, G. et al. Action observation activates premotor and
14, 913921 (2002). theory of mind and executive functions in a patient with parietal areas in a somatotopic manner: an fMRI study. Eur.
Shows modulation of amygdala activation during self- early left amygdala damage. Brain 124, 287298 (2001). J. Neurosci. 13, 400404 (2001).
regulation. 75. Stone, V. E., Baron-Cohen, S., Young, A. W., Calder, A. J. & 103. Hutchison, W. D., Davis, K. D., Lozano, A. M., Tasker, R. R.
48. Oya, H., Kawasaki, H., Howard, M. A. & Adolphs, R. Keane, J. Acquired theory of mind impairments in patients & Dostrovsky, J. O. Pain-related neurons in the human
Electrophysiological responses in the human amygdala with bilateral amygdala lesions. Neuropsychologia 41, cingulate cortex. Nature Neurosci. 2, 403405 (1999).
discriminate emotion categories of complex visual stimuli. 209220 (2003). 104. Gallese, V. & Goldman, A. Mirror neurons and the simulation
J. Neurosci. 22, 95029512 (2002). 76. Baron-Cohen, S. et al. Social intelligence in the normal and theory of mind-reading. Trends Cogn. Sci. 2, 493500
49. Morris, J. S., Oehman, A. & Dolan, R. J. Conscious and autistic brain: an fMRI study. Eur. J. Neurosci. 11, (1999).
unconscious emotional learning in the human amygdala. 18911898 (1999). 105. Adolphs, R., Damasio, H., Tranel, D., Cooper, G. &
Nature 393, 467470 (1998). Shows that normal people activate the amygdala Damasio, A. R. A role for somatosensory cortices in the
50. Whalen, P. J. et al. Masked presentations of emotional facial when making social judgements from viewing peoples visual recognition of emotions as revealed by three-
expressions modulate amygdala activity without explicit eyes, and that people with autism fail both to activate dimensional lesion mapping. J. Neurosci. 20, 26832690
knowledge. J. Neurosci. 18, 411418 (1998). the amygdala and to perform normally on this task. (2000).
Shows that subliminal facial expressions of fear 77. Adolphs, R., Tranel, D. & Baron-Cohen, S. Amygdala 106. Ruby, P. & Decety, J. Effect of subjective perspective taking
activate the amygdala. damage impairs recognition of social emotions from facial during simulation of action: a PET investigation of agency.
51. Morris, J. S., deGelder, B., Weiskrantz, L. & Dolan, R. J. expressions. J. Cogn. Neurosci. 14, 12641274 (2002). Nature Neurosci. 4, 546550 (2001).
Differential extrageniculostriate and amygdala responses to 78. Fletcher, P. C. et al. Other minds in the brain: a functional 107. Stone, V. E., Cosmides, L., Tooby, J., Kroll, N. & Knight, R. T.
presentation of emotional faces in a cortically blind field. imaging study of theory of mind in story comprehension. Selective impairment of reasoning about social exchance in
Brain 124, 12411252 (2001). Cognition 57, 109128 (1995). a patient with bilateral limbic system damage. Proc. Natl
52. Vuilleumier, P. et al. Neural responses to emotional faces 79. Goel, V., Grafman, J., Sadato, N. & Hallett, M. Modeling Acad. Sci. USA 99, 1153111536 (2002).
with and without awareness: event-related fMRI in a parietal other minds. Neuroreport 6, 17411746 (1995). A patient with orbitofrontal cortex damage was
patient with visual extinction and spatial neglect. 80. Stuss, D. T., Gallup, G. G. & Alexander, M. P. The frontal impaired in reasoning about social exchange,
Neuropsychologia 40, 21562166 (2002). lobes are necessary for theory of mind. Brain 124, specifically detecting cheating, on the Wason
53. Pessoa, L., McKenna, M., Gutierrez, E. & Ungerleider, L. G. 279286 (2001). selection task.
Neural processing of emotional faces requires attention. 81. Rowe, A. D., Bullock, P. R., Polkey, C. E. & Morris, R. G. 108. Adolphs, R., Bechara, A., Tranel, D., Damasio, H. &
Proc. Natl Acad. Sci. USA 99, 1145811463 (2002). Theory of mind impairments and their relationship to Damasio, A. in Neurobiology of Decision Making
54. Hart, A. J. et al. Differential response in the human amygdala executive functioning following frontal lobe excisions. Brain (eds Christen, Y., Damasio, A. & Damasio, H.) 158179
to racial outgroup vs ingroup face stimuli. Neuroreport 11, 124, 600616 (2001). (Springer, New York, 1995).
23512355 (2000). 82. Blair, R. J. R. & Cipolotti, L. Impaired social response reversal. 109. Damasio, H., Grabowski, T., Frank, R., Galaburda, A. M. &
55. Phelps, E. A. et al. Performance on indirect measures of A case of acquired sociopathy. Brain 123, 11221141 Damasio, A. R. The return of Phineas Gage: clues about the
race evaluation predicts amygdala activation. J. Cogn. (2000). brain from the skull of a famous patient. Science 264,
Neurosci. 12, 729738 (2000). 83. Stone, V. E., Baron-Cohen, S. & Knight, R. T. Frontal lobe 11021104 (1994).
56. Golby, A. J., Gabrieli, J. D. E., Chiao, J. Y. & Eberhardt, J. L. contributions to theory of mind. J. Cogn. Neurosci. 10, A revisit to this classic case, demonstrating that
Differential responses in the fusiform region to same-race 640656 (1998). damage to his medial prefrontal cortex resulted in his
and other-race faces. Nature Neurosci. 4, 845850 (2001). 84. Goel, V. & Dolan, R. J. The functional anatomy of humor: impaired decision making in real life.
57. Phelps, E. A., Cannistraci, C. J. & Cunningham, W. A. Intact segregating cognitive and affective components. Nature 110. Bechara, A., Tranel, D., Damasio, H. & Damasio, A. R.
performance on an indirect measure of race bias following Neurosci. 4, 237238 (2001). Failure to respond autonomically to anticipated future
amygdala damage. Neuropsychologia 41, 203209 (2003). 85. Berthoz, S., Armony, J. L., Blair, R. J. R. & Dolan, R. J. An outcomes following damage to prefrontal cortex. Cereb.
58. Adolphs, R., Tranel, D. & Damasio, A. R. The human fMRI study of intentional and unintentional (embarrassing) Cortex 6, 215225 (1996).
amygdala in social judgment. Nature 393, 470474 (1998). violations of social norms. Brain 125, 16961708 (2002). 111. Bechara, A., Damasio, H., Tranel, D. & Damasio, A.
Shows that bilateral amygdala damage impairs the 86. Karama, S. et al. Areas of brain activation in males and Deciding advantageously before knowing the advantageous
ability to judge trustworthiness in faces. females during viewing of erotic film excerpts. Hum. Brain strategy. Science 275, 12931295 (1997).
59. Winston, J. S., Strange, B. A., ODoherty, J. & Dolan, R. J. Mapp. 16, 113 (2002). Shows that we have non-conscious emotional
Automatic and intentional brain responses during evaluation of 87. Moll, J. et al. The neural correlates of moral sensitivity: hunches that guide our decision making, which
trustworthiness of faces. Nature Neurosci. 5, 277283 (2002). a functional magnetic resonance imaging investigation of depend on the integrity of orbitofrontal cortex.
Shows that viewing untrustworthy faces activates the basic and moral emotions. J. Neurosci. 22, 27302736 112. Gehring, W. J. & Willoughby, A. R. The medial frontal cortex
amygdala in normal people, and that this is partly (2002). and the rapid processing of monetary gains and losses.
independent of other factors such as emotional 88. Lane, R. D. et al. Neural correlates of levels of emotional Science 295, 22792281 (2002).
expression, gender or direction of gaze. awareness: evidence of an interaction between emotion and 113. ODoherty, J., Kringelbach, M. L., Rolls, E. T., Hornak, J. &
60. Canli, T., Sivers, H., Whitfield, S. L., Gotlib, I. H. & Gabrieli, attention in the anterior cingulate cortex. J. Cogn. Neurosci. Andrews, C. Abstract reward and punishment
J. D. E. Amygdala resposes to happy faces as a function of 10, 525535 (1998). representations in the human orbitofrontal cortex. Nature
extraversion. Science 296, 2191 (2002). 89. Berthoz, S. et al. Effect of impaired recognition and Neurosci. 4, 95102 (2001).
61. Hariri, A. R. et al. Serotonin transporter genetic variation and expression of emotions on frontocingulate cortices: an fMRI 114. Kahn, I. et al. The role of the amygdala in signaling
the response of the human amygdala. Science 297, study of men with alexithymia. Am. J. Psychiatry 159, prospective outcome of choice. Neuron 33, 983994
400403 (2002). 961967 (2002). (2002).
62. Penton-Voak, I. S. et al. Menstrual cycle alters face 90. Yamasaki, H., LaBar, K. S. & McCarthy, G. Dissociable 115. Saver, J. L. & Damasio, A. R. Preserved access and
preference. Nature 399, 741742 (1999). prefrontal brain systems for attention and emotion. Proc. processing of social knowledge in a patient with acquired
63. Macrae, C. N., Alnwick, K. A., Milne, A. B. & Schloerscheidt, Natl Acad. Sci. USA 99, 1144711451 (2002). sociopathy due to ventromedial frontal damage.
A. M. Person perception across the menstrual cycle: 91. Gray, J. R., Braver, T. S. & Raichle, M. E. Integration of Neuropsychologia 29, 12411249 (1991).
hormonal influences on social-cognitive functioning. emotion and cognition in the lateral prefrontal cortex. Proc. 116. Anderson, S. W., Bechara, A., Damasio, H., Tranel, D. &
Psychol. Sci. 13, 532537 (2002). Natl Acad. Sci. USA 99, 41154120 (2002). Damasio, A. R. Impairment of social and moral behavior
64. Aharon, I. et al. Beautiful faces have variable reward value: 92. Davidson, R. J. Anxiety and affective style: role of prefrontal related to early damage in human prefrontal cortex. Nature
fMRI and behavioral evidence. Neuron 32, 537551 (2001). cortex and amygdala. Biol. Psychiatry 51, 6880 (2002). Neurosci. 2, 10321037 (1999).
Shows a dissociation between the aesthetic and 93. Davidson, R. J., Putnam, K. M. & Larson, C. L. Dysfunction Developmental frontal lobe damage results in
motivational aspects of stimuli, and that ventral in the neural circuitry of emotion regulation a possible impairments similar to those seen in psychopaths,
striatal activation correlates only with the latter. prelude to violence. Science 289, 591594 (2000). notably an inability to know right from wrong in moral
65. Kampe, K. K. W., Frith, C. D., Dolan, R. J. & Frith, U. Reward 94. Schore, A. N. Affect Regulation and the Origin of the Self: action.
value of attractiveness and gaze. Nature 413, 589 (2001). the Neurobiology of Emotional Development (Lawrence 117. Greene, J. D., Sommerville, R. B., Nystrom, L. E., Darley, J. M.
66. ODoherty, J. et al. Beauty in a smile: the role of medial Erlbaum Associates, Hillsdale, New Jersey, 1994). & Cohen, J. D. An fMRI investigation of emotional
orbitofrontal cortex in facial attractiveness. 95. Damasio, A. R. Descartes Error: Emotion, Reason, and the engagement in moral judgment. Science 293, 21052107
Neuropsychologia 41, 147155 (2003). Human Brain (Grosset/Putnam, New York, 1994). (2001).
67. Erk, S., Spitzer, M., Wunderlich, A. P., Galley, L. & Walter, H. Theory and evidence that the orbitofrontal cortex 118. Rilling, J. K. et al. A neural basis for social cooperation.
Cultural objects modulate reward circuitry. Neuroreport 13, implements the triggering of somatic markers that Neuron 35, 395405 (2002).
24992503 (2002). guide decision making. 119. Mitchell, J. P., Heatherton, T. F. & Macrae, C. N. Distinct
68. Premack, D. & Woodruff, G. Does the chimpanzee have a 96. Greene, J. D. & Haidt, J. How (and where) does moral neural systems subserve person and object knowledge.
theory of mind? Behav. Brain Sci. 1, 515526 (1978). judgment work? Trends Cogn. Sci. 6, 517523 (2002). Proc. Natl Acad. Sci. USA 99, 1523815243 (2002).
69. Siegal, M. & Varley, R. Neural systems involved in theory of 97. Kelley, W. M. et al. Finding the self? An event-related fMRI 120. Price, C. J. & Friston, K. J. Degeneracy and cognitive
mind. Nature Rev. Neurosci. 3, 463471 (2002). study. J. Cogn. Neurosci. 14, 785794 (2002). anatomy. Trends Cogn. Sci. 6, 416420 (2002).
70. Blakemore, S.-J. & Decety, J. From the perception of action 98. Heberlein, A. S. Neural Substrates for Social Cognition from 121. Bowlby, J. Attachment and Loss (Basic Books, New York,
to the understanding of intention. Nature Rev. Neurosci. 2, Motion Cues: Lesion Studies in Humans. Ph.D. Thesis, 1972).
561568 (2001). University of Iowa (2002). 122. Harlow, H. F. & Harlow, M. K. Social deprivation in monkeys.
71. Gallagher, H. L. et al. Reading the mind in cartoons and 99. Rizzolatti, G., Fogassi, L. & Gallese, V. Neurophysiological Sci. Am. 207, 136146 (1962).
stories: an fMRI study of theory of mind in verbal and mechanisms underlying the understanding and imitation of 123. Schore, A. N. Affect Dysregulation and Disorders of the Self
nonverbal tasks. Neuropsychologia 38, 1121 (2000). action. Nature Rev. Neurosci. 2, 661670 (2001). (Norton, New York, 2003).
124. Leslie, A. Pretense and representation: the origins of theory contemptuous faces in generalized social phobia. Arch. 152. Olausson, H. et al. Unmyelinated tactile afferents signal
of mind. Psychol. Rev. 94, 412426 (1987). Gen. Psychiatry 59, 10271034 (2002). touch and project to insular cortex. Nature Neurosci. 5,
125. Baron-Cohen, S. Mindblindness: an Essay on Autism and 138. Tillfors, M. et al. Cerebral blood flow in subjects with social 900904 (2002).
Theory of Mind (MIT Press, Cambridge, Massachusetts, phobia during stressful speaking tasks: a PET study. Am. J. 153. Zald, D. H. & Pardo, J. V. Emotion, olfaction, and the human
1995). Psychiatry 158, 12201226 (2001). amygdala: amygdala activation during aversive olfactory
126. Frith, U. Mind blindness and the brain in autism. Neuron 32, 139. Veit, R. et al. Brain circuits involved in emotional learning in stimulation. Proc. Natl Acad. Sci. USA 94, 41194124
969979 (2001). antisocial behavior and social phobia in humans. Neurosci. (1997).
127. St. George, M. & Bellugi, U. (eds) Linking cognitive Lett. 328, 233236 (2002). 154. Royet, J.-P. et al. Emotional responses to pleasant and
neuroscience and molecular genetics: new perspectives 140. Skuse, D. H. et al. Evidence from Turners syndrome of an unpleasant olfactory, visual, and auditory stimuli: a positron
from Williams syndrome. J. Cogn. Neurosci. 12, Suppl. imprinted X-linked locus affecting cognitive function. Nature emission tomography study. J. Neurosci. 20, 77527759
S1S6 (2000). 387, 705708 (1997). (2000).
128. Chung, W. C. J., De Vries, G. J. & Swaab, D. F. Sexual 141. Tarr, M. J. & Warren, W. H. Virtual reality in behavioral 155. Savic, I., Berglund, H., Gulyas, B. & Roland, P. Smelling of
differentiation of the bed nucleus of the stria terminalis in neuroscience and beyond. Nature Neurosci. 5, 10891093 odorous sex hormone-like compounds causes sex
humans may extend into adulthood. J. Neurosci. 22, (2002). differentiated hypothalamic activation in humans. Neuron
10271033 (2002). 142. Montague, P. R. et al. Hyperscanning: simultaneous fMRI 31, 661668 (2001).
129. Giedd, J. N. et al. Quantitative MRI of the temporal lobe, during linked social interactions. Neuroimage 16, 156. Adolphs, R., Tranel, D. & Damasio, H. Neural systems for
amygdala, and hippocampus in normal human development: 11591164 (2002). recognizing emotion from prosody. Emotion 2, 2351 (2002).
ages 418 years. J. Comp. Neurol. 366, 223230 (1996). 143. Lechner, H. A., Lein, E. S. & Callaway, E. M. A genetic 157. Blood, A. J. & Zatorre, R. J. Intensely pleasurable responses
130. Abbott, A. Into the mind of a killer. Nature 410, 296298 method for selective and quickly reversible silencing to music correlate with activity in brain regions implicated in
(2001). of mammalian neurons. J. Neurosci. 22, 52875290 reward and emotion. Proc. Natl Acad. Sci. USA 98,
131. Caspi, A. et al. Role of genotype in the cycle of violence in (2002). 1181811823 (2001).
maltreated children. Science 297, 851854 (2002). 144. Adolphs, R. Investigating the cognitive neuroscience
132. Raine, A., Lencz, T., Bihrle, S., LaCasse, L. & Colletti, P. of social behavior. Neuropsychologia 41, 119126 Acknowledgements
Reduced prefrontal gray matter volume and reduced (2003). I am greatly indebted to critiques by T. Heatherton, E. Phelps,
autonomic activity in antisocial personality disorder. Arch. 145. Moll, J., de Oliveira-Souza, R., Bramati, I. E. & Grafman, J. A. Atkinson and A. Heberlein. To the best of my knowledge,
Gen. Psychiatry 57, 119127 (2000). Functional networks in emotional moral and nonmoral social T. Heatherton coined the term social brain sciences that I have
133. Kiehl, K. A. et al. Limbic abnormalities in affective judgments. Neuroimage 16, 696703 (2002). used in this article. Supported by grants from the NIH, the
processing by criminal psychopaths as revealed by 146. Amaral, D. G. et al. The amygdala: is it an essential Klingenstein Fund and the James S. McDonnell Foundation.
functional magnetic resonance imaging. Biol. Psychiatry 50, component of the neural network for social cognition?
677684 (2001). Neuropsychologia 41, 235240 (2003).
134. Mitchell, D., Colledge, E., Leonard, A. & Blair, R. Risky 147. Rolls, E. T. The Brain and Emotion (Oxford Univ. Press, New Online links
decisions and response reversal: is there evidence of York, 1999).
orbitofrontal dysfunction in psychopathic individuals? 148. Panskepp, J. Affective Neuroscience. (Oxford Univ. Press, FURTHER INFORMATION
Neuropsychologia 40, 20132022 (2002). New York, 1998). Encyclopedia of Life Sciences: http://www.els.net/
135. Baumeister, R. F. & Leary, M. R. The need to belong: desire 149. Dunbar, R. The Social Brain Hypothesis. Evol. Anthropol. 6, autism | Williams syndrome
for interpersonal attachments as a fundamental human 178190 (1998). MIT Encyclopedia of Cognitive Sciences: http://www.els.net/
motivation. Psychol. Bull. 117, 497529 (1995). 150. Whiten, A. & Byrne, R. W. (eds) Machiavellian Intelligence II: decision making | emotions | sexual attraction, evolutionary
136. Birbaumer, N. et al. fMRI reveals amygdala activation to Extensions and Evaluations (Cambridge Univ., Cambridge, psychology of | social cognition | social cognition in animals |
human faces in social phobics. Neuroreport 9, 12231226 UK, 1997). theory of mind
(1998). 151. Brothers, L. The social brain: a project for integrating primate Ralph Adolphs laboratory:
137. Stein, M. B., Goldin, P. R., Sareen, J., Zorilla, L. T. & Brown, behavior and neurophysiology in a new domain. Concepts http://www.medicine.uiowa.edu/adolphs
G. G. Increased amygdala activation to angry and Neurosci. 1, 2751 (1990). Access to this interactive links box is free online.