Beruflich Dokumente
Kultur Dokumente
Article
Neuron 61, 481–490, February 12, 2009 ª2009 Elsevier Inc. 481
Neuron
Brain Responses to Gambling Near-Misses
482 Neuron 61, 481–490, February 12, 2009 ª2009 Elsevier Inc.
Neuron
Brain Responses to Gambling Near-Misses
by trials where, during reel spinning, the play icon moved through outcome, with the selection and anticipation phases entered
the payline and stopped in the next position (mean z = +0.18), as covariates in the design matrix (see Supplemental Data).
compared to near-misses where the chosen icon stopped The contrast of winning outcomes against all nonwin outcomes
one position short of the payline (mean z = 0.19; t39 = 3.90, yielded significant signal change (p < 0.05 after correction for
p < 0.001). family wise error rate) in a distributed circuit comprising the
ventral striatum bilaterally, the anterior insula bilaterally, the
Experiment II: Neural Correlates of the Slot rostral anterior cingulate cortex (rACC), the thalamus and
Machine Task a midbrain cluster in proximity to the dopaminergic cells in the
Brain responses during gambling play were measured using substantia nigra/ventral tegmental area (Bunzeck and Duzel,
fMRI in a second group of 15 volunteers. Subjects played 2006; D’Ardenne et al., 2008; see Figure 3A and Table S4).
a longer version of the task comprising 3 blocks of 60 trials, This circuit is reliably activated in previous imaging studies using
yielding a total of 30 wins (£15), and subjective ratings were both unconditioned and conditioned reinforcers (Berns et al.,
only taken intermittently (on 1 in 3 trials). An event-related anal- 2001; Breiter et al., 2001; Delgado et al., 2000; Elliott et al.,
ysis was used to identify neural responses at the receipt of the 2000; Knutson et al., 2003; McClure et al., 2003). The win-related
Neuron 61, 481–490, February 12, 2009 ª2009 Elsevier Inc. 483
Neuron
Brain Responses to Gambling Near-Misses
circuit was implemented as a mask for the further fMRI contrasts full-misses), there was a significant cluster in the anterior insula/
that were orthogonal to this comparison. caudolateral orbitofrontal cortex (BA 47; x, y, z = 42, 18, 10;
The contrast comparing the near-miss outcomes against the z = 3.98, pFWE-corr = 0.018; see Figure 5A). This correlation indi-
full-miss outcomes showed significantly elevated signal change cates that subjects who rated themselves as more susceptible
to near-misses in the ventral striatum bilaterally (x, y, z = 8, 4, to gambling distortions showed greater recruitment of the ante-
2, Z = 4.30, pFWE-corr = 0.005; 12, 2, 2, Z = 4.25, pFWE-corr = rior insula in response to near-miss outcomes.
0.006) and the right anterior insula (x, y, z = 32, 18, 0, Z = 3.63, Second, we looked for brain areas where neural responses to
pFWE-corr = 0.049), despite the lack of objective monetary gain wins and near-misses were correlated with the subjective ratings
on those trials (see Figure 3B). Signal increases in the ventral of ‘‘continue to play.’’ As ratings were acquired on one in three
striatum and anterior insula to near-miss outcomes were present trials, we calculated a mean win effect for each subject (ratings
on trials with, and without, personal control. A third contrast on available win outcomes minus ratings on available nonwin
assessed the interaction of the near-miss effect (near-misses outcomes) and a mean near-miss effect for each subject (ratings
minus full-misses) and personal control (participant-chosen on available near-miss outcomes minus ratings on available
trials minus computer-chosen trials) and identified bilateral vox- full-miss outcomes). There were no significant voxels within the
els in the rACC region (Brodmann Area 24) with significance win mask when the subjective win effect was regressed against
levels just below the familywise error-corrected threshold (x, y, win-related brain activity. When the subjective near-miss effect
z = 4, 32, 2, Z = 3.48, pFWE-corr = 0.062; x, y, z = 4, 38, 2, Z = was regressed against near-miss related brain activity, adjacent
3.36, pFWE-corr = 0.088). When this contrast was confined to voxels in the anterior insula (Brodmann Area 13) and caudolat-
near-misses that had passed through the payline and stopped eral orbitofrontal cortex (Brodmann Area 47) were the only sig-
in the next position (given that the behavioral impact of near- nificant effects at a reduced threshold of p < 0.001 uncorrected
misses was predominantly driven by this type), these voxels in for multiple comparisons (x, y, z = 30, 16, 10, Z = 3.24, punc =
the rACC were fully significant despite the restricted number of 0.001; x, y, z = 34, 24, 4, Z = 3.37, punc < 0.0001). This correla-
events (x, y, z = 4, 38, 2, Z = 4.34, pFWE-corr = 0.005; x, y, z = tion indicates that subjects who reported greater subjective
4, 34, 2, Z = 3.97, pFWE-corr = 0.019; x, y, z = 6, 38, 2; z = 3.67, effects of the near-misses on their ratings of ‘‘continue to
pFWE-corr = 0.049). An analysis of extracted signal change from play’’ showed a greater BOLD response to near-miss outcomes
these voxels showed greater activity on near-misses compared in the anterior insula/caudolateral orbitofrontal cortex (see
to full-misses on participant-chosen trials (t14 = 3.37, p = 0.005), Figure 5B).
with a marginally significant effect in the opposite direction on
computer-chosen trials (t14 = 2.06, p = 0.058; see Figure 4). DISCUSSION
Neural responses to the win and near-miss related contrasts
were regressed against two sets of variables. First, we looked The main focus of this study was the comparison of two types of
for brain areas where neural responses to wins and near-misses nonwin outcome: near-misses, where the slot machine reel
were correlated with the GRCS questionnaire, which assesses stopped one position from the chosen icon, and full-misses,
the susceptibility to cognitive distortions associated with where the outcome was not proximal to a win. While the objec-
gambling. GRCS total scores were well-distributed within the tive outcome on these two trial types was the same (i.e., zero
group (see Table S1). There were no significant voxels within gain), there were significant differences between the patterns
the win-related circuit when GRCS score was regressed against of neural response to the near-misses and full-misses. Near-
win activity (wins minus all nonwins). However, when GRCS misses were associated with significantly greater BOLD signal
score was regressed onto near-miss activity (near-misses minus in the ventral striatum and anterior insula; areas that were also
484 Neuron 61, 481–490, February 12, 2009 ª2009 Elsevier Inc.
Neuron
Brain Responses to Gambling Near-Misses
Neuron 61, 481–490, February 12, 2009 ª2009 Elsevier Inc. 485
Neuron
Brain Responses to Gambling Near-Misses
previously reported insula activation during exposure to Several aspects of the current data present problems for an
cocaine-related stimuli (Garavan et al., 2000; Wang et al., account of the near-miss effect solely in terms of reward expec-
1999), which was correlated with subjective reports of the tation and omission. First, why should unpleasant reward omis-
degree of induced craving (Wang et al., 1999). A neuropsycho- sion invigorate behavior? It is unclear how this account would
logical study has reported that patients with insula damage explain our finding that near-misses increased self-report ratings
showed rapid cessation of cigarette smoking without persistent of desire to play the game. In many real-world situations (e.g.,
urges to smoke, compared to brain-injured patients with target practice), near-miss outcomes are indicative of skill acqui-
damage to other regions (Naqvi et al., 2007). A study in experi- sition and, as such, constitute useful signals of imminent
mental animals also showed that temporary inactivation of the success. In these environments, it is advantageous for reinforce-
insula reduced amphetamine seeking behavior in amphet- ment learning algorithms to compute a value function that can
amine-experienced rats (Contreras et al., 2007). Given its well- assign some value to near-misses, despite the objective
recognized role in the processing of bodily feedback (Craig, absence of reinforcement on these trials (e.g., Daw et al.,
2002), the insula’s involvement in addictive behaviors may be 2006; Kakade and Dayan, 2002). In many gambling games,
to signal the interoceptive aspects of compulsive urges (Gray however, winning outcomes are chance events and near-misses
and Critchley, 2007). While previous fMRI studies have often are not predictive of winning, and so it would be misleading to
associated insula activity with negative emotional states like assign value to near-misses. Humans are often deficient at pro-
disgust (Phillips et al., 1997), pain (Ploghaus et al., 1999), or cessing chance events (Carlson and Shu, 2007; Wagenaar,
risk of financial loss (Paulus et al., 2003), it is also reliably 1988), and it is conceivable that gambling games may harness
recruited in response to monetary gains (Delgado et al., 2000; a reinforcement learning system that evolved to handle skill-
Elliott et al., 2000; Izuma et al., 2008) and other appetitive pro- oriented behaviors.
cessing (Craig, 2002). Based on the present findings, we would A second issue is that the reward expectation and omission
hypothesize that excessive insula recruitment during gambling components were matched across the participant-chosen and
play may be a risk factor for the cognitive distortions and loss- computer-chosen conditions, but we saw differences between
chasing that are characteristic of problem (‘‘compulsive’’) the near-miss outcomes as a function of personal control, in
gambling. both the subjective ratings and the rACC response. These
These findings provide a number of further insights into the effects are more consistent with cognitive formulations of
psychological basis of the near-miss effect. By one account, gambling that invoke an ‘‘illusion of control,’’ where the gambler
the near-miss may be conceptualized as the omission of an ex- interprets the near-miss as evidence that he has acquired skill at
pected reward and considered within the context of fMRI studies the game. Crucially, this appraisal of skill is most likely to occur
of reinforcement learning by prediction error (e.g., D’Ardenne when the player has control over their gamble selection. Thus,
et al., 2008; McClure et al., 2003; O’Doherty et al., 2003). By by interpreting the near-miss event as evidence of skill acquisi-
this formulation, on near-miss trials, as the slot machine reel tion, the subject is motivated to continue gambling in order to
approaches a standstill during the anticipation phase, the exploit this (perceived) knowledge. Our finding that the rACC is
subject develops an expectation that they are about to win. sensitive to this manipulation is consistent with much that is
This may be analogous to an effect shown in electrophysiological known about ACC involvement in reward processing and deci-
research, that during appetitive Pavlovian conditioning tasks sion-making. Lesion studies in experimental animals have shown
with uncertain rewards, there is a ‘‘ramping up’’ of mesolimbic a critical role for ACC in deciding how much effort to invest in ob-
dopamine cell firing between the CS presentation and the taining a reward (Rudebeck et al., 2006) and in using the
expected time of juice delivery (Fiorillo et al., 2003). In our slot outcomes of past decisions to guide ongoing choice (Behrens
machine task, this positive prediction error is rapidly followed et al., 2007; Kennerley et al., 2006). The dependency of the
by a negative prediction error in the outcome phase, as the ex- rACC response upon personal control is also consistent with
pected win is withheld. Dopamine cells show a pause in firing event-related potential data where the feedback negativity
to omission of an expected reward (Schultz, 2006). The observed (thought to derive from a medial frontal source) was enhanced
signal in the ventral striatum during near-miss outcomes is on trials where a choice or response was required (Yeung
compatible with this account, as BOLD response in this region et al., 2005; see also Walton et al., 2004 for similar data using
is known to correlate closely with both positive and negative fMRI). In the specific context of gambling behavior, we postulate
prediction errors (D’Ardenne et al., 2008; McClure et al., 2003; that the rACC plays a key role in processing the personal signif-
O’Doherty et al., 2003) and is observed irrespective of instru- icance of the near-miss outcomes; that is, interpreting them as
mental demands (O’Doherty et al., 2004; Zink et al., 2003), evidence of skill acquisition and using these outcomes to inform
consistent with our finding that this region responded to near- subsequent choice.
misses across both participant-chosen and computer-chosen An alternative, lower-level account of these near-miss
conditions. However, several aspects of this formulation remain phenomena is that they are an effect of perceptual generaliza-
unclear: how positive and negative prediction errors may tion. By virtue of their spatial proximity to the goal state, near-
summate when occurring close together in time, how pauses misses may engender some goal-related neural processing.
in dopamine cell firing influence the BOLD response, and Such an account seems unlikely for two reasons. First, spatial
whether reward omission and discrete ‘‘nonwin’’ events are anal- proximity to the payline is equally present across the partici-
ogous. Future research may fruitfully manipulate the expectation pant-chosen and computer-chosen conditions, but the impact
of winning in order to study its effect upon near-miss processing. of the near-misses on ratings of ‘‘continue to play’’ and rACC
486 Neuron 61, 481–490, February 12, 2009 ª2009 Elsevier Inc.
Neuron
Brain Responses to Gambling Near-Misses
signal diverged as a function of personal control. Second, both data inform our understanding of the allure of gambling behavior
the subjective ratings and the rACC signal were predominantly within society, and by extrapolation, the capacity of gambling to
modulated by near-misses that passed through the payline become addictive and pathological.
before stopping; the near-misses that stopped one position
short of the payline were much less effective. A perceptual EXPERIMENTAL PROCEDURES
generalization account would predict comparable effects for
near-misses either side of the payline. Experiment 1 (Behavioral Study)
The effects of near-misses and personal control in the present Subjects
study were observed in healthy volunteers who did not gamble Forty undergraduate volunteers (23 male) were recruited through university
advertisements that asked ‘‘Do you enjoy gambling?’’ Subjects attended
regularly. When nine subjects with moderate gambling involve-
a single test session, where they completed the slot machine task (30 min),
ment (South Oaks Gambling Screen scores 2–5) were excluded the South Oaks Gambling Screen (Lesieur and Blume, 1987) and the
from the behavioral analysis (n = 31), the potency of the near- gambling-related cognitions scale (Raylu and Oei, 2004; see Table S1). The
miss and personal control manipulations were unaffected (see protocol was approved by the Cambridge Psychology Research Ethics
Supplemental Data). However, as gambling becomes dysfunc- Committee (#2006.35) and all volunteers provided written informed consent.
tional and problematic, it is likely that these cognitive distortions Volunteers were instructed that they would have ‘‘the opportunity to win
become exacerbated (Joukhador et al., 2003), along with disrup- money on the task’’ and by virtue of the pseudorandomized win sequence,
all participants received £5 at the end of the session.
tion of multiple components of reward-related brain circuitry. A
Task Design
previous fMRI study in pathological gamblers using a card- The task was programmed in Microsoft Visual Basic 6, with responses regis-
guessing task reported blunted activation in the ventral striatum tered on three adjacent keyboard keys. Trial structure and display screen
and ventromedial prefrontal cortex (which includes the rACC) in are displayed in Figure 1. The task display resembles a two-reel slot machine,
a contrast of monetary wins and losses (Reuter et al., 2005). with the same six icons displayed, in the same order, on the left and right reel,
Similar findings were reported in substance addictions (Gold- and a horizontal ‘‘payline’’ across the center of the screen. At the start of the
task, the subject was invited to select the six icons they wished to play with,
stein et al., 2007; Wrase et al., 2007). Conversely, human lesion
from sixteen alternatives arranged in a 4 3 4 matrix. This feature was included
patients with damage to the ventromedial prefrontal cortex to enhance the participants’ level of involvement, and subjects were instructed
showed increased wagering on a neuropsychological test of that the available shapes would vary in the chances of winning during the
gambling behavior (Clark et al., 2008). Activity in this region game. After selecting their icons, the subject played 4 practice trials followed
has also been associated with decisions to chase one’s losses by 60 trials with monetary reward available.
(Campbell-Meiklejohn et al., 2008), which is widely recognized Each trial consisted of a selection phase, an anticipation phase, and an
outcome phase. The selection phase lasted a fixed 5 s duration, where one
as a hallmark of problem gambling. As well as the near-miss
shape on the left reel was selected. The anticipation phase lasted a variable
effects discussed above, the presence of personal control duration (2.8–6 s), where the right reel was spun, and decelerated to a stand-
caused subjects to rate their chances of winning as higher, still. The outcome phase was initiated as the right reel stopped moving: if the
and the winning outcomes as more pleasurable, compared to right reel stopped on the icon that was selected on the left reel (i.e., matching
computer-selected gambles, although we were unable to detect icons displayed in the payline), the subject was awarded £0.50; all other
any corollary of these effects in the fMRI experiment. outcomes won nothing. Outcomes were presented in a fully balanced pseudo-
These data demonstrate that two cognitive distortions associ- random order to ensure a proportionate number of wins over the 60 trials (1/6,
total 10), near-misses (2/6, total 20) and full-misses (3/6, total 30). The outcome
ated with gambling behavior can be elicited in a laboratory
phase lasted a fixed 4 s duration. At the end of each trial, there was an intertrial
setting, in healthy subjects who do not gamble with any regu- interval of variable duration (2–7 s).
larity. Gambling near-misses were associated with significant Two trial types were presented in a pseudorandom order: on 30 trials, the
recruitment of brain win-related circuitry and acted to increase play icon was selected by the participant, and on the other 30 trials, the play
desire to gamble when the subject had personal control over se- icon was selected by the computer. Trial type was indicated by screen back-
lecting the gamble. These neural responses may be described as ground color and a message on the left side of the screen. On participant-
chosen trials (white background), the subject chose the play icon using keys
anomalous, in the sense that they occur in the absence of objec-
1 and 2 to rotate the reel up and down, and key 3 to select the icon currently
tive reinforcement on near-miss trials. In this sense, these find- displayed in the payline. On computer-chosen trials (black background), the
ings are congruent with data showing that striatal activity is computer selected the icon on the left reel, but the subject was required to
tied to the subjective utility rather than the objective value of confirm the selection by pressing key 3, in order to better equate attentional
the outcome; for example, the ventral striatal response to mone- and motor demands across the two conditions. In both conditions, if selec-
tary wins is also sensitive to framing effects (Nieuwenhuis et al., tion/confirmation was not completed within the 5 s window, a ‘‘Too late’’
message was displayed and the next trial commenced after the intertrial
2005a) and individual discount functions in the valuation of de-
interval.
layed rewards (Kable and Glimcher, 2007). These neural corre- On each trial, subjective ratings were also acquired using onscreen visual
lates of the near-miss effect may underlie the behavioral potency analog scales. After the selection phase, subjects rated ‘‘How do you rate
of near-miss outcomes to engender continued play. Our findings your chances of winning?’’ and after the outcome phase, two further ratings
in the ventral striatum and rACC are consistent with current were taken: ‘‘How pleased are you with the result?’’ and ‘‘How much do you
knowledge about the involvement of these regions in reward pro- want to continue to play the game?’’ Subjects indicated their response on
cessing and decision-making. The close relationships between a 21 point scale using keys 1 and 2 to move left and right and key 3 to confirm.
No time limit was imposed for the subjective ratings.
insula recruitment, and measures of gambling propensity and
Statistical Analysis
the subjective effects of near-misses, indicate an important Subjective ratings for each subject were standardized to a z score, based on
role for the insula in decisions to gamble. By linking psycholog- the individual’s mean and standard deviation for that rating, given the vari-
ical and neurobiological accounts of gambling behavior, these ability in anchoring across subjects. Data were inspected for normality and
Neuron 61, 481–490, February 12, 2009 ª2009 Elsevier Inc. 487
Neuron
Brain Responses to Gambling Near-Misses
parametric statistics were applied only where normality was met. Subjective calculated between parameter estimates from different trial types. The
ratings were analyzed using paired t tests (for ‘‘chances of winning’’) and following outcome-related contrasts were computed:
repeated-measures analysis of variance (for ‘‘pleased with outcome’’
and ‘‘continue to play’’) with outcome (three levels: win, near-miss, full-miss) (1) Win-related activity: Winning outcomes on participant- and computer-
and control (two levels: participant-chosen, computer-chosen) as factors. chosen trials minus all nonwinning outcomes on participant- and
The Greenhouse-Geisser correction was applied where sphericity was computer-chosen trials.
violated. Two-tailed statistics were thresholded at p < 0.05. (2) Near-miss activity: near-miss outcomes on participant- and computer-
chosen trials minus full-miss outcomes on participant- and computer-
Experiment 2 (fMRI Study) chosen trials. This contrast was restricted to areas showing win-related
Subjects activity (i.e., masked with contrast 1).
Seventeen right-handed subjects with no history of psychiatric or neurological (3) Near-miss by choice interaction: areas differentially recruited by near-
disorder were recruited from advertisements around the University. One misses compared to full-misses as a factor of participant versus
subject withdrew due to claustrophobia, and one subject was subsequently computer control (i.e., 1, 1, 1, 1). This contrast was restricted to
excluded from all analysis due to excessive movement (4 mm within session, areas showing win-related activity (i.e., masked with contrast 1).
with pronounced spiking), leaving 15 subjects (9 male, mean age 26 SD 7.5) in (4) Win activity as a function of personal control: winning outcomes on
the reported analysis. Subjects reported minimal to modest involvement in participant-chosen trials minus winning outcomes on computer-
gambling, indexed by scores on the South Oaks Gambling Screen of 0–3 chosen trials. This contrast was restricted to areas showing win-related
(mean 0.7, SD 1.0; scores R5 indicate probable pathological gambling). activity (i.e., masked with contrast 1).
Subjects attended a single fMRI session at the Wolfson Brain Imaging Centre
Based on the data from experiment 1, contrasts 2 and 3 were repeated
in Cambridge, UK. The protocol was approved by the Norfolk & Norwich
restricted to near-miss outcomes where the play icon passed through the pay-
Research Ethics Committee (COREC 06/Q0101/69) and all volunteers
line. Contrasts 1 and 2 were also calculated for the onset of the anticipation
provided written informed consent. Volunteers were reimbursed £20 for partic-
phase. For the selection phase onsets, a single contrast of participant-chosen
ipation ‘‘with the opportunity to win further money on the task’’ (£15 over 180
minus computer-chosen trials was calculated (see Table S5). Individual
trials).
contrast images were taken to a second-level random-effects group analysis,
Task Design
and were thresholded at p < 0.05 corrected for multiple comparisons using
Several minor modifications were required for fMRI. First, the auditory feed-
random field theory (Worsley et al., 1996), i.e., familywise error corrected.
back was not delivered given the noise of the scanner. Second, more trials
Masking of contrasts with the win-related activity (contrast 1) was performed
were acquired (3 blocks of 60 trials) to enable sufficient power for fMRI anal-
using the PickAtlas tool (Maldjian et al., 2003). Signal change was extracted
ysis. Third, the number of ratings was reduced given the longer task duration:
from activated foci using the MARSBAR tool (http://marsbar.sourceforge.
the ‘‘pleased with outcome’’ rating was dropped altogether, and the ratings of
net/) for the purposes of plotting the data.
‘‘chances of winning’’ and ‘‘continue to play’’ were acquired, at random, on 1 in
3 trials. Responses were recorded using the first three buttons on a four-button
box, resting on the subject’s stomach under the dominant hand. Subjects per-
SUPPLEMENTAL DATA
formed 10 practice trials on the task (delivering two hypothetical wins) before
entering the fMRI scanner.
The Supplemental Data include five tables and supplemental text and can be
Imaging Procedure
found with this article online at http://www.neuron.org/supplemental/S0896-
Scanning was performed on a Siemens TimTrio 3 Tesla magnet using a 32 slice
6273(09)00037-3.
axial oblique sequence, with a repetition time of 2 s (TE 30ms, flip angle 78 ,
voxel size 3.1 3 3.1 3 3.0 mm, matrix size 64 3 64, field of view 201 mm 3
201 mm, bandwidth 2232 Hz/Px). At the start of each run, six dummy scans
ACKNOWLEDGMENTS
were discarded to allow for equilibrium effects. Each 60 trial EPI run lasted
a maximum of 630 repetitions (21 min), but was terminated early on block
This work was supported by an Economic and Social Research Council and
completion. A high-resolution T1-weighted three-dimensional magnetiza-
Responsibility in Gambling Trust project grant to L.C. and T.W. Robbins
tion-prepared rapid acquisition gradient-echo sequence (MP-RAGE) struc-
(RES-164-0010). This work was completed within the Behavioural and Clinical
tural image was also acquired for use in spatial normalization of the EPI series.
Neuroscience Institute, supported by a consortium award from the Medical
Imaging Analysis
Research Council (UK) and the Wellcome Trust. We are grateful to the radio-
fMRI data analysis was performed using SPM5 (Statistical Parametric
graphic staff at the Wolfson Brain Imaging Centre and to T.W. Robbins,
Mapping, Wellcome Department of Cognitive Neurology, London, UK). Data
G. Murray, H. Chase, P. Corlett, M.R.F. Aitken, and R. Cools for helpful
preprocessing consisted of slice timing correction, within-subject realignment,
discussion.
spatial normalization, and spatial smoothing using a 10 mm Gaussian kernel.
Time series were high pass filtered (128 s). Volumes were normalized to the
Accepted: December 10, 2008
International Consortium for Brain Mapping (ICBM) templates that approxi-
Published: February 11, 2009
mate to Talairach and Tournoux (1988) space, using a matrix obtained from
normalizing each subject’s segmented MP-RAGE structural scan onto the
ICBM gray and white matter templates. REFERENCES
A canonical hemodynamic response function (HRF) was modeled to the
onsets of the selection phase, the anticipation phase and the outcome phase Behrens, T.E., Woolrich, M.W., Walton, M.E., and Rushworth, M.F. (2007).
on each trial. At the selection onset, two trial types were distinguished: partic- Learning the value of information in an uncertain world. Nat. Neurosci. 10,
ipant-chosen trials and computer-chosen trials. At anticipation and outcome, 1214–1221.
eight trial types were distinguished, comprising a 2 (choice: participant-
chosen, computer-chosen) by 4 (win, near-miss before the payline, near- Berns, G.S., McClure, S.M., Pagnoni, G., and Montague, P.R. (2001). Predict-
miss past the payline, full-miss) factorial design. The design matrix thus ability modulates human brain response to reward. J. Neurosci. 21, 2793–
comprised 18 (2 + 8 + 8) columns per session. In addition, the movement 2798.
parameters from realignment were included as covariates of no interest. The Breiter, H.C., Gollub, R.L., Weisskoff, R.M., Kennedy, D.N., Makris, N., Berke,
HRF was used a covariate in a general linear model, and a parameter estimate J.D., Goodman, J.M., Kantor, H.L., Gastfriend, D.R., Riorden, J.P., et al.
was obtained for each voxel, for each event type, reflecting the strength of (1997). Acute effects of cocaine on human brain activity and emotion. Neuron
covariance between the data and the canonical HRF. Contrast images were 19, 591–611.
488 Neuron 61, 481–490, February 12, 2009 ª2009 Elsevier Inc.
Neuron
Brain Responses to Gambling Near-Misses
Breiter, H.C., Aharon, I., Kahneman, D., Dale, A., and Shizgal, P. (2001). Func- Joukhador, J., Maccallum, F., and Blaszczynski, A. (2003). Differences in
tional imaging of neural responses to expectancy and experience of monetary cognitive distortions between problem and social gamblers. Psychol. Rep.
gains and losses. Neuron 30, 619–639. 92, 1203–1214.
Bunzeck, N., and Duzel, E. (2006). Absolute coding of stimulus novelty in the Kable, J.W., and Glimcher, P.W. (2007). The neural correlates of subjective
human substantia nigra/VTA. Neuron 51, 369–379. value during intertemporal choice. Nat. Neurosci. 10, 1625–1633.
Campbell-Meiklejohn, D.K., Woolrich, M.W., Passingham, R.E., and Rogers, Kakade, S., and Dayan, P. (2002). Dopamine: generalization and bonuses.
R.D. (2008). Knowing when to stop: the brain mechanisms of chasing losses. Neural Netw. 15, 549–559.
Biol. Psychiatry 63, 293–300. Kassinove, J.I., and Schare, M.L. (2001). Effects of the ‘‘near miss’’ and the
Carlson, K.A., and Shu, S.B. (2007). The rule of three: How the third event ‘‘big win’’ on persistence at slot machine gambling. Psychol. Addict. Behav.
signals the emergence of a streak. Organ. Behav. Hum. Decis. Process. 15, 155–158.
104, 113–121. Kennerley, S.W., Walton, M.E., Behrens, T.E., Buckley, M.J., and Rushworth,
Clark, L., Bechara, A., Damasio, H., Aitken, M.R., Sahakian, B.J., and Robbins, M.F. (2006). Optimal decision making and the anterior cingulate cortex. Nat.
T.W. (2008). Differential effects of insular and ventromedial prefrontal cortex Neurosci. 9, 940–947.
lesions on risky decision-making. Brain 131, 1311–1322. Knutson, B., Fong, G.W., Bennett, S.M., Adams, C.M., and Hommer, D. (2003).
Contreras, M., Ceric, F., and Torrealba, F. (2007). Inactivation of the interocep- A region of mesial prefrontal cortex tracks monetarily rewarding outcomes:
tive insula disrupts drug craving and malaise induced by lithium. Science 318, characterization with rapid event-related fMRI. Neuroimage 18, 263–272.
655–658. Ladouceur, R., and Mayrand, M. (1987). The level of involvement and the
Cote, D., Caron, A., Aubert, J., Desrochers, V., and Ladouceur, R. (2003). Near timing of betting in roulette. J. Psychol. 121, 169–176.
wins prolong gambling on a video lottery terminal. J. Gambl. Stud. 19, Langer, E.J. (1975). The illusion of control. J. Pers. Soc. Psychol. 32, 311–328.
433–438. Lesieur, H.R., and Blume, S.B. (1987). The South Oaks Gambling Screen
Craig, A.D. (2002). How do you feel? Interoception: the sense of the physiolog- (SOGS): a new instrument for the identification of pathological gamblers.
ical condition of the body. Nat. Rev. Neurosci. 3, 655–666. Am. J. Psychiatry 144, 1184–1188.
D’Ardenne, K., McClure, S.M., Nystrom, L.E., and Cohen, J.D. (2008). BOLD Maldjian, J.A., Laurienti, P.J., Kraft, R.A., and Burdette, J.H. (2003). An auto-
responses reflecting dopaminergic signals in the human ventral tegmental mated method for neuroanatomic and cytoarchitectonic atlas-based interro-
area. Science 319, 1264–1267. gation of fMRI data sets. Neuroimage 19, 1233–1239.
Davis, D., Sundahl, I., and Lesbo, M. (2000). Illusory personal control as McClure, S.M., Berns, G.S., and Montague, P.R. (2003). Temporal prediction
a determinant of bet size and type in casino craps games. J. Appl. Soc. Psy- errors in a passive learning task activate human striatum. Neuron 38, 339–346.
chol. 30, 1224–1242. Naqvi, N.H., Rudrauf, D., Damasio, H., and Bechara, A. (2007). Damage to the
Daw, N.D., O’Doherty, J.P., Dayan, P., Seymour, B., and Dolan, R.J. (2006). insula disrupts addiction to cigarette smoking. Science 315, 531–534.
Cortical substrates for exploratory decisions in humans. Nature 441, 876–879. Nieuwenhuis, S., Heslenfeld, D.J., von Geusau, N.J., Mars, R.B., Holroyd,
Delgado, M.R., Nystrom, L.E., Fissell, C., Noll, D.C., and Fiez, J.A. (2000). C.B., and Yeung, N. (2005a). Activity in human reward-sensitive brain areas
Tracking the hemodynamic responses to reward and punishment in the stria- is strongly context dependent. Neuroimage 25, 1302–1309.
tum. J. Neurophysiol. 84, 3072–3077. Nieuwenhuis, S., Slagter, H.A., von Geusau, N.J., Heslenfeld, D.J., and
Elliott, R., Friston, K.J., and Dolan, R.J. (2000). Dissociable neural responses in Holroyd, C.B. (2005b). Knowing good from bad: differential activation of
human reward systems. J. Neurosci. 20, 6159–6165. human cortical areas by positive and negative outcomes. Eur. J. Neurosci.
21, 3161–3168.
Fiorillo, C.D., Tobler, P.N., and Schultz, W. (2003). Discrete coding of reward
probability and uncertainty by dopamine neurons. Science 299, 1898–1902. O’Doherty, J.P., Dayan, P., Friston, K., Critchley, H., and Dolan, R.J. (2003).
Temporal difference models and reward-related learning in the human brain.
Garavan, H., Pankiewicz, J., Bloom, A., Cho, J.K., Sperry, L., Ross, T.J., Sal- Neuron 38, 329–337.
meron, B.J., Risinger, R., Kelley, D., and Stein, E.A. (2000). Cue-induced
O’Doherty, J., Dayan, P., Schultz, J., Deichmann, R., Friston, K., and Dolan,
cocaine craving: neuroanatomical specificity for drug users and drug stimuli.
R.J. (2004). Dissociable roles of ventral and dorsal striatum in instrumental
Am. J. Psychiatry 157, 1789–1798.
conditioning. Science 304, 452–454.
Gilman, J.M., Ramchandani, V.A., Davis, M.B., Bjork, J.M., and Hommer, D.W.
Paulus, M.P., Rogalsky, C., Simmons, A., Feinstein, J.S., and Stein, M.B.
(2008). Why we like to drink: a functional magnetic resonance imaging study of
(2003). Increased activation in the right insula during risk-taking decision
the rewarding and anxiolytic effects of alcohol. J. Neurosci. 28, 4583–4591.
making is related to harm avoidance and neuroticism. Neuroimage 19,
Goldstein, R.Z., Alia-Klein, N., Tomasi, D., Zhang, L., Cottone, L.A., Maloney, 1439–1448.
T., Telang, F., Caparelli, E.C., Chang, L., Ernst, T., et al. (2007). Is decreased
Phillips, M.L., Young, A.W., Senior, C., Brammer, M., Andrew, C., Calder, A.J.,
prefrontal cortical sensitivity to monetary reward associated with impaired
Bullmore, E.T., Perrett, D.I., Rowland, D., Williams, S.C., et al. (1997). A
motivation and self-control in cocaine addiction? Am. J. Psychiatry 164,
specific neural substrate for perceiving facial expressions of disgust. Nature
43–51.
389, 495–498.
Gray, M.A., and Critchley, H.D. (2007). Interoceptive basis to craving. Neuron
Ploghaus, A., Tracey, I., Gati, J.S., Clare, S., Menon, R.S., Matthews, P.M., and
54, 183–186.
Rawlins, J.N. (1999). Dissociating pain from its anticipation in the human brain.
Griffiths, M. (1991). Psychobiology of the near-miss in fruit machine gambling. Science 284, 1979–1981.
J. Psychol. 125, 347–357.
Potenza, M.N. (2006). Should addictive disorders include non-substance-
Griffiths, M. (1993). Fruit machine gambling: the importance of structural char- related conditions? Addiction 101 (Suppl 1), 142–151.
acteristics. J. Gambl. Stud. 9, 101–120. Raylu, N., and Oei, T.P. (2004). The Gambling Related Cognitions Scale
Harrigan, K.A. (2008). Slot machine structural characteristics: creating near (GRCS): development, confirmatory factor validation and psychometric prop-
misses using high award symbol ratios. International Journal of Mental Health erties. Addiction 99, 757–769.
and Addiction 6, 353–368. Reid, R.L. (1986). The psychology of the near miss. J. Gambl. Behav. 2, 32–39.
Henslin, J.M. (1967). Craps and magic. Am. J. Sociol. 73, 316–330. Reuter, J., Raedler, T., Rose, M., Hand, I., Glascher, J., and Buchel, C. (2005).
Izuma, K., Saito, D.N., and Sadato, N. (2008). Processing of social and mone- Pathological gambling is linked to reduced activation of the mesolimbic reward
tary rewards in the human striatum. Neuron 58, 284–294. system. Nat. Neurosci. 8, 147–148.
Neuron 61, 481–490, February 12, 2009 ª2009 Elsevier Inc. 489
Neuron
Brain Responses to Gambling Near-Misses
Rudebeck, P.H., Walton, M.E., Smyth, A.N., Bannerman, D.M., and Rush- Walker, M. (1992). The Psychology of Gambling (Sydney: Pergamon Press).
worth, M.F. (2006). Separate neural pathways process different decision Walton, M.E., Devlin, J.T., and Rushworth, M.F. (2004). Interactions between
costs. Nat. Neurosci. 9, 1161–1168. decision making and performance monitoring within prefrontal cortex. Nat.
Schultz, W. (2006). Behavioral theories and the neurophysiology of reward. Neurosci. 7, 1259–1265.
Annu. Rev. Psychol. 57, 87–115. Wang, G.J., Volkow, N.D., Fowler, J.S., Cervany, P., Hitzemann, R.J., Pappas,
Shaffer, H.J., LaPlante, D.A., LaBrie, R.A., Kidman, R.C., Donato, A.N., and N.R., Wong, C.T., and Felder, C. (1999). Regional brain metabolic activation
Stanton, M.V. (2004). Toward a syndrome model of addiction: multiple expres- during craving elicited by recall of previous drug experiences. Life Sci. 64,
sions, common etiology. Harv. Rev. Psychiatry 12, 367–374. 775–784.
Stein, E.A., Pankiewicz, J., Harsch, H.H., Cho, J.K., Fuller, S.A., Hoffmann, Worsley, K.J., Marrett, S., Neelin, P., Vandal, A.C., Friston, K.J., and Evans,
R.G., Hawkins, M., Rao, S.M., Bandettini, P.A., and Bloom, A.S. (1998). Nico- A.C. (1996). A unified statistical approach for determining significant signals
tine-induced limbic cortical activation in the human brain: a functional MRI in images of cerebral activation. Hum. Brain Mapp. 4, 58–73.
study. Am. J. Psychiatry 155, 1009–1015. Wrase, J., Schlagenhauf, F., Kienast, T., Wustenberg, T., Bermpohl, F., Kahnt,
Talairach, J., and Tournoux, P. (1988). Co-planar Stereotaxic Atlas of the T., Beck, A., Strohle, A., Juckel, G., Knutson, B., and Heinz, A. (2007). Dysfunc-
Human Brain (New York: Thieme Medical Publishers). tion of reward processing correlates with alcohol craving in detoxified alco-
Thut, G., Schultz, W., Roelcke, U., Nienhusmeier, M., Missimer, J., Maguire, holics. Neuroimage 35, 787–794.
R.P., and Leenders, K.L. (1997). Activation of the human brain by monetary Yeung, N., Holroyd, C.B., and Cohen, J.D. (2005). ERP correlates of feedback
reward. Neuroreport 8, 1225–1228. and reward processing in the presence and absence of response choice.
Tricomi, E.M., Delgado, M.R., and Fiez, J.A. (2004). Modulation of caudate Cereb. Cortex 15, 535–544.
activity by action contingency. Neuron 41, 281–292. Zink, C.F., Pagnoni, G., Martin, M.E., Dhamala, M., and Berns, G.S. (2003).
Wagenaar, W. (1988). Paradoxes of Gambling Behaviour (London: Lawrence Human striatal response to salient nonrewarding stimuli. J. Neurosci. 23,
Erlbaum Associates). 8092–8097.
490 Neuron 61, 481–490, February 12, 2009 ª2009 Elsevier Inc.