Sie sind auf Seite 1von 8

Studies in History and Philosophy of Science 62 (2017) 6e13

Contents lists available at ScienceDirect

Studies in History and Philosophy of Science


journal homepage: www.elsevier.com/locate/shpsa

Process tracing in political science: What’s the story?q


Sharon Crasnow
Norco College, 2001 Third Street, Norco, CA 92860, United States

a r t i c l e i n f o a b s t r a c t

Article history: Methodologists in political science have advocated for causal process tracing as a way of providing evi-
Available online 14 March 2017 dence for causal mechanisms. Recent analyses of the method have sought to provide more rigorous
accounts of how it provides such evidence. These accounts have focused on the role of process tracing for
Keywords: causal inference and specifically on the way it can be used with case studies for testing hypotheses.
Narrative While the analyses do provide an account of such testing, they pay little attention to the narrative el-
Process tracing
ements of case studies. I argue that the role of narrative in case studies is not merely incidental. Narrative
Causal mechanism
does cognitive work by both facilitating the consideration of alternative hypotheses and clarifying the
Case studies
relationship between evidence and explanation. I consider the use of process tracing in a particular case
(the Fashoda Incident) in order to illustrate the role of narrative. I argue that process tracing contributes
to knowledge production in ways that the current focus on inference tends to obscure.
Ó 2017 Elsevier Ltd. All rights reserved.

1. Introduction democratic peace.1 A narrative of the incidentda story that pulls


together the events surrounding the encounter at Fashodadmay
During the late-19th and early-20th centuries, as European thus be told in a variety of ways. If we are interested in the history of
powers scrambled for control of the African continent, British and the European colonial presence in Africa, there are aspects of the
French interests intersected in the North Nile River Valley. In July of case that will be more relevant than othersdthe location of the
1898, a small French expedition occupied the village of Fashoda in a village is crucial, for example. Fashoda is roughly the intersection of
move to secure a trade route between their colonies in the east a proposed trade and communication routedthe Cape to Cairo
(Senegal) and west (Djibouti) of the continent. Anglo-Egyptian railroad proposed by Cecil Rhodes in 1892dand a potential east-
forces led by Sir Herbert Kitchener were moving south from Cairo west link between the French colonies. The French withdrawal
as part of an effort to reassert control over the Sudan. After gave the British their north-south pathway and secured their
receiving orders to investigate the French presence in Fashoda, control of Egypt, which had been in dispute. The story of the
Kitchener marched on the village and arrived there on September Fashoda Incident can also be told so that it bears on international
18. While cordial on the ground, the meeting sparked outrage at relations debates about militarized conflict and the democratic
home, touching off “a diplomatic crisis over the division of colonial peace. On this telling, the location is less important than the nature
rights in the Upper Nile” (Schultz, 2001, p. 176). The two forces sat of the government and the dynamics between the nations. That the
waiting instructions from their respective governments with ten- nations are democracies that nearly go to war is more important
sions rising until early November, when the French government than where the incident takes place.
backed down and withdrew their troops thus ending the crisis. Different narratives of the same case carry with them frame-
Although a seemingly minor episode during the European works within which the story needs to make sense. Paul Roth
imperialist conquest of Africa, the Fashoda Incident has been makes this point in his discussion of Clifford Geertz’s classic “Deep
thought interesting for a variety of reasons: its resolution shaped Play: Notes on a Balinese Cockfight.” There he understands Geertz
colonial control of Northern Africa; it marked the last time that as constructing “a particular storyline, that is, a way of reading the
French and British forces appeared on opposite sides of a conflict, event of the cockfight as a tale about Balinese society” (Roth, 1989,
marking a shift in international alliances; and it came close to
providing a counterexample to the robust empirical generalization
that democracies do not go to war against each otherdthe
1
The democratic peace is one of the few widely accepted empirical generaliza-
tions in international relations. Bruce Russett, for example, begins Grasping the
Democratic Peace with, “Scholars and leaders now commonly say ‘Democracies
q This paper appears in a special issue of SHPS on ‘Narrative in Science’. almost never fight each other’,” and refers to “The Fact of Democratic Peace”
E-mail address: Sharon.crasnow@norcocollege.edu. (Russett, 1993, p. 3).

http://dx.doi.org/10.1016/j.shpsa.2017.03.002
0039-3681/Ó 2017 Elsevier Ltd. All rights reserved.
S. Crasnow / Studies in History and Philosophy of Science 62 (2017) 6e13 7

p. 450). As Roth puts it, “A narrative is not determined by those arguments. Bennett’s account serves as an example of
sequencing some prior set of events. Rather, what comes first is problems with an approach to process tracing that isolates the el-
some more general view of what counts; the particular eventsdthe ements of the hypothesized causal mechanism uncovered through
elements relevant to one’s narrativedemerge from this” (Roth, process tracing and downplays the cognitive work played by the
1989, p. 455). narrative elements of case studies.
For political science, such frameworks, and consequently the Specifically, I identify two areas in which elements of narrative
stories they inform, are usually causal. If, for example, the Fashoda are core to process tracing: 1) consideration of alternative hy-
Incident is the story of a “near miss”dthat the two democracies, potheses and 2) the relationship between evidence and explana-
Britain and France, nearly went to wardthen the causal factors that tion. The narrative of the case guides process tracing so that it does
sustained the peace are most salient. But how are such factors to be more than uncover events, actions, and entities that are relevant for
identified? One answer to this question is that they are identified testing hypotheses. To illustrate this, I offer an alternate reading of
through hypothesized causal mechanisms. Such hypotheses might Schultz’s use of process tracing, arguing that his reasoning depends
be either empirically or theoretically drivendthat is, suggested by on a more holistic reading of the eventsdone in which they are
empirical observation or by theories of why nations do and do not made coherent through a narrative. In this way, I argue that process
go to war. A number of such theories appear in the international tracing requires creating a narrative through a hypothesized causal
relations literature. Testing various hypotheses against the events mechanism and that involves more than uncovering pieces of ev-
as they occurred through a case study of that event is one way of idence to test a hypothesis. The hypothesized causal mechanism
providing evidence for or against these competing hypotheses. One not only provides a framework from which information to test
method proposed for uncovering this evidence is causal process hypotheses can be gleaned, but the narrative does cognitive work
tracing. through making the causally salient elements of the case coherent.
Causal process tracing has been characterized as a way of
“formulating and testing explanations with case studies” 2. Process tracing
(Mahoney, 2015, p. 200). The value of process tracing is thus
thought to rest in how it provides evidence for causal mechanisms. The key idea behind process tracing is that through seeking the
Statistical and experimental methods may be able to establish a link key elements of a hypothesized causal mechanism within a case, it
between a dependent and independent variable, but they cannot should be possible to identify whether the mechanism is oper-
reveal what is in the “black box”dthe mechanisms through which atingdthat is, one should be able to trace the mechanism from the
the cause brings about the effect. The idea is that if we are able to cause to the effect. This might be forward lookingdstarting with
trace the process, we will be able to identify the causal mechanism the cause and moving to the effectdor backward lookingdstarting
as it is operating in a particular case. with the effect and tracing its origin in the cause. The case might be
Recently, characterizations of process tracing have been accom- taken to be exemplary and so provide the grounds for some
panied by an effort to provide a more rigorous account of how the generalization or hypothesis (theory-building) or it might be a case
method works to provide evidence.2 The focus on the use of process in which a hypothesized causal mechanism is thought to be oper-
tracing for testing hypotheses in these efforts has indeed provided a ating. The examination of the case provides evidence that the
more rigorous characterization. These accounts have helped to mechanism is or is not operating (theory-testing). George and
clarify the variety of approaches that are described under that name, Bennett put it this way: “Process-tracing attempts to empirically
offered suggestions for how the method provides evidence for establish the posited intervening variables and implication that
causal inference, and urged greater transparency in how process should be true in a case if a particular explanation of that case is
tracing is used, but these approaches have also moved the under- true” (George & Bennett, 2005, p. 147).
standing of the method away from its roots in the narrative elements Bennett and Checkel describe process tracing as “the examina-
of case studies. Nina Tannenwald remarks that while these recent tion of intermediate steps in a process to make inferences about
accounts have value because they make process tracing more hypotheses on how that process took place and whether and how it
transparent and rigorous, she warns that the “‘armature’ of method generated the outcome of interest” (Bennett & Checkel, 2014, p. 6).
should not become such a fetish that it overwhelms the narrative” This characterization closely follows George and Bennett’s
(Tannenwald, 2015, p. 227). She continues, “It is a tall order to be both description of process tracing as a method that “attempts to iden-
methodologically rigorous and narratively engaging but that is a tify the intervening causal processdthe causal chain and causal
worthy goal to which security studies can continue to aspire.” mechanismdbetween an independent variable (or variables) and
(Tannenwald, 2015, p. 227). Although Tannenwald couches her the outcome of the dependent variable” (George & Bennett, 2005, p.
remark in terms of aesthetic appeal, in this essay I argue that the role 206).
of narrative is not merely aesthetic. A consideration of the narrative Unlike quantitative observational and experimental methods
elements of case studies illuminates how process tracing contributes that work with larger populations and produce evidence of average
to knowledge production in ways that the current focus on inference effects, process tracing requires the careful examination of a single
tends to obscure. case or a few cases and provides evidence for singular causation.
The structure of the essay is as follows. I start by giving an ac- That is, rather than providing evidence for the distribution of Y, given
count of the key concepts used and the relationships among them: X in a population, process tracing provides evidence that an instance
process tracing, causal mechanism, and narrative. I next consider y of Yoccurred in this case. Furthermore, process tracing is thought to
Bennett’s reconstruction of Kenneth Schultz’s use of process tracing give insight into how y occurred. For methods that are appropriate
to evaluate various hypothesized causal mechanisms offered to for populations, we may find ourselves both wondering how X
account for the Fashoda Incident. I argue that Bennett treats brought about the distribution of Y in the population (what is the
Schultz’s reasoning as a matter of constructing arguments using causal connection between X and Y?) and whether instances of Y
process tracing as a means of identifying evidence to be used in will occur in individual/event/activity a or not since there is no
assurance that any singular case will exhibit an instance of Y just
because Y is on average likely to be present in the population.
2
I specifically have in mind Beach and Pedersen (2013) and Bennett and Checkel Conversely, if we know that X brought about Y in n we cannot infer
(2014). that X will do the same in different populations (or subpopulations
8 S. Crasnow / Studies in History and Philosophy of Science 62 (2017) 6e13

of the original examined population) n1, n2, n3, or . nz. Different For process tracing to be possible, mechanisms must have parts
methods thus appear to answer different questions and so it is not and those parts need to be accessible to researchers. But the other
surprising that combining methods has been advocated in order to features that characterize mechanisms play important roles as well.
answer both sorts of questions. In the next section, I consider hypothesized causal mechanisms
The idea that process tracing will allow for a more complete offered to account for the outcome of the Fashoda crisis Incident as
causal understanding is intuitively appealing, but how it does so is concrete examples. and I argue that an analysis of process tracing as
not obvious, although the link appears to lie somewhere in the ap- a search for diagnostic pieces of evidence fails to capture the way
peal to causal mechanisms. Advocates of process tracing argue that that a mechanistic account seeks to address the inter-relationship
close examination of the intervening events, activities, or entities of the parts in a way that the narrative elements of case studies can.
occurring between purported cause and purported effect can pro-
vide evidence for the causal mechanism and thus provide the how.
This suggests that a first step for understanding process tracing is 3. Process tracing and the Fashoda Incident
understanding what is meant by “mechanism” and what the rela-
tionship between the process that is traced and the mechanism is. Andrew Bennett (2010, pp. 207e220) has analyzed Kenneth
Mechanisms have been explicated in a variety of ways and the Schultz’s treatment of the Fashoda Incident in Democracy and Co-
preferred understandings vary among disciplines. Still, the main ercive Diplomacy (2001) as a use of process tracing to empirically
features of mechanisms that are relevant to the discussion here can test several different approaches to understanding international
be seen in most characterizations. One of the best known and conflict and ultimately to support Schultz’s preferred account. As
frequently referred to in the social science literature is Machamer, Bennett sees it, Schultz seeks out pieces of evidence each of which
Darden, and Craver’s: “Mechanisms are entities and activities provides a specific sort of inferential test for the various hypothe-
organized such that they are productive of regular changes from sized causal mechanisms under consideration. To provide back-
start or set-up to finish or termination conditions” (2000, p. 3). ground for the analysis, I first give a brief account of the alternative
While they have biological mechanisms in mind, there appear to be approaches under scrutiny.
similarities with social mechanisms of the sort in which political There are two main approaches that can be identified in the
scientist are interested. Thus, we see a similar characterization literature on international conflict. The first stems from the robust
offered by Glennan,: “A mechanism for a behavior is a complex empirical generalization that democracies do not go to war with
system that produces that behavior by the interaction of a number of each otherdthe democratic peace. The democratic peace suggests
parts, where the interactions between parts can be characterized by a role for domestic politics in explaining international conflict
direct, invariant, change-relating generalizations” (2002, p. S344). however leaves open the question of how democracy might play
The main difference between these two is that Machamer, this role. The two main approaches offered to account for the
Darden, and Craver emphasize entities and activities organized democratic peace are normative and institutional. Normative ap-
with a starting point and ending point whereas Glennan is focused proaches propose two sets of norms. The first is the socialization of
on the interactions that take place in a system. Several philosophers democratic leaders to have a preference for nonviolent dispute
of science have claimed that these two characterizations of mech- resolution that decreases the probability of war between demo-
anism are not so different. James Tabery has argued that these cratic nations. The second set of norms is the mutual recognition on
definitions should be synthesized (Tabery 2004) whereas Phyllis the part of leaders that governments in liberal democracies reflect
Illari and Jon Williamsons suggest a “consensus concept” of the wishes of their citizens. Democracies, it is claimed, recognize
mechanism (Illari and Williamson, 2012). Illari and Williamson’s that they will be seen by other democratic states as legitimate
preferred characterization is “A mechanism for a phenomenon because of this. This mutual respect increases the likelihood of the
consists of entities and activities organized in such a way that they peaceful resolution of disputes since demands are recognized as
are responsible for the phenomenon” (Illari and Williamson 2012, legitimate and both parties seek common ground to resolve dif-
p. 123) and. to clarify their understanding, they look at each of the ferences (Schultz, 2001, pp. 12e13).
three parts of their consensus approach in turn: 1) responsible for Institutional approaches begin with the supposition that states
the phenomenon; 2) entities and activities; and 3) organization. are less likely to go to war when those who would bear the cost of war
These accounts capture important aspects of the notion of are involved in the decision making. Democratic institutions provide
mechanism. However, if the idea of a synthesis is taken seriously, I the means for the representation of those who would bear the costs of
propose the following as a better characterization of the core fea- war since they make the government answerable to the citizens.
tures of mechanisms: 1*) mechanisms have partsdthey may be “Thus, democratic leaders face costs of war to which their nondem-
identified as activities, events, or entities, but the parts are in some ocratic counterparts are less vulnerable” (Schultz, 2001, p. 14).
sense discrete (if only analytically); 2*) the parts are organized in While these approaches seek to explain the democratic peace, a
some waydthe mechanism has a structure; and 3*) there is an second theoretical framework, neorealism, challenges that de-
active element that is seen through the inter-relationship of the mocracy or any other domestic political configuration is relevant in
partsdall characterizations of mechanism include the idea that an considering the causes of war. Neorealists argue that conflicts of
effect is brought about, produced, propagated, or maintained interests among nations are inevitable and that wars occur when
through the inter-relationship of the parts.3 the balance of power is such that one nation can militarily domi-
nate another. Cases of democracies that do not go to war in spite of
conflicting interests can be explained based on differential military
3
These elements appear to be implicit in Illari and Williamson’s account with 2* power (Layne 1994).4
and 3* packed into their 2. Machamer, Darden, and Craver and Glennan also include
that the changes produced are regular e the interactions among the parts are
invariant and general, however it is not a consensus that regularity should be
required for mechanisms (Illari and Williamson, 2012 do not include regularity, nor
4
do Bogen, 2005; Reiss, 2008) nor that regularity should always be understood as Neorealists also point out that the period most relevant for evidence of the
embedded in a structure (Reiss, 2008, p. 110). Since this is a disputed feature and democratic peace e the rise of democracies during post World War II e coincides
nothing that follows depends on understanding mechanisms as regular or invariant with the Cold War, which they identify as bearing the primary responsibility for
I leave it out of the characterization offered here. peace among democracies during this same period.
S. Crasnow / Studies in History and Philosophy of Science 62 (2017) 6e13 9

Schultz offers theoretical, statistical, and case-based arguments motivates alternative solutions to costly military conflict.6 Autoc-
against each of these approaches, and proposes an alternative.5 racies do not have this transparency, making signals are harder to
Using a fairly simple bargaining game model as a tool for anal- read and thus, Schultz argues, increasing the likelihood of a crisis
ysis, Schultz proposes an account that he identifies as falling be- escalating into military conflict.
tween the democratic peace and neoliberal frameworks. He As Bennett analyzes Schultz’s use of process tracing, Schultz
identifies informational asymmetries (lack of information about seeks pieces of evidence that either conflict with or comport with
interests, intent, resolve, or military strength) as among the causes the hypothesized causal mechanisms that are offered in each the
of the failure in bargaining between nations that lead to war and approaches. For example, Bennett considers Schultz’s argument
elaborates by identifying features of international disputes that against the neo-realist balance of power approach. On that account,
make it difficult to overcome such asymmetries (Schultz, 2001, p. the explanation for France backing down rests in Britain’s superior
18). military strength (Layne 1994); e the democratic nature of the two
As part of his argument, Schultz explores several cases through governments is not relevant. According to Bennett, Schultz shows
which he tests the viability of these various hypotheses, including that this hypothesis cannot explain a number of features of the
his own. The Fashoda Incident is one such case. He argues that casedthat the crisis happened in the first place, that it lasted two
neither neorealism nor the democratic peace hypotheses can ac- months, and that it came so close to wardsince the fact of Britain’s
count for the details of this case as well as the asymmetrical in- superior military strength was known to the French from the outset
formation hypothesis he proposes. According to Schultz, the (Bennett, 2010, pp. 211e212). Since each of these pieces of infor-
dynamics surrounding international conflict resolutiondboth mation is visible in the case, the balance of power account is
successful negotiations that preserve peace and unsuccessful ne- incomplete and its failure to account for aspects of the case means
gotiations that end in wardcenter on incomplete and asymmetrical that this hypothesis is inadequate.7
information. Although factors such as the balance of power are In contrast, Schultz’s own signaling hypothesis is supported by
important, these are mediated through beliefs and information and an in-depth examination of the case that brings forth relevant
so their effects are not necessary predictable (Schultz, 2001, p. 24). diagnostic pieces of evidence. These show that the credibility of the
Resolution of conflict fails primarily because of lack of access to the British refusal to back down was signaled by the government, the
information that is needed to assess the credibility of a nation’s opposition, and the public. Specifically, Bennett mentions the
threats to go to war. When interests conflict, parties involved in public support by the opposition for the British refusal to back
negotiations have the motivation to deceive their rivals making it down (confirmatory signaling). In addition, he cites evidence of
difficult to assess the credibility of threats. Such assessment relies apathy on the part of the French public (restraining the French
primarily on interpretation of signals, both those directed to the government from successful deception and thus making it difficult
rival nation and those directly internally to the domestic audience. to force a compromise). “In sum, the close timing of these events,
Schultz argues that attention to information and signaling issues following in the sequence predicted by Schultz’s theory, provides .
provides causal mechanisms through which the democratic peace evidence for his explanation; this, combined with the alternative
can be understood. explanations’ failures ., makes Schultz’s explanation of the
He spells this out by looking at the effects of democracy on Fashoda case convincing” (Bennett, 2010, p. 212).8
signaling the credibility of threats issued by state leaders. He While Bennett does mention that Schultz predicts a particular
identifies two mechanisms that work to create clearer signals: a sequence of events, Bennett’s focus is primarily on the pieces of
restraining effect of democracy and a confirmatory effect. The fact evidence and how they bear inferentially on the various hypotheses
that democracies must answer to their constituents in a trans- under consideration. The failure of the neorealist account to pass a
parent environment has a restraining effect on democratic leaders’ test is interpreted as a refutation of that hypothesisdan inference
ability to hide their true intentions from their adversaries resulting that the causal mechanism proposed is not in operation in this case.
in less opportunity for deception. The result is that threats are Bennett next interprets the evidence in support of Schultz’s
perceived as more credible. In addition, because of these same asymmetrical information hypothesis as a form of Bayesian
features, when democracies make threats that are clearly backed by updating. The subjective degree of belief that the hypothesized
public opinion these threats are highly credible. They are rendered mechanism is the best available account is increased with each
even more credible when opposition parties in democracies sup- piece of evidence produced. The relationship between these
port them. Again, because in a democracy the voicing of opposition discrete bits of evidence and the hypothesized causal mechanisms
support is visible to rival nations, it has a confirmatory effect, for which they provide evidence is that they are events, activities,
increasing the credibility of threats. Schultz thus proposes causal or entities that would be expected if the causal mechanism were
mechanisms through which the peace is sustained in democracies. operating in this case. Finding them should increase the degree of
e the government is restrained in making threats because of the belief in the hypothesis.9
transparency, thus thereby increasing their credibility when threats Bennett’s emphasis on the discrete units of evidencedthe
are made. Likewise, public and opposition support also increases partsdseems to pull away from the idea that process tracing is
and the credibility of the threats. is also increased when confirmed
by public and opposition support. The credibility of the threats thus

7
The idea is that minimally the hypothesis should account for all the facts of the
case and in failing to do so the hypothesis should be eliminated. Of course, doing so
5
In response to normative accounts he notes that a shared preference for peace does not confirm the hypothesis but only means that it is still on the table. Bennett
does not always prevent war. In considering institutional arguments, he points out identifies various types of tests that evidence might provide following a categori-
that frequently the cost of war for dictators is greater than it is for democratic zation proposed by van Evera (1997). I discuss these tests in Crasnow, 2012, p. 663.
8
leaders. Dictators frequently risk losing their freedom or their lives as a result of Bennett also briefly discusses Schultz’s treatment of the democratic norms and
taking their nations into unpopular wars whereas democratic rulers merely lose institutions hypotheses, however, Schultz’s own discussion of them differs from his
office. Against neorealists he argues that they focus on conflict of interests and discussion of neorealism in that he identifies them as conflicting with the case
balance of power but do not do a good job of explaining why rational actors ever whereas the neorealist account is merely incomplete. I will return to this point in
chose such a costly option as war. Section 5.
6 9
Recall that the costliness of war raises a serious question about why nations Bennett also develops this Bayesian analysis in more detail in Bennett, 2014.
would ever go to war in the first place. Beach & Pedersen, 2013 also analyze process tracing in terms of Bayesian updating.
10 S. Crasnow / Studies in History and Philosophy of Science 62 (2017) 6e13

seeking evidence for hypothesized causal mechanism as a whole. In the case of process tracing in political science, the beginning
Another way of putting this, referring back to the core features of points and end points often derive from a theoretical framework
mechanisms in Section 2, is that he emphasizes that mechanisms that informs the hypothesis. The Fashoda Incident example is like
have parts (1* of my account of mechanisms), but downplays or this in that it becomes interesting in relation to the theories of
neglects that the parts are organized in some waydthey have a international conflict and more specifically in relation to the
structure (2*)dand the active element that is seen through the democratic peace. Theoretical frameworks and background
inter-relationship of the parts (3*). While it seems clear that finding knowledge point to possible causes and effects in a similar way. For
parts of the mechanismdfor example, the speeches made in sup- example, a multiple regression analysis that focuses on the rela-
port of the British government’s stance by the oppositionddoes tionship between levels of wealth and democracy treats them as
count as evidence, the telling of the tale (the narrative) involves the relevant variables in part because of theories about the rela-
taking the mechanism as a skeleton (organizing structure) and tionship that have made it an established research area in political
moving the story forward through the causal nature of the mech- science.
anism. These organizational features make the story more A second feature of narrative relevant for thinking about process
compelling than the additive effect of such bits of evidence in- tracing is the generative nature of events and actions. In a narrative
dicates. The mechanism is the skeletondthe framingdof the the events do not merely follow one another, they are connected to
narrative through which the story is told and the holistic role that one another. Noël Carroll (2001) has argued that the sequence of
this framing plays is not apparent if process tracing is treated as a events in a narrative depends on causal relations among the
project of finding diagnostic pieces of evidence with which to make events.10 While not everyone agrees with this account, it surely
inferences. To see what is missing more clearly, I turn to a discus- seems that at least some narrative is moved from its beginning to
sion of narrative before reconsidering Schultz’s account of the its end through causal relationsdthe reasons of the actors, the
Fashoda Incident. events occurring that produce changes in the options available to
the actors, and the structures in which the actors must act, all
operate as causes. The story not only has structure but the sequence
4. Narrative, process tracing, and causal mechanisms of events is one in which they are driven along towards the end by
these causes. Such causal relations are similarly the focus of process
I have claimed that uncovering the “diagnostic pieces” of evi- tracing. Finding the traces of the mechanism in the story means not
dence that are found within case studies through process tracing only finding the parts but finding the organizational structure and
only provides a partial understanding of how process tracing con- the active elements through which the endpoint is reached.
tributes to knowledge production. Tracing the process depends on Just as this causal nature of “narrative connection” (Carroll,
being able to tell the story of the case. A case study is not a list of 2001) distinguishes narrative from a temporal series of events,
relevant features (nor is it a list of all of the features surrounding the generative, productive, causal nature of mechanisms also
the event) and process tracing is not merely a matter of sifting distinguish a mechanism from set of elements that could be treated
through those features for evidence. as independent and dependent variables even when taken together
The first feature of narrative relevant here is that narratives have with all the intervening variables.11
a starting point and an end point. I will refer to this feature as Another way that narratives work to move the story from its
“narrative closure.” The narrative takes us from the start to the end beginning to its end is through an elimination of alter-
of the story by moving us along through a series of events that nativesdpossible paths that could have been taken but were not.
unfold over time. Although they need not be presented in the exact Sometimes storytellers are explicit about what these options are,
temporal order over which they unfold, their temporality is sometimes the reader fills in the alternative scenario with implicit
important since it gives the narrative structure through revealing background knowledge of the circumstances the actors face. As
the inter-related nature of the elements of the story. The “closure” John Beatty puts it, “A narrative indicates or alludes to non-
that I am referring to is the “endedness” of the story that de- actualized possibilities, and their consequences, by treating
termines which pieces of the story are to be connected. events . not just as points along the way to the outcome, but as
To relate this to the discussion of the previous section, tempo- “‘turning points’” .” (Beatty, 2016, 36; also see Beatty in this issue).
rality is one way of organizing the parts of the mechanism and the Beatty goes on to distinguish two senses of “contingency” that are
movement of time from the starting point to the end point offers a illustrated through this feature of narrative: 1) forward looking
path along which to trace the process. (See Morgan in this issue for contingencydthe idea that there are possibilities in front of us that
other ways narrative organizes parts of a whole.) In the case of the are eliminated at the turning points, and 2) backward looking
Fashoda Incident, when the point of telling the story is its relevance contingencydwhat appeared to be a matter of chance latter comes
for the democratic peace, the end point of the story is the peaceful to seem necessary.
resolution of the conflict. The story is over when the conflict has There are several features of Beatty’s characterization that seem
ended e. the hypothesized mechanism directs attention to the el- particularly relevant for process tracing. One worry often raised
ements of the story that lead to that end point. about the use of case studies is the idea that it may devolve to
Process tracing also must choose a starting pointdsome event, cherry picking or just-so stories. This is indeed a concern but one
entity, or activity that sets the mechanism in motion. The case of
the Fashoda Incident takes as its starting point the initiation of the
crisisdthe point at which the British meet the French outpost at 10
The sense of cause he uses is “a necessary or indispensable contribution to a
Fashoda. There is a sense in which that beginning point is some-
sufficient, though non-necessary, condition for the occurrence of the relevant later
what arbitrary. Where we start the storydwhere we begin tracing event in the narrative complex (or, in other words, it is, at least, what J. L. Mackie
the processddepends on a variety of things. It depends on our calls an INUS condition)” (Caroll 2001, pp. 123e124). I am not committed to un-
interests, background knowledge, and other features of context. If derstanding cause in only this way. I am more inclined to think that there are a
wide variety of ways that “cause” is understood and that any of them could provide
the story of the Fashoda crisis is told in the context of the more
the narrative connection Carroll describes.
general question of colonial power in Africa, the story might begin 11
I mention this alternative specifically because King, Keohane, and Verba (1994)
earlier. Again, when the concern is the resolution of crisis, the point have argued that mechanisms have no unique characteristics that cannot be un-
at which the crisis becomes evident seems appropriate. derstood through such a sequence of variables.
S. Crasnow / Studies in History and Philosophy of Science 62 (2017) 6e13 11

that can be addressed by requiring that all of the relevant details of others. Each hypothesis proposes a mechanism that serves as an
the case be considered and not just those that are relevant to the abstract organizing principle through which he concretizes the
favored hypothesis. In order to assure that these details are details of the case.13 Schultz’s argument is that his account does so in
addressed, alternative hypothesesddifferent ways that the story a way that provides a more coherent storydin a sense of “coher-
could have gone, different paths that could have been taken, ence” that includes completeness, consistency, and credibility.14
different mechanisms through which the case can be under- He starts with the neorealist hypothesis. He makes clear that the
stooddneed to be explored.12 Forward looking contingency directs superior military strength of the British both in Fashoda itself and
the researcher to identify crucial turning points. If the details of the more generally (he particularly notes the superior naval power of
case cohere with the mechanismmechanism, then the turning Britain) was known to the French. This creates a puzzle for the
points should be apparent in the mechanism as points at which the balance of power story in that it leaves unexplained why the French
operation of the mechanism could be disrupted. The successful would have challenged the British at all, why they would have
tracing of the mechanism suggests that the outcome was inevita- remained in Fashoda for two months as the crisis escalated rather
bledor at least highly probable. But alternative pathsdalternative than leaving once it was clear that the British would not compro-
mechanismsdmust also be explored. The case study has to be mise, and why they ultimately did concede when they did. Schultz
detailed enough that alternatives are clear, can be explored, and the considers how the balance of power account might be preserved.
story makes clear why the alternatives were not actualized. He notes for example, that there is fairly strong evidence that the
There is another way that the narrative of the case aids in French never intended to stay in Fashoda but rather hoped to force
thinking through the viability of various accounts. The counter- a compromise that would improve their position in this portion of
factual thinking that causal claims support requires considering Africa and so challenge the presumed dominance of Britain in the
options that are as close as possible to the original case. But how are area. The challenge is consistent with recognizing the superior
we to know what is a minimally different counterfactual scenario military strength of Britain, since it takes France as never intending
without a clear understanding of the actual? And what is actual to go to war, but it leaves unexplained why the French held their
includes more than the “furniture”dthe diagnostic bitsdof the position when that strength was so overwhelming and a compro-
case. It also includes the connections between the actors, circum- mise did not appear to be forthcoming. Schultz considers the
stances, and events. Counterfactual thinking parallels the backward possibility that the French had hopes that a third nation, either the
looking contingency that Beatty describes through exploring how Germans Germany or the Russians, would join them as allies
changes in the past might have resulted in a present unlike that against the Britishdsomething that would account for their
actual. When the story makes clear why such alternative scenarios persistence. But he eliminates these alternative pathwaysdother
did not come to pass, the outcome seems inevitable or nearly so. ways that the story might have gonedby producing evidence of
(See Beatty in this issue for more on narratives and counterfactuals.) events and circumstances that close them off. French and German
These parallels suggest that if narrative has cognitive force then animosity was deep and so they were unlikely allies in any case. The
that force could well be present in process tracing. I have thus far Russian navy would be ice bound for the winter and so unable to be
argued that we can see this in the causal explanatory aspect of counted on as an ally against the powerful British navy.
narrative that Carroll focuses on and in both the forward and In order to avoid telling just just-so stories, process tracing
backward looking contingency that Beatty discusses. I turn now to needs to be done in a way that does not pick out only the parts of
re-examine Schultz’s use of process tracing in the case of the the story that fit. The consideration of alternative hypotheses and
Fashoda Incident with these insights about narrative in mind. their elimination is crucial for a convincing story. But the focus on
the elimination of alternative hypotheses tells us little about what
alternatives to considerdwhich options among all the possibilities
5. Telling the story e: The Fashoda Incident again
are “live.” While alternative hypotheses can be suggested by the
political science literature and general background knowledge, the
Schultz’s account of the Fashoda crisis Incident goes on for 20
details uncovered in the case study also suggest alternatives.
twenty pages of text (Schultz, 2001, pp. 177e196). In those 20
Beatty’s notion of backward looking contingency is helpful here.
twenty pages, he tells the story of the crisis in detail, focusing on
The review of options and their elimination as Schultz considers the
events, actors, and circumstances of the case. While he focuses on
neorealist approach illustrates this. He asks, how could we have
particular events that are relevant to the each of the examined hy-
gotten here, given that the balance of power hypothesis makes it
potheses, in the course of considering them he gives a rich account
unlikely? In this way, he generates alternative possibilities that
of events and actions surrounding the crisis. The details I highlight
need to be examined and eliminated if he is to build an argument
here are intended to give a sense of how Schultz weaves the
against the balance of power account.
narrative but they do not reproduce it. His strategy is to provide a
In relation to the democratic peace accounts, Schultz notes that,
narrative through the various hypothesized causal mechanism. In
“Whereas the neorealist story fails primarily by being incomplete,
doing so he seeks out events, actions, and entities that the hypoth-
elements of the democratic peace story are directly contradicted by
esis in question relies on to connect those events and generate the
many aspects of the crisis” (Schultz, 2001, p. 180). During the two
outcome. The balance of power mechanism, the democratic peace
months in which the Fashoda crisis Incident unfolded, the French
shared norms and institutional mechanisms, and then ultimately his
government was under pressure due to the Dreyfus Affair and there
signaling and asymmetrical information mechanism are each
was a real concern that the democratic regime could collapse. Both
explored in this way. Each provides, as Roth suggests of narrative, a
the democratic norms and institutions hypotheses for the
way of reading the events. Schultz’s strategy is not to uncover events
or actions that refute or support the hypotheses, as in Bennett’s
analysis, but is the more nuanced argument that telling the story 13
That the relationship between cases and hypotheses or theories is one of the
through one causal mechanism is more compelling than through
concrete to the abstract is proposed by Chang (2012) in discussing the relationship
between historical cases in science and the history and philosophy of science.
14
My use of “credibility” here follows Morgan (2012) and differs from the sense of
12
Stephen Gould and Richard Lewontin emphasize this in their 1979 paper “The “credibility” in the discussion of the credibility of threats. That terminology is
Spandrels of San Marcos and the Panglossian Paradigm: A Critique of the Adapta- common in international relations discussions of signaling and refers to the belief
tionist Programme”. that the threat will be acted upon.
12 S. Crasnow / Studies in History and Philosophy of Science 62 (2017) 6e13

democratic peace seem inconsistent with the British response to this contingency, indicating alternative paths that events could have
French domestic crisis. “Rather than working against the jingoism of taken. Finding that they did not go that way solidifies our under-
the public, Salisbury and his ministers cultivated the public’s hos- standing of the actual course of events.
tility in order to convince French decision makers that they could not In this case, the causal mechanism signals the pivotal
grant concessions” (Schultz, 2001, p. 186). Upping the pressure on a pointsdforward looking contingency. The mechanism directs the
weakened democracy does not appear to be consistent with the idea search for features that will produce a coherent story by looking for
that mutual respect for democratic values and institutions is what “moments” when crucial information might have been conveyed
moderates bargaining between democratic nations. but was not. If the French had realized that Salisbury would be
Bennett does not distinguish between these two different sorts under pressure not to compromise they would not have misjudged
of failingsdincompleteness and inconsistency. This too is because the risk of war. These pivot points are then used to account for the
Bennett focuses on pieces of evidence that he sees as playing a role path taken. The French back down when it is clear that there is
in telling inferencesdtestsdof the theory. Schultz, on the other unified British support for war (confirmatory signals) and when it is
hand, is more focused on how well the story hangs together. The also clear that the French public is apathetic about Africa and
gaps in the story correspond to failures to show the in- opposed to engaging the British (restraining signals).
terconnections between the actions, entities, and events that are In a narrative, one element that makes the story worth telling is
implicated in the processdthe elements that we should see if the the awareness that things might have been otherwisedthat the
hypothesized mechanism is operating. The inconsistencies, on the story could have turned out differently. If we think of process
other hand, are expectations that contradict the account of events tracing in terms of testing hypotheses it is not clear how we get that
as they happened. We can treat these as two ways that the coher- sense of contingency., but if we think of the case as constructing a
ence of the story can fail. narrative, these elements are highlighted. The evidence that we
In describing an account as “coherent” I mean to indicate find through process tracing is evidence that things did not go in
minimally that it is both consistent and complete. For the case at some other way that they could have. The possible thus informs the
hand, Schultz argues that thinking of the Fashoda Incident in terms actual and clarifies the nature of the causal relationships outlined.
of balance of power will not produce a complete account and that In this way, it is related to and perhaps buttressed by counterfactual
telling the story in terms of the democratic peace will not produce a reasoning rather than an alternative to it (as Reiss, 2015 argues).
consistent account. But coherence is not just completeness and In summary, while Schultz’s case study can be reconstructed as a
consistency of a story. It is also the way these features contribute to series of tests of alternative hypotheses as Bennett does, to do so
our confidence that the story is a good onedto its credibility, as fails to address both the way constructing a narrative guides pro-
Morgan puts it (2012, 674). In considering how case studies work as cess tracing and the way that the story provided through one hy-
support for a theory, Morgan uses Donald Campbell’s idea that they pothesized mechanism has greater coherence than through the
can both infirm (weaken) and confirm (strengthen) our confidence others considered.
in a hypothesis (Morgan, 2012, p. 670). Case studies contain so
many potential points of fitdso many details that might not be able 6. Conclusions
to be accounted fordthat when they do all fit into an account, our
confidence that this account is a good one should be increased. This I have argued that reconstructing process tracing as inference
is not just a matter of fitting the points to the story as one does in does not capture key elements of how process tracing produces
statistical curve fitting, but rather having the case fit into the story. knowledge. If we understand reading the case as seeing it through a
Credibility is the credibility of the case when told through the causal mechanism, then those connections are more clearly visible.
causal mechanism. In addition, what appears to be context on an inferential reading of
Schultz argues that understanding the case as told through his process tracing becomes content when we understand the case as
hypothesized signaling mechanisms produces the bestdmost narrative.15 It is through the narrative elements of the case that the
complete, consistent, and credibledstory of the options considered salience of this content to other aspects of knowledge production is
e, and that it is the most coherent. To support this argument, he revealed.
considers both the British and French domestic environments and The causal mechanism shapes the story line that helps us
their transparency to each other. First, he notes that incomplete identify what we should look for in the case. The details of the
information contributes to the French move on Fashoda in the first narrative told through that mechanism also clarify what counts as
place. The prime minister, Lord Salisbury had a reputation for relevant alternative hypotheses and supply the dynamic or gener-
making “graceful concessions” (Schultz, 2001, p. 185) and so chal- ative features that are hallmarks of a mechanism. Successful pro-
lenging the British might not have seemed unreasonable to the cess tracing reveals the coherence of the events when understood
French given that their assessment was that the risk of war was not through the causal mechanism. While process tracing can be
high even though Britain’s military strength was so much greater. analyzed as providing a basis for causal inference, to do so is to
However, over the next few months the signals from Britaindboth minimize key features that make it a powerful tool for evaluating
the public outcry and the outcry from the Liberal opposi- hypothesized causal mechanisms.
tiondindicated that the British resolve and the pressure on Salis- When we think of process tracing through narrative, the role
bury not to compromise were to be taken seriously. Backward that case studies play becomes clearer. The case itself includes a
looking contingency is also useful in that it suggests counterfactual variety of different descriptive elements from which the causal
scenarios. Again, the details of the casedthe context in which the story is constructed. While an account of process tracing that fo-
hypothesized mechanism operatesdare important. The counter- cuses on inference draws evidence from the constructed story, it
factual scenarios that are worth considering are those that are leaves out the inter-relationships among the partsdthe generative
minimally different from the actual events. To know which they and temporal elements of the mechanismdand pulls the focus
aredto know what makes sense to probe as an alternative sce- away from the coherence of the case as a whole that is relevant for
nariodrequires knowing what could possibly have been different consideration of alternative hypotheses and for counterfactual
in the case at hand. Rather than treating the details of the story as
context against which we evaluate the hypothesis, they are the
15
relevant content of the story. This supports backward looking Thanks to Mary Morgan for providing this turn of phrase.
S. Crasnow / Studies in History and Philosophy of Science 62 (2017) 6e13 13

analysis. These features support the evaluation of hypotheses Carroll, Noël (2001). Narrative connection. In Noël Carroll beyond Aesthetics: Philo-
sophical essays (pp. 118-133). Cambridge: Cambridge University Press.
because they constitute the total evidence that must be made sense
Chang, Hasok (2012). Beyond case studies: History as philosophy,” integrating
of in the telling of the causal storydthey contribute to the narra- history and philosophy of science: Problems and prospects. In
tive’s completeness, consistency, and credibility. Seymour Mauskopf, & Tad M. Schmaltz (Eds.), Boston studies in the history and
The narratives through which case studies are presented are philosophy of science (pp. 109-124). Dordrecht: Springer.
Crasnow, Sharon (2012). The role of case study research in political science: Evi-
indeed engaging and, as Tannenbaum suggests, it would be a dence for causal claims. Philosophy of Science, 79(5), 655-666.
shame to sacrifice that appeal. But the greater loss is to the George, Alexander L., & Bennett, Andrew (2005). Case studies and theory develop-
cognitive power of the narrative when cases are treated merely as ment in the social sciences. Cambridge: MIT Press.
Glennan, Stuart (2002). Rethinking mechanistic explanation. Philosophy of Science,
sources of bits of diagnostic evidence. S342-S353.
Gould, Stephen J., & Lewontin, Richard C. (1979). The spandrels of san marcos and
Acknowledgements the panglossian paradigm: A critique of the adaptationist programme. Pro-
ceedings of the Royal Society London B, 205, 581-598, 1979.
Illari, Phyllis McKay, & Williamson, Jon (2012). What is a mechanism? Thinking
I am grateful to Stephan Haggard, Julian Reiss, and an anony- about mechanisms across the sciences. European Journal of Philosophy of Science,
mous referee for comments on an earlier version of this paper. In 2, 119-135.
King, Gary, Keohane, Robert O., & Verba, Sidney (1994). Designing social Inquiry:
addition, I owe a special thanks to Mary Morgan and Norton Wise Scientific inference in qualitative research. Princeton. NJ: Princeton University
both for including me in this project and their guidance in thinking Press.
about narrative, process tracing, and causal mechanisms. Layne, Christopher (1994). Kant or Cant: The myth of democratic peace. Interna-
tional Security, 19(2), 5-49.
Mahoney, James (2015). Process tracing and historical explanation. Security Studies,
References 24(2), 200-218.
Morgan, Mary (2012). Case studies: One observation or many? Justification or
Beach, Derek, & Pedersen, Rasmus Brun (2013). Process-tracing Methods: Founda- discovery? Philosophy of Science, 79, 667-677.
tions and guidelines. Ann Arbor: University of Michigan Press. Reiss, Julian (2008). Error in economics: Towards a more evidence-based methodology.
Beatty, John (2016). What are narratives good for? Studies in the History and Phi- New York: Routledge.
losophy of Biological and Biomedical Sciences, 58, 33-40. Reiss, Julian (2015). Causation, evidence, and inference. New York: Routledge.
Bennett, Andrew (2010). Process tracing and causal inference. In Henry Brady, & Roth, Paul (1989). How narratives explain. Social Research, 56(2), 449-478.
David Collier (Eds.), Rethinking social inquiry: Diverse tools, shared standards (p. Russett, Bruce (1993). Grasping the democratic Peace: Principles for a post-cold war
220). Lanham, MD: Rowen & Littlefield Publishers, Inc.. Lanham. world. Princeton, NJ: Princeton University Press.
Bennett, Andrew (2015). Appendix: Disciplining our conjectures, systemizing pro- Schultz, Kenneth (2001). Democracy and coercive diplomacy. New York: Cambridge
cess tracing with bayesian analysis. Process Tracing: From Metaphor to Analytic University Press.
Tool, 276-298. Cambridge: Cambridge University Press. Tabery, James (2004). Synthesizing activities and interactions in the concept of a
Bennett, Andrew, & Checkel, Jeffrey (2014). Process Tracing: From metaphor to an- mechanism. Philosophy of Science, 71(1), 1-15.
alytic tool. Cambridge: Cambridge University Press. Tannenwald, Nina (2015). Process tracing and security studies. Security Studies, 219-
Bogen, Jim (2005). Regularities and causality; generalizations and causal explana- 227.
tions. Studies in the History and PhilosohyPhilosophy of Biological and Biomedical Van Evera, Stephan (1997). Guide to methods for students of political science. Ithaca:
Science, 36(2), 397-420. Cornell University Press.

Das könnte Ihnen auch gefallen