Beruflich Dokumente
Kultur Dokumente
DOI 10.1007/s10803-013-1814-y
ORIGINAL PAPER
Alicia Saunders
123
J Autism Dev Disord (2013) 43:26282648 2629
The use of technology to teach students with ASD is not still lacking. Computer-assisted instruction (CAI) is one
a new concept. In fact, technology has been used to teach type of instructional technology commonly used to teach
students with ASD for over 35 years (Colby 1973). Colby various skills to students with ASD. Even with this fre-
(1973) conducted one of the first studies examining the use quently used technological approach, quality studies are
of computers to teach students with ASD. Colby used a scant. For example, according to a recent review conducted
computer program consisting of various computer games by Pennington (2010) on the effects of CAI to teach aca-
organized at various levels of complexity with 17 non- demic skills to students with ASD from 1998 to 2008, there
verbal students with ASD. For example, in one game, the was a notable lack of experimental control in the CAI
child pressed a letter on the computer and simultaneously efficacy studies. Further, the author noted that the majority
heard the computer say the letter; in another game, the of studies evaluated the effects of CAI specifically on lit-
child pressed a letter (e.g., H) and then saw a horse moving eracy related skills, and suggested the need for additional
across the screen and heard the sound of horses hooves. studies in other content areas.
The purpose of the study was to increase students under- The lack of research-based literature combined with the
standing of how letters and sounds form words, and how zeal of an appealing practice has led researchers to con-
words can form expressions. Results claim that 13 of the 17 tinue to debate the promises and limitations of technology
children showed an increase in involuntary speech, for this population (Mineo et al. 2009). Some researchers
enjoyment, and motivation. Despite these promising caution that although there is some preliminary evidence
results, several limitations of the study warrant discussion. supporting technologies for skill development, one pitfall
For example, the experimental design was not mentioned; in the field of ASD is the use of mythical practices that are
information regarding the participants ages and method of not empirically based (Mineo et al. 2009). Miraculous
diagnosis was not given; and details on the length of ses- claims, such as the one presented by Zemla (2012) about
sions used or how long intervention lasted were not the use of iPads for children with ASD, should be viewed
presented. with extreme caution, especially when the available evi-
More than a decade after this study, Panyan (1984) dence was anecdotal. At best, these claims support the need
published a review on the use of computer technology for for repeated empirical study of technological interventions
children with autism. Although few systematic studies had to determine if the data support the proclamations of
been reported, Panyan reported the use of technology to miraculous interventions.
promote responsiveness, attention, performance, verbal Tincani and Boutot (2005) suggested that researchers
interactions, social skills, and interactions with peers. and practitioners in the field of ASD determine the efficacy
Further, Panyan offered that technology could be used to of technology for children with ASD and their families
capitalize on the learning characteristics of students with before embracing the practice with intensity. In the era of
ASD. Specifically, the nature of technology can (a) benefit evidence-based practices (EBP), it seems especially pru-
students with ASD due to their differences in attention and dent to examine whether or not technology can increase
motivation from typically developing peers, (b) decrease academic learning for students with ASD. Horner et al.
stereotypic behaviors, (c) provide students with consistent (2005) and Gersten et al. (2005) developed criteria to
feedback, and (d) increase language. Finally, the author evaluate individual studies as well as the overall quality of
advocated for the use of technology as it can increase a practice as evidence-based in both single-subject and
active student responses, by allow[ing] the student to be group research designs, respectively.
in control of the learning situation, rather than [being] a One argument against technology may be that the effects
passive participant (p. 381). on skill development seem to be the same whether deliv-
Speech generating devices may also encourage students ered by a computer or a teacher; however, the benefits for
with ASD to be more active participants in their learning. using technology include an increase in autonomy for the
Blischak and Schlosser (2003) examined the evidence of student as well as an additional tool for teachers to provide
speech generating devices and talking word software in one-to-one instruction (Higgins and Boone 1996). Tincani
supporting spelling for students with ASD. Authors con- and Boutot (2005) suggested that while there is mixed
clude that while there were emerging data to suggest that evidence on the effectiveness of CAI for students with
technology can support independent spelling, design limi- ASD, the following tentative conclusions can be made:
tations in the studies (e.g., pre-experimental designs) pre- (a) for students who have limited speaking and writing
vent authors from reaching definitive conclusions. skills, CAI may be a beneficial alternative for the expres-
Little has changed in the past 25 years since the initial sion of literacy skills; (b) children with ASD may prefer
review of the literature; well-controlled studies on the CAI, as it may seem like a game; and (c) CAI may be more
effect of technology (e.g., computers, interactive white cost and time effective, because the teacher can work with
boards) on academic learning for students with ASD are a greater number of students in the same amount of time.
123
2630 J Autism Dev Disord (2013) 43:26282648
Tincani and Boutot recommended that current research is found represented the comprehensive range of all pub-
warranted to investigate the use of CAI for children with lished research. Once it was determined that all of the
ASD in all content areas. Further, they offered that future studies included in previous literature reviews were inclu-
studies should explore the use of CAI to teach various ded within their search, the authors read the titles and
academic skills; student preference of CAI versus tradi- abstracts of each study screening for empirical studies that
tional instruction; and the generalization of skills from the taught academics to students with ASD. Once this initial
computer-assisted instruction to other skills and settings screening was complete, approximately 65 empirical
(Tincani and Boutot 2005). studies remained and the authors determined whether or
Clearly, a comprehensive review of studies examining not the remaining studies for analysis based on the inclu-
the effects of instructional technologies on academic skills sion criteria described below.
for students with ASD is needed. Prior reviews were lim-
ited in a number of ways. First, prior reviews did not Inclusion Criteria
evaluate both group experimental and single-subject
research studies together to determine the level of evidence Based on the inclusion criteria of (a) publishing in a peer
for the practice. Second, the reviews did not use Horner reviewed within the years of 19732012 having at least one
et al. (2005) and Gersten et al. (2005) criteria to evaluate participant with a diagnosis of ASD, (b) teaching an aca-
the quality of the literature on teaching using technology demic skill, and (c) including technology as the interven-
for students with ASD. Third, recent reviews evaluated tion or part of an intervention package, a comprehensive
specific technological interventions (e.g., CAI, speech- list of 29 single-subject and group design research studies
generated devices), rather than evaluating studies of the were retained for analysis. Authors agreement for inclu-
broad range of technologies available (e.g., interactive sion and exclusion of articles was 100 % following dis-
white boards, Personal Data Assistants; PDAs). Finally, the cussion in which individual articles were evaluated against
current review expanded the search beyond prior search inclusion criteria. These studies, including information on
results and includes more recent studies. The purpose of the each studys number of participants, dependent variables,
current comprehensive review is to evaluate the evidence- independent variables, results, implications, and limitations
base for using instructional technology to teach academic are found in Table 1. Studies were excluded if the tech-
skills to students with autism from the years 19932012. nological interventions pertained to (a) alternative assistive
communication instruction, (b) unspecified assistive tech-
nology, (c) task completion interventions, (d) video-mod-
Method eling interventions, and (e) video teleconferencing
interventions. Authors excluded these studies due to the
Literature Search Procedures prior reviews demonstrating these interventions (e.g., video
modeling) to be effective (i.e., Colby 1973; Dyches 1998)
First, authors developed a list of search terms to seek in teaching academic skills to students with ASD.
published single-subject and group design research studies
that included technology-based interventions, such as CAI Application of the Horner et al. (2005) Quality
and computer-based video interventions, which were used Indicators for Single-Case
specifically to teach (and not just deliver) academic skills
(e.g., object identification, word identification, and com- Following the establishment of a comprehensive list of
pletion of math problems) across English Language Arts studies for review, authors coded each article based on the
(ELA), mathematics, social studies, and science content (a) number of participants identified with autism or ASD,
areas for students with ASD. The list of search terms (b) type of research design used, (c) content area for the
included 17 total terms. The authors searched combinations targeted skill, (d) intervention, (e) dependent variables,
of the 17 terms using both whole and truncated versions of (f) results, and (g) limitations noted by each study as shown
each term (e.g., autism, ASD, computer, iPod, computer- in Table 1.
based video instruction, computer assisted instruction, Next, authors coded studies in accordance with estab-
academic) using Education Full Text, ERIC, Academic lished criteria for single-subject and group experimental
Search Premier, PyschINFO, and PubMed databases. This research established respectively by Horner et al. (2005)
initial search yielded more than 400 potential studies. Next, and Gersten et al. (2005) to determine if the retained arti-
the authors compared their search results with recent cles met criteria for quality. For single-subject studies, the
reviews of literature (Blischak and Schlosser 2003; Pen- authors used 20 quality indicators developed by National
nington 2010) related to using technology to teach aca- Secondary Transition Technical Assistance Centers
demic skills to students with ASD to ensure the studies (NSTTAC 2010; Test et al. 2009) decision rules (See
123
Table 1 Characteristics of technology articles
Reference Participants (total Design Content IV (include technology Instructional Components of DV Results Limitations
number of area used) IV (e.g., systematic
participants, (e.g., instruction, principles of
number of ELA, applied behavior analysis)
participants with math,
ASD, ages) science)
Basil and N=6 Quasi- ELA Self-directed CAI Differential reinforcement of Literacy acquisition Participants had gains in Major design flaws in
Reyes N(ASD) = 2 experimental including Delta reading sentence created including sentence writing, terms of failing to
(2003) (pre/post with messages and animations; stimulus Reading letters phonological synthesis demonstrate a
Ages: 8, 14 no control prompting skills, and writing skills functional relationship
group) Reading syllables
Reading words
Reading a text
J Autism Dev Disord (2013) 43:26282648
123
Table 1 continued
2632
Reference Participants (total Design Content IV (include technology Instructional Components of DV Results Limitations
number of area used) IV (e.g., systematic
123
participants, (e.g., instruction, principles of
number of ELA, applied behavior analysis)
participants with math,
ASD, ages) science)
Clark and N(ASD) = 2 Alternating ELA CAI using exclusion Reinforcement for correct Symbol identification Both participants acquired Limitations include the
Green Ages: 9, 11 treatment and delayed cue responses (food); use of a symbol identification of use of arbitrary
(2004) training delayed prompt procedure; targeted symbols more symbols, inconsistent
stimulus prompting rapidly using a delayed cue amount of exposure
between the two
interventions, and a
laboratory setting
Coleman N=3 Alternating ELA CAI with CTD CTD Cooking words Both conditions were Only one generalization
et al. (2012) N(ASD)* = 1 treatments compared to teacher- Stimulus fading (pictures effective for all students, probe, students
design directed CTD and words to words only) but 2/3 students learned distracted while on the
Age: 12 words more efficiently computer, time
* Multiple Reinforcement for correct during teacher-directed requirement to make
disabilities, behaviors condition the PowerPoint
including ASD presentations, student
absences
Coleman- N=3 Multitreatment ELA Teacher instruction Stimulus fading and response Sight word identification Students made acquired Technology was slow and
Martin et al. N(ASD) = 1 only, teacher and CAI prompting (verbal) of target words in all unreliable
(2005) (using the nonverbal phonemes; guided practice conditions
Age: 12 reading approach, (i.e., provided directions,
Power Point TM encouragement, and
software, auditory metacognitive strategy);
component), and CAI error correction, praise for
only correct answers
Heimann N = 30 Quasi- ELA CAI Very little description of Reading, sentence imitation, All students made gains in Loss of data and subjects,
et al. (1995) N(ASD) = 11 experimental Multi-media Alpha program, but article phonological awareness, all measures except small sample size,
(pre/post with environment (voice, suggests use of model verbal behavior/motivation sentence imitation based length of intervention
Ages: control prompts and feedback on t tests was different between
M = 9.4 years, animation, and
group) videos) groups
range 613
Hetzroni and N(ASD) = 6 Multiple probe ELA CAI (including a 7 step Stimulus fading; match to Matching sight words to All children acquired, Evaluated preferred food
Shalem Ages: 1013 across fading process) sample; reinforcer (smiley sample maintained and most items, not all students
(2005) participants face); error correction generalized to actual food generalized skills
resulting in a natural items
consequence (i.e., display
remains unchanged when
the student selects
incorrect answer)
Hetzroni et al. N(ASD) = 3 Multiple probe ELA CAI Reinforcement for correct Symbol identification CAI was effective in Many characteristics of
(2002) **Rett Syndrome across responses; error correction; teaching symbol Rett impacted
participants use of a delayed prompt identification assessment measures
Ages: 810 procedure (e.g., absences,
tremors)
J Autism Dev Disord (2013) 43:26282648
Table 1 continued
Reference Participants (total Design Content IV (include technology Instructional Components of DV Results Limitations
number of area used) IV (e.g., systematic
participants, (e.g., instruction, principles of
number of ELA, applied behavior analysis)
participants with math,
ASD, ages) science)
Kelly et al. N(ASD) = 1 Quasi- ELA CAI Stimulus prompting; Letter, number, and picture Poor performance during Authors provided no
(1998) Age: 5 experimental Math differential reinforcement; identification visualvisual matching, explanations for study
(pre/post with use of a delayed prompt participant scored much results directly conflict
no control procedure higher on auditory-visual with the requirements
group) matching of visual discrimination
Kinney et al. N(ASD) = 1 Quasi- ELA CAI (video) Differential reinforcement; Spelling Student acquired and No repeated baseline
(2003) Age: 8 experimental use of delayed prompt maintained knowledge measure, no procedural
J Autism Dev Disord (2013) 43:26282648
123
Table 1 continued
2634
Reference Participants (total Design Content IV (include technology Instructional Components of DV Results Limitations
number of area used) IV (e.g., systematic
123
participants, (e.g., instruction, principles of
number of ELA, applied behavior analysis)
participants with math,
ASD, ages) science)
Schlosser and N(ASD) = 4 Adapted ELA LightWRITER- Intermittent non-contingent Spelling: Percentage of Three students met criterion Study ended due to end of
Blischak Ages: 812 alternating SL35TM(SGD) praise; article suggests use correctly spelled words; for words spelled correctly school year; did not
(2004) treatments featuring text-to- of constant time delay with percentage of correct letter in the print only, speech- focus on use of words
* Replication design speech via model prompt as feedback; sequences, and number of to-print, and speech only for communication
of 1998 (alternating DECtalkTM verbal praise for correct sessions to reach criterion conditions respectively. purposes
study between synthetic speech and answers (spell all 4 words in a set Two students did not
speech only, dual liquid crystal correctly over 2 generalize to novel words,
speech-to- displays (LCDs), and consecutive sessions); and 2 students showed
print, and an instructor using generalization to novel moderate generalization to
print only the copy-cover- words novel words
conditions) compare method with
an error correction
procedure
Schlosser N(ASD) = 1 Adapted ELA LightWRITER- Intermittent non-contingent Percentage of correctly Percentage of words spelled Only1 participant, did not
et al. (1998) Age: 10 alternating SL35TM(SGD) praise; article suggests use spelled words; percentage correctly met criterion in examine phonological
treatments featuring text-to- of constant time delay with of correct letter sequences, 21 sessions for Auditory awareness (feedback
speech via model prompt as feedback; and number of sessions to condition, 26 for Auditory- was given for each
DECtalkTM verbal praise for correct reach criterion (spell all 4 Visual condition, and 31 letter of each word); no
synthetic speech and answers words in a set correctly for Visual condition; measure of
dual liquid crystal over 2 consecutive percentage of correct letter generalization
displays (LCDs), and sessions) sequences increased across
an instructor using conditions. Results
the copy-cover- maintained over time
compare method,
finger spelling, and
an error correction
procedure
Simpson and N(ASD) = 3 Multiple ELA CAI (Interactive songs Similar procedures as used in Picture identification of All students were able to Lack of a baseline probe
Keen Ages: 34 baseline using power point TM PECS (i.e., learning of animals receptively label the before intervention on
(2009) across and an interactive individual symbols are animal pictures from the the second tier of the
participants white board) taught prior to songs multiple baseline;
discrimination tasks); error students were not able
correcting using least to to generalize to other
most prompting system; settings
error correction from the
computer resulting in a
natural consequence (i.e.,
display remains unchanged
when the student selects
incorrect answer)
J Autism Dev Disord (2013) 43:26282648
Table 1 continued
Reference Participants (total Design Content IV (include technology Instructional Components of DV Results Limitations
number of area used) IV (e.g., systematic
participants, (e.g., instruction, principles of
number of ELA, applied behavior analysis)
participants with math,
ASD, ages) science)
Soares et al. N(ASD) = 1 Reversal ELA CAI and self- DRA; token economy on the Academic tasks (e.g., Student increased academic No measure of
(2009) Age: 13 monitoring computer; self-monitoring answering 5 tasks and decreased generalization across
using a token economy on comprehension questions) tantrums and self-injurious settings, academic
the computer behavior accuracy, no inter-rater
reliability on the
tantrum behavior
Sugasawara N=2 Quasi- ELA CAI (using a Differential outcome (DO) Reading 46 Hiragana Student 1 needed additional Additional prompts and/
J Autism Dev Disord (2013) 43:26282648
and N(ASD) = 1 experimental constructional procedure (i.e., provides characters (Japanese) instruction for or differential
Yamamoto (pre/post with matching-to-sample specific reinforcing maintenance; whereas, reinforcement were not
(2007) ** PDD-NOS no control [MTS] task with a stimulus after a particular student 2 met criterion recorded. Training was
Age: 4 group) differential outcome response); DO stimulus (read 100 % of characters done by students
[DI] procedure) (i.e., word repeated) and for 2 consecutive sessions) parents in the home
reinforcement (i.e., fanfare
animation) provided for all
correct answers; response
prompting; auditory
feedback for error
correction (i.e., beep) and a
natural consequence (i.e.,
display remains unchanged
when the student selects
incorrect answer)
Tanji and N(ASD) = 2 Quasi- ELA CAI (Constructed- Matrix training using a Generative spelling of Both students showed One student required an
Noro (2011) experimental Response Matching visual stimulus (speaker); dictated trained and generative spelling to additional training
(pre/post with to Sample Task; feedback on correct untrained, novel words, trained and untrained session to yield
no control CRMTS) responses; multiple and writing of novel words words. generative spelling
group) exemplar training for one (Japanese characters)
student
Tjus et al. N = 20 Quasi- ELA CAI; multimedia Alpha Differential reinforcement; Childrens behavior: Verbal expression Data loss of 2 students
(2001) N(ASD) = 11 experimental program (Nelson and feedback; stimulus complies, ignores, off-task, significantly increased in with mixed intellectual
(pre/post with Prinz 1991) with prompting seeks help, verbal all children; and for disabilities. Sample
Ages: M = 6.9, control different modes of expressions, protests, students with autism in the size too small for
range 615 group) feedback (voice, enjoyment; Teacher categories of verbal within group
animation, video and behavior: procedure expression, seeks help, and comparisons.
sign language) along comments, content enjoyment. Off-task Nonverbal interaction
with supportive comments, verbal behavior was significantly was not measured
teacher recasts directives, physical higher for students with
directives, adjustment, autism
recasts, praises, enjoyment
2635
123
Table 1 continued
2636
Reference Participants (total Design Content IV (include technology Instructional Components of DV Results Limitations
number of area used) IV (e.g., systematic
123
participants, (e.g., instruction, principles of
number of ELA, applied behavior analysis)
participants with math,
ASD, ages) science)
Whalen et al. N(ASD) = 47 Experimental ELA CAI Differential reinforcement; Math: shapes, numbers, most Students in the intervention Limitations include no
(2010) Ages: 36 (group) Math stimulus prompting; and fewest concepts, group scored statistically data collected on part
multiple exemplars; numeral-quantity significantly higher in post of the intervention
pivotal response training matching, math symbols, test scores in the areas of which required teachers
addition, subtraction, receptive language, social to incorporate 20 min
number lines, fractions; understanding, life skills, of off computer
ELA: matching letters, and cognitive academics activities and issues in
letter ID, phonics, word versus student in the teacher fidelity
matching, upper and lower control group implementing the IV
case, letter matching,
initial and ending sounds
ID, book awareness,
rhyming, sight words,
spelling
Whitcomb N(ASD) = 1 Multiple ELA CAI (Headsprout) Visual cues and auditory Percent reading accuracy Student achieved mastery Increasing baselines;
et al. (2011) Age: 9 baseline cues, verbal praise (words read correctly) in ([80 % in 1 day) in both Lack of enough data in
across word word sets and short stories word sets and short stories tiers 24 to show
sets verification; no
maintenance data
collected
Yamamoto N(ASD) = 3 Quasi- ELA CAI NCR for motivation; Verbally production of a All students were able to No measure of
and Miya Ages: 610 experimental reinforcer for completing sentence and construction generalize trained generalization; no
(1999) (pre/post with session (small prize); of a sentence on the sentences to untrained procedural fidelity
Study I no control differential reinforcement computer sentences, but were not collected
group) and error correction during able to generalize the use
the intervention of particles (i.e., in
Japanese, used to specify
the object and subject of
nouns) in the sentences
Yamamoto N(ASD) = 3 Quasi- ELA CAI Verbal production of All students learned to Mortality of one
and Miya Ages: 610 experimental sentences including verbally produce sentences participant; no
(1999) (pre/post with particles including particles; 2 of procedural fidelity
Study II no control the 3 students learned to collected
group) generalize to written
sentences
J Autism Dev Disord (2013) 43:26282648
Table 2 QIs identified in group and/or quasi experimental design studies
Basil and Bosseler and Heimann Kelly Kinney Moore Sugasawara Tanji Tjus Whalen Yamamoto Yamamoto
Reyes Massaro et al. et al. et al. and and and et al. et al. and Miya and Miya
(2003) (2003) Study 1 (1995) (1998) (2003) Calvert Yamamoto Noro (2001) (2010) (1999) Study 1 (1999) Study 2
(2000) (2007) (2011)
Clearly described Y Y Y Y Y Y Y Y Y Y Y Y
Fidelity of implementation Y N Y Y Y N N N N N N N
described
Comparison condition Y N Y Y Y Y N N Y N N N
described
DV
Multiple measures used Y Y Y Y Y Y N Y N Y N N
Outcomes measured at N Y Y N Y Y Y Y Y Y Y Y
appropriate times
Results
Appropriate data analysis Y Y N Y Y Y Y Y Y Y N N
techniques chosen
Effect size reported Y N Y Y Y N N N Y Y N N
Desirable quality indicators
Participants
Attrition rate \ 30 % N Y N N N Y Y Y Y Y N N
DV
Evidence of testretest N N Y N N Y Y N Y N N N
reliability, internal
consistency reliability, and
IRR
Adequate IOA score Y N N Y Y Y N N N N Y Y
Data collectors blind to study Y N N N Y N N N N N N N
conditions and unfamiliar
with participants
Outcomes measured beyond N Y Y N N Y N Y Y N N Y
immediate posttest
Criterion and construct Y Y Y N Y N N N N Y N N
validity provided
2637
123
2638 J Autism Dev Disord (2013) 43:26282648
6/20
variable and measures, (d) independent variable/interven-
Y
tion, (e) baseline procedures, (f) results, and (g) social
validity.
Yamamoto
5/20
was also used to determine the level of quality for each
N
Y
study based on the studys description of (a) participants,
Whalen
11/20
et al.
10/20
Tanji
Noro
and
Yamamoto
8/20
and
13/20
15/20
et al.
9/20
14/20
et al.
ization measures).
(2003)
Reyes
10/20
included
coherent
123
J Autism Dev Disord (2013) 43:26282648 2639
(13) The procedural characteristics of the baseline conditions were described with replicable
precision.
Results/ Graphs/ Design
(14) The design provides at least three demonstrations of experimental effect at different
points in time.
(15) The design controls for common threats to internal validity (e.g., permits elimination of
rival hypotheses).
(16) Experimental effects were replicated across participants, settings, or materials to
establish external validity.
Social Validity [must of have 1 of these 4 for acceptable quality]
(17) The dependent variable is socially important.
(18) The magnitude of change in the dependent variables resulting from the intervention is
measured as socially important.
(19) Implementation of the independent variable was described by author as practical and
cost effective.
(20) Social validity is enhanced by implementation of the independent variable over extended
time periods, by typical intervention agents, in typical physical and social contexts.
123
2640 J Autism Dev Disord (2013) 43:26282648
Fig. 2 Coding form for group design research. Source NSTTAC (2010)
123
J Autism Dev Disord (2013) 43:26282648 2641
least three geographic locations represented in the set of experimental pretest/posttest design with no control group,
experiments. Gersten et al. criteria for demonstrating an and 17 studies used single-subject designs (i.e., five mul-
evidence-based practice consists of two high quality or four tiple probe or multiple baseline designs, seven alternating
acceptable quality studies thats results support the practice treatment designs, one multitreatment design, and one
or intervention. According to Gersten et al. criteria, a reversal design). All 29 studies focused on the content area
practice can also be determined a promising practice if two of English-Language Arts, and three of the 29 studies
or more high quality or four or more acceptable quality included a math component (i.e., Chen and Bernard-Opitz
studies have results that support the practice and the 1993; Kelly et al. 1998, and Whalen et al. 2010). No
authors report a 20 % confidence interval for a weighted studies focused on the content areas of science or social
effect size greater than zero. studies. Training settings included participants homes,
school, and clinical settings.
Interrater Reliability on Quality Indicators
and Characteristics of Studies Components of CAI
Of the 29 studies interrater reliability data were collected The articles were examined to determine the specific
across 34 % of studies (n = 10 studies) using the same instructional strategies (e.g., principles of Applied Behavior
coding criteria used to originally code the studies. The 10 Analysis, systematic instructional strategies, etc.) that were
studies were chosen randomly by two doctoral students included in the computer programs. One study used simul-
who served as the second scorers and independently coded taneous prompting (e.g., Pennington et al. 2012). Ten studies
the studies. used some type of differential reinforcement (e.g., Basil and
Reyes 2003; Kelly et al. 1998; Kinney et al. 2003; Mechling
et al. 2002). Fifteen studies used an error correction and
Results feedback procedure (e.g., Bosseler and Massaro 2003;
Coleman-Martin et al. 2005; Heimann et al. 1995; Hetzroni
Interrater Reliability and Shalem 2005; Pennington et al. 2012). Five studies used
a delayed prompting procedure (Clark and Green 2004;
Agreement for inclusion of the studies was done by con- Hetzroni et al. 2002; Kelly et al. 1998; Kinney et al. 2003;
sensus of the three researchers, and no disagreements Reagon et al. 2007). Fifteen studies used stimulus prompting
occurred. The three researchers coded two articles together, and/or stimulus fading (e.g., Chen and Bernard-Opitz 1993;
one single-subject and one group design, to establish Coleman et al. 2012; Sugasawara and Yamamoto 2007; Tjus
fidelity and ensure consistency before coding articles et al. 2001; Whalen et al. 2010; Whitcomb et al. 2011). Four
independently. Interrater reliability for the coding of the studies used response prompting procedures (Coleman-
quality indicators was established for 34 % of the studies Martin et al. 2005; Massaro and Bosseler 2006; Moore and
included. Interrater reliability was determined using an Calvert 2000; Sugasawara and Yamamoto 2007). Eleven
item-by-item method and was calculated by dividing the studies offered some type of reinforcement for correct
number of agreements by the total number of agreements responses (e.g., Bosseler and Massaro 2003; Clark and Green
plus disagreements divided by 100 (Cooper et al. 2007). 2004; Coleman et al. 2012; Sugasawara and Yamamoto
Interrater reliability was 99.3 % (range 95100). 2007; Tanji and Noro 2011; Whitcomb et al. 2011;
Yamamoto and Miya 1999). Three studies used specific
Description of the Studies Included methods to train for generalization (Bosseler and Massaro,
study 2, 2003; Mechling et al. 2002; Whalen et al. 2010). One
Twenty-nine studies, which met the inclusion criteria, were study did not describe any component of the CAI interven-
included in this literature review with a total of 191 par- tion (Chen et al. 2009).
ticipants, and of those, 142 had a diagnosis of Autism
Spectrum Disorder (e.g., autism, PDD-NOS, Rett Syn- Quality of the Studies
drome). The mean age of participants was 8.4 years (range
318 years). Of the studies that included gender specific No group experimental studies (e.g., true, quasi, between,
information (n = 100 participants total), 22 were female, within, or mixed) were of acceptable or high quality based
M(age) = 9.5, range 317 years, and 78 were male, on the NSTTAC (2010) criteria. Therefore, there was not
M(age) = 8.1, range 318 years. enough evidence to determine technology-based interven-
All studies are summarized in Table 1. One study used a tions including CAI as an evidence-based practice. See
true, group experimental design, three studies used a quasi- Table 2 for the Quality Indicator Checklist for all group
experimental group design, eight studies used a quasi- experimental studies.
123
Table 3 QIs identified in single-subject studies
2642
Bosseler Chen Chen Clark Coleman Coleman- Hetzroni Hetzroni Massaro Mechling Pennington Reagon Schlosser Schlosser Simpson Soares Whitcomb
and et al. and and et al. Martin et al. and and et al. et al. (2012) et al. and et al. and Keen et al. et al.
123
Massaro (2009) Bernard- Green (2012) et al. (2002) Shalem Bosseler (2002) (2007) Blischak (1998) (2009) (2009) (2011)
(2003) Opitz (2004) (2005) (2005) (2006) (2004)
Study 2 (1993)
Participants
Described Y Y Y Y Y Y Y Y Y Y Y Y Y Y Y Y Y
sufficiently
Selection Y Y N N Y Y Y Y Y Y Y N Y N Y Y N
described
Setting
Setting described N N Y N Y Y Y Y N Y Y Y Y Y Y Y N
DV
Described with Y Y N Y Y Y Y Y Y Y Y Y Y Y Y Y Y
replicable
precision
Quantifiable Y Y Y Y Y Y Y Y Y Y Y Y Y Y Y Y Y
Measurement Y N N Y Y Y Y Y Y Y Y Y Y Y Y Y Y
described with
replicable
precision
Measurement Y Y Y Y Y Y Y Y N Y Y Y Y Y Y Y Y
occurred
repeatedly
IOA data reported N N Y N Y Y Y Y N Y Y Y Y Y N Y Y
IV
Described with Y Y N Y Y Y Y Y Y Y Y Y Y Y Y Y Y
replicable
precision
Systematically Y Y Y Y Y Y Y Y Y Y Y Y N Y Y Y Y
manipulated
PF described N N N N Y Y N Y N Y Y N Y Y N N Y
Baseline procedures
Repeated Y N N Y Y Y Y Y N Y Y N Y Y Y Y Y
measurement
and evidence of
pattern
Described with Y N N Y Y Y Y Y N Y Y N Y Y Y Y Y
replicable
precision
J Autism Dev Disord (2013) 43:26282648
Table 3 continued
Bosseler Chen Chen Clark Coleman Coleman- Hetzroni Hetzroni Massaro Mechling Pennington Reagon Schlosser Schlosser Simpson Soares Whitcomb
and et al. and and et al. Martin et al. and and et al. et al. (2012) et al. and et al. and Keen et al. et al.
Massaro (2009) Bernard- Green (2012) et al. (2002) Shalem Bosseler (2002) (2007) Blischak (1998) (2009) (2009) (2011)
(2003) Opitz (2004) (2005) (2005) (2006) (2004)
Study 2 (1993)
Results/graphs/design
Three Y N N N N N Y Y N Y Y N N N Y Y N
demonstrations
of effect
Internal validity Y Y Y Y Y N Y Y N Y Y Y Y Y Y Y N
External validity Y N N N Y Y Y Y N Y Y N Y N Y N Y
J Autism Dev Disord (2013) 43:26282648
Social validity
DV socially Y N Y N Y Y Y Y Y Y Y N Y Y Y Y Y
important
Change in DV Y N N N Y Y Y Y N Y N N N N Y N N
measured as
socially
important
IV is cost N N N N N Y N N N N N N N N Y Y N
effective/
practical
Implemented over N N Y N Y Y N Y N Y N N N Y N Y Y
time, in typical
contexts, or with
typical agents
Total indicators 15/20 8/20 9/20 10/20 18/20 18/20 17/20* 19/20 * 8/20 19/20* 17/20 * 10/20 16/20 15/20 17/20 17/20 14/20
met
123
2644 J Autism Dev Disord (2013) 43:26282648
No single-subject design studies were of high quality; indicates a low level of evidence for using technology-
however, four studies were of acceptable quality in based interventions to teach academics to individuals with
accordance with the NSTTAC criteria (2010; Hetzroni ASD. Overall, these results taken together suggest that
et al. 2002; Hetzroni and Shalem 2005; Mechling et al. technology-based interventions for teaching academic
2002; Pennington et al. 2012). See Table 3 for the Quality skills to students with ASD should be used with caution.
Indicator Checklist for all single-subject studies.
Of the studies that met the acceptable criteria, two Implications for Practitioners
(Hetzroni and Shalem 2005; Mechling et al. 2002) met 19
out of 20 possible quality indicators (QIs), but neither study Even though students performance data demonstrated
reported if the intervention was practical or cost effective, gains in almost all of the studies, considering the low to
and thus, did not meet one of the social validity QIs. Two moderate level of evidence, the use of technology to teach
studies (Hetzroni et al. 2002; Pennington et al. 2012) met academics should be used with caution until additional
17 out of 20 QIs but were missing a procedural fidelity quality research is added to the research base. Media
measure and two social validity measures. According to the claims regarding miracle outcomes as a result of using the
NSTTAC criteria (2010; Test et al. 2009), three acceptable latest gadgets should not replace the use of an EBP. This is
quality single-subject studies that demonstrate a functional not to suggest that all technologies for teaching academics
relationship from two different research teams indicate a be abandoned, but rather used in conjunction with practices
moderate level of evidence for considering CAI as an EBP that are known to be effective. In most of the studies,
for teaching academics to students with autism. technology was combined with or embedded within other
Four of the 17 single-subject studies (24 %) met research-based, systematic instructional procedures (e.g.,
acceptable quality. Eight studies did not demonstrate a time delay). The four studies that met acceptable criteria
functional relationship (Chen et al. 2009; Chen and Ber- for quality used systematic instructional procedures such as
nard-Opitz 1993; Clark and Green 2004; Coleman et al. reinforcement for correct responses, stimulus fading, sys-
2012; Coleman-Martin et al. 2005; Massaro and Bosseler tem of least prompts, and error correction. In fact, many of
2006; Schlosser and Blischak 2004; Schlosser et al. 1998). the studies reviewed used error correction and feedback.
Several studies met 14 or more QIs, but were missing key For example, in the Pennington et al. (2012) study, using
indicators necessary to be considered of acceptable quality simultaneous prompting to teach computer-based writing,
(i.e., studies must meet all QIs with the exception of 2 if the student did not select the correct word after the
[selection of participants described], 11 [procedural fidelity teacher said, Write a story about ______, then the tea-
described], and one of 1720 [social validity] to be con- cher erased the incorrect word and used a physical prompt
sidered acceptable). Of these studies, two studies did not to guide the mouse to the correct word. Practitioners should
report interobserver agreement data (Bosseler and Massaro combine the use of technologies with systematic instruc-
2003, study 2; Simpson and Keen 2009), and one did not tion considered to be an EBP for teaching academics to
show replication of effects across participants, settings, or students with severe disabilities, including ASD (Spooner
materials to establish external validity (Soares et al. 2009). et al. 2011).
Despite the overall lack of evidence supporting the use
of technology to teach academics to students with ASD, the
Discussion four acceptable studies did have some similarities worth
mentioning that teachers can use to guide practice. First,
The purpose of this comprehensive literature review was to because all of the acceptable studies taught skills in the
determine the evidence-base for using instructional tech- area of ELA, practitioners should feel more confident
nology to teach academic skills to students with autism presenting instruction via technology in this content area
from the years 1993 to 2012. Results of the current review versus mathematics, science, and social studies. Second,
indicate only four acceptable quality single-subject technology can be used to teach discrete skills such as
studies that demonstrated a functional relation from three words and symbol identification; current evidence of its
different research teams. According to the NSTTAC (2010) effect on teaching more complex or chained skills is ten-
criteria for single-subject research studies, these findings uous. Third, some type of error correction and reinforce-
suggest a moderate level of evidence for considering ment should be built in to the software for maximum
technology as an EBP to teach academics to students with benefit. This recommendation is consistent with other
autism. In addition, no group experimental studies (e.g., researchers in the field. Higgins and Boone (1996) suggest
true, quasi, between, within, or mixed) were of acceptable error correction to be considered an essential component
or high quality based on the NSTTAC criteria. Based on when designing or evaluating existing technology-based
the NSTTAC criteria for group design studies, this interventions. In some of the studies reviewed, smiley faces
123
J Autism Dev Disord (2013) 43:26282648 2645
or animations were built into the software as reinforcement applications) on academic skills, most studies found in the
(e.g., Basil and Reyes 2003; Bosseler and Massaro 2003), literature review used CAI. Authors did not find studies
and in other cases, food, verbal praise and tangible rewards that used portable devices, and only one study was found
were used for reinforcement (e.g., Clark and Green 2004; that used an interactive whiteboard. In contrast to a recent
Massaro and Bosseler 2006; Moore and Calvert 2000). review conducted by Mechling (2011) supporting the use
In addition to using technology-based interventions of handheld electronic devices (e.g., PDAs, ipods) for
along with empirically sound instructional practices, the increasing functional multi-step skills, transitioning
interventions should also be evaluated on an individual between tasks and environments, and time and task man-
basis for their benefits. If an individual education planning agement, the lack of studies using these technologies in the
(IEP) team decides that a technology-based intervention is current review prevents recommendations for or against
the best approach for teaching academics to a particular such technologies at this time.
student, then progress in the academic area should be
monitored before, during, and after the technology-based Suggestions for Future Research from Findings
intervention. The IEP team should carefully evaluate the
efficacy and efficiency of the intervention, and modify or There are a number of suggestions for future research that
change it if it is ineffective or the student is progressing too can be derived based on the moderate degree of evidence
slowly. from the single-subject studies and the low degree of evi-
dence from the group experimental studies for using
Limitations of the Studies technology-based interventions to teach academics. In
general, the results of the current review support the find-
The limitations of the group experimental and single-sub- ings from other reviews calling for additional studies with
ject studies accounted for the minimal degree of evidence sound research designs that are of high quality (e.g.,
for which to recommend technology-based interventions. Pennington 2010). The dearth of quality studies makes the
First, three quasi-experimental group designs did not have opportunities for research almost unlimited. For example,
enough participants in each group to be considered true researchers should replicate the interventions found in the
group designs (Heimann et al. 1995; Moore and Calvert current review using the Horner et al. (2005) or Gersten
2000; Tjus et al. 2001). Second, several single-subject et al. (2005) criteria as guidelines. Further, although studies
studies did not demonstrate functional relations, and thus, are needed in all content areas, investigations are especially
could not be evaluated for the level of evidence needed to scarce in content areas other than ELA, such as mathe-
establish an EBP (Chen et al. 2009; Chen and Bernard- matics, science, and social studies. Quality studies that
Opitz 1993; Clark and Green 2004; Coleman-Martin et al. teach complex academic skills (e.g., problem solving in
2005; Massaro and Bosseler 2006; Schlosser and Blischak mathematics; sentence creation) are also lacking. Future
2004; Schlosser et al. 1998). Third, several single-subject research should address the lack of procedural fidelity data
studies did not meet the essential quality indicators because and social validity quality indicators in the studies
they were lacking setting descriptions, procedural fidelity reviewed.
data, interrater reliability data, and social validity. The Finally, there is a critical need for research on the
limitations to the studies should be considered in light of technologies lacking in the current review (e.g., iPads,
the fact that many studies were published prior to 2005 iPods, cell phones as described in the Mechling 2011
when the Gersten et al. and Horner et al. criteria for high review) for academic skills. The recommendation for
quality research in group experimental designs and single- future research across a wide range of technologies,
subject designs, respectively, were published in Excep- including newer electronic systems that use the principles
tional Children. The authors of the studies conducted prior of universal design to determine their efficacy for indi-
to 2005 did not have published guidelines for conducting viduals with disabilities from Wehmeyer et al. (2008), is
quality research, which may have affected decisions on also applicable to the current review. Although there is a
whether or not to include information related to procedural clear need for effective interventions in the field of ASD,
fidelity data, interrater reliability data, and social validity in it is also important that emphasis of EBP does not prevent
the final draft of their manuscripts. As such, studies con- the use, evaluation, and development of innovative tech-
ducted after the publication in Exceptional Children in nological advances. Technological tools have the capacity
2005 might adhere more closely to the quality guidelines to offer a wealth of benefits for individuals with ASD in
set forth by the Gersten et al. and Horner et al. Finally, learning academic content. For example, Wehmeyer et al.
although the authors sought to determine the effects of the (2008) reported handheld electronic devices to be a sim-
broad range of technologies available (e.g., interactive ple and effective way to prompt individuals with dis-
white boards, Personal Data Assistants; PDAs, iOS abilities. The authors suggested that these devices are
123
2646 J Autism Dev Disord (2013) 43:26282648
123
J Autism Dev Disord (2013) 43:26282648 2647
*Hetzroni, O., Rubin, C., & Konkol, O. (2002). The use of assistive writing to a student with autism. Education and Treatment of
technology for symbol identification by children with Rett Children, 35, 389406.
syndrome. Journal of Intellectual and Developmental Disability, *Reagon, K., Higbee, T., & Endicott, K. (2007). Using video
27, 5771. instruction procedures with and without embedded text to teach
*Hetzroni, O. E., & Shalem, U. (2005). From logos to orthographic object labeling to preschoolers with autism: A preliminary
symbols: A multilevel fading computer program for teaching investigation. Journal of Special Education Technology, 22(1),
nonverbal children with autism. Focus on Autism and Other 1320.
Developmental Disabilities, 20, 201212. *Schlosser, R. W., & Blischak, D. M. (2004). Effects of speech and
Higgins, K., & Boone, R. (1996). Creating individualized computer- print feedback on spelling by children with autism. Journal of
assisted instruction for students with autism using multimedia Speech, Language, and Hearing Research, 47, 848862.
authoring software. Focus on Autism and Other Developmental *Schlosser, R. W., Blischak, D. M., Belfiore, P. J., Bartley, C., &
Disabilities, 11, 6978. Barnett, N. (1998). Effects of synthetic speech output and
Horner, R. H., Carr, E. G., Halle, J., McGee, G., Odom, S., & Wolery, orthographic feedback on spelling in a student with autism: A
M. (2005). The use of single-subject research to identify preliminary study. Journal of Autism and Developmental Disor-
evidence-based practice in special education. Exceptional Chil- ders, 28, 309319.
dren, 71, 165178. Simpson, R. L. (2005). Evidence-based practices and students with
*Kelly, S., Green, G., & Sidman, M. (1998). Visual identity matching autism spectrum disorders. Focus on Autism & Other Develop-
and auditory-visual matching: A procedural note. Journal of mental Disabilities, 20, 140149.
Applied Behavior Analysis, 31, 237243. *Simpson, K., & Keen, D. (2009). Teaching young children with
*Kinney, E. M., Vedora, J., & Stromer, R. (2003). Computer- autism graphic symbols embedded within an interactive song.
presented video models to teach generative spelling to a child Journal of Developmental and Physical Disabilities, 22,
with an autism spectrum disorder. Journal of Positive Behavior 165177.
Interventions, 5(1), 2229. *Soares, D. A., Vannest, J., & Harrison, J. (2009). Computer-aided
Lefever-Davis, S., & Pearman, C. (2005). Early readers and electronic self-monitoring to increase academic production and reduce self-
texts: CD-ROM Storybook features that influence reading injurious behavior in a child with autism. Behavioral Interven-
behaviors. Reading Teacher, 58, 446454. tions, 24, 171183.
Leu, D. J., Jr. (2002). Internet workshop: Making time for literacy. Spooner, F., Knight, V., Browder, D., & Smith, B. (2011). Evidence-
Reading Teacher, 55, 466472. based practices for teaching academic skills to students with severe
*Massaro, D. W., & Bosseler, A. (2006). Read my lips: The developmental disabilities. Remedial and Special Education.
importance of the face in a computer-animated tutor for Advance online publication. doi:10.1177/0741932511421634.
vocabulary learning by children with autism. Autism, 10, *Sugasawara, H., & Yamamoto, J. (2007). Computer-based teaching
495510. of word construction and reading in two students with develop-
Mechling, L. C. (2011). Review of twenty-first century portable mental disabilities. Behavioral Interventions, 22, 263277.
electronic devices for persons with moderate intellectual disabil- *Tanji, T., & Noro, F. (2011). Matrix training for generative spelling
ities and autism spectrum disorders. Education and Training in in children with autism spectrum disorder. Behavioral Interven-
Autism and Developmental Disabilities, 46, 479498. tions, 26, 326339.
Mechling, L. C., Gast, D. L., & Langone, I. (2002). Computer-based Test, D. W., Fowler, C. H., Richter, S. M., White, J., Mazzotti, V.,
video instruction to teach persons with moderate intellectual Walker, A. R., et al. (2009). Evidence-based practice in
disabilities to read grocery aisle signs and locate items. Journal secondary transition. Career Development for Exceptional
of Special Education, 35, 224240. Individuals, 32, 115128. doi:10.1177/0885728809336859.
Mineo, B. A., Ziegler, W., Gill, S., & Salkin, D. (2009). Engagement Tincani, M., & Boutot, E. A. (2005). Technology and autism: Current
with electronic screen media among students with autism practices and future directions. In D. Edyburn, K. Higgins, & R.
spectrum disorders. Journal of Autism and Developmental Boone (Eds.), Handbook of special education technology research
Disorders, 39, 172187. and practice. Whitefish Bay, WI: Knowledge by Design.
*Moore, M., & Calvert, S. (2000). Brief report: Vocabulary *Tjus, T., Heimann, M., & Nelson, K. E. (2001). Interaction patterns
acquisition for children with autism: Teacher or computer between children and their teachers when using a specific
instruction. Journal of Autism and Developmental Disorders, 30, multimedia and communication strategy: Observations from
359362. children with autism and mixed intellectual disabilities. Autism:
National Center on Educational Statistics. (2001). Computer and The International Journal of Research and Practice, 5, 175187.
internet use by children and adolescents in 2001. Washington, Wehmeyer, M. L., Palmer, S. B., Smith, S. J., Davies, D. K., & Stock,
DC: U.S. Department of Education. S. (2008). The efficacy of technology use by people with
National Secondary Transition Technical Assistance Center intellectual disability: A single-subject design meta-analysis.
(NSTTAC). (2010). Decision rules. Retrieved from: http://www. Journal of Special Education Technology, 23(3), 2130.
nsttac.org/ebp/LiteratureReview.aspx. Wehmeyer, M. L., Smith, S. J., Palmer, S. B., & Davies, D. K. (2004).
Nelson, K. E., & Prinz, P. M. (1991). Alpha interactive language Technology use by students with intellectual disabilities: An
series/gator super sentences (computer software). Warriors overview. Journal of Special Education Technology, 19(4),
Mark, PA: Super Impact Images. 722.
Panyan, M. V. (1984). Computer technology for Autistic Students. *Whalen, C., Moss, D., Ilan, A. B., Vaupel, M., Fielding, P.,
Journal of Autism and Developmental Disorders, 14, 375382. Macdonald, K., et al. (2010). Efficacy of TeachTown: Basics of
Pennington, R. C. (2010). Computer-assisted instruction for teaching computer-assisted intervention for the intensive comprehensive
academic skills to students with autism spectrum disorders: A autism program in Los Angeles Unified School District. Autism,
review of literature. Focus on Autism and Other Developmental 14, 179197.
Disabilities. Advance online publication. doi:10.1177/10883576 *Whitcomb, S. A., Bass, J. D., & Luiselli, J. K. (2011). Effects of a
10378291. computer-based early reading program (Headsprout) on word
*Pennington, R. C., Stenoff, D. M., Gibson, J., & Ballou, K. (2012). list and text reading skills in a student with autism. Journal of
Using simultaneous prompting to teach computer-based story Developmental and Physical Disabilities, 23, 491499.
123
2648 J Autism Dev Disord (2013) 43:26282648
*Yamamoto, J., & Miya, T. (1999). Acquisition and transfer of Zemla, J. (2012). 5 Great iPad apps for children with autism. Yahoo
sentence construction in Autistic Students: Analysis by com- voices. Retrieved from http://voices.yahoo.com/5-great-ipad-apps-
puter-based teaching. Research in Developmental Disabilities, children-8893899.html.
20, 355377.
123
Copyright of Journal of Autism & Developmental Disorders is the property of Springer
Science & Business Media B.V. and its content may not be copied or emailed to multiple sites
or posted to a listserv without the copyright holder's express written permission. However,
users may print, download, or email articles for individual use.