Sie sind auf Seite 1von 13

RESEARCH

Assessment and Instruction of Oral Reading Fluency


Among Adults With Low Literacy
Daryl Mellard, Kari Woods, and Emily Fall
University of Kansas

implicated in the problem (AUington, 1983; Fuchs, Fuchs,


ABSTRACT Hosp, 6 Jenkins, 2001; NICHD, 2000; Rasinski, 2006).
We statistically examined the oral reading fluency of 295 adults
Therefore, we explored how we might better understand
with low literacy by analyzing total words read per minute and
word error rates. We identified four fluency-ability groupings based adult oral reading fluency (ORF) and its implications
on standardized assessments of reading-related skills (phonemic for adult reading-literacy assessment and instructional
awareness, word recognition, vocabulary, comprehension, and general planning.
ability). Our results suggest that adults who read at comparable
correct word rates vary significantly in total words read and word
error rates. Tliese differences were independent of assessed general BACKGROUND
ability level. Thus, total words read per minute and word error rates Fluency is commonly defined as the ability to read text with
offer a picture of learner reading ability that can help instructors
speed, accuracy, and proper expression (NICHD, 2000).
target instruction toward weak reading-related skills.
Because most readers spend far more time reading silently,
ORF has historically received less attention in the classroom
INTRODUCTION than other components of reading, such as decoding,
Ninety-three million adults inl the United States (43%) vocabulary, and comprehension skills and strategies
read at or below a basic level, and one third of these (AUington, 1983; Fuchs et al., 2001; Pikulski C Chard, 2005;
individuals lack even the most simple, concrete literacy Rasinski & Zuteil, 1996). The importance of ORF is found
skills (Kutner, Greenberg, Jin, Boyle, Hsu, 8C Dunleavy, not in itself but in its usefiilness as an indicator of silent
2007). Why, after decades of educational research and reading fluency and in its significant correlation with reading
advancements in instructional practices, do so many adults comprehension or competence (Calfee & Piontkowski,
lack literacy proficiency? Limited understanding of adults' 1981; Fuchs et al., 2001; Herman, 1985; Pinnell et al.,
reading abilities and specific instructional models accounts 1995; Stanovich, 1986). Harris and Hodges (1995)
expanded the definition of fluency to "freedom from word
for some of the difficulties (Kruidenier, 2002; National
identification problems that might hinder comprehension"
Center for Family Literacy, 205; National Institute of
(p. 85). Similarly, Wolf and Katzir-Cohen (2001) described
Child Health and Human development [NICHD],
fluent readers as those who demonstrate "a level of accuracy
2000). However, instructional neglect of fluency is also

Daryl Mellard is associate research professor and director of the Division of Adult Studies, Kari Woods is program assistant, and Emily Fait is a graduate research
assistanc at the Center for Research on Learning t the University of Kansas.
Tliis paper reports findings from a study funded by the National Institute of Child Health and Human Development, the National Institute for Literacy, and the U.S.
Department of Education Office of Vocational and Adult Education (Award # RO 1 HD43775).

Adult Basic Education and Literacy Journal Volume 5, Number 1, Spring 2011
Mellard, Woods, and Fall

and rate where decoding is relatively effortless; where oral rate (e.g., DIBELS) (Good C Kaminski, 2002; Hashrouck &
reading is smooth and accurate with correct prosody; and Tindal, 1992). Research generally supports the notion that
where attention can he allocated to comprehension" (p, 218). distinguishing between high- and low-proficiency readers on
Harris and Sipay (1990) described two types of the basis of correct words rate is hetter than making such
readers who lack fluency: print-hound readers and context distinctions on the hasis of in-context word recognition
readers. Print-bound readers read slowly, tend to pause errors (e.g., Frederiksen, 1981; Fuchs et al., 2001).
after every word, and ignore or misinterpret punctuation. Systems of informal ORF assessment (e.g., informal
As word-hy-word readers, they may demonstrate accuracy reading inventories, miscue analyses, pausing indices, running
when reading word lists, yet their slow pace can diminish records) address instructors' need for more information
understanding and recall of connected words in sentences that they can use to make instructional decisions. Such
or paragraphs (Sundhye, 2001). The limited capacity assessments don't just measure correct word rates; they
theory of reading (Lesgold 8 Perfetti, 1978; Perfetti, also classify and analyze types of word and prosody errors
1985) suggests such inefficient word recognition processes (mispronunciation, suhstitution, addition, omission,
"drain cognitive resources...needed for integrating and repetition). Information from informal assessments can
constructing meaning from text" (Jenkins, Fuchs, van den point instructors in productive instructional directions, hut
Broek, Espin, & Deno, 2003, p. 237), thus contributing to the assessments require much examiner time and diagnostic
a lack of fluency and poor reading comprehension. activity. Furthermore, informal assessments do not compare
Context readers (Harris C Sipay, 1990) tend to individual readers with normative levels for age and grade
read with speed and prosody hut with inaccurate word levels to evaluate reading proficiency.
recognition, skipping, adding, or substituting words and The National Assessment of Adult Literacy (NA AL)
sometimes inventing new stories that hear little resemhiance (Baer, Kutner, & Sahatini, 2009) bases fluency descriptions
to the text. They often score hetter on measures of silent on a hattery of oral assessments of speed and accuracy in
reading than on oral reading, particularly when tasked with digit and letter naming, word reading, decoding, and passage
flnding general meaning as opposed to recalling details. reading (words correct). However, the data is used to
The National Assessment of Education Progress's special descrihe (a) variations among reading skills across different
study of oral reading (Daane, Camphell, Grigg, Goodman, population groups and (h) the relationship between these
& Oranje, 2005) reported that if word errors did not change basic reading skills and prose literacy abilities, rather than
the meaning, comprehension was maintained; however, as to plan or evaluate instruction.
errors accumulated, meaning was lost. Other researchers Assessing fluency hy correct word rate alone may he
have found that word recognition ability accounts for too limited for instructional planning, while administering a
nearly all the reliahle variance in reading ability (Hoover & battery or diagnostic assessment may require more resources
Gough, 1990; Vadasy, Sanders, & Peyton, 2005). than necessary. We suggest an alternate approach: Literacy
Based on these views, we speculated that readers' ORF instructors may be able to plan instruction efficiently and
might best be described by total word and word error effectively using just total words read and word error rates.
rates, and that such descriptions could he used to identify
instructional frameworks that might improve reading Instruction in Fluency
proflciency. Instructional methods for improving the fluency of
developing or struggling readers typically consist of
Assessing Fluency (a) an increased volume of reading practice such as repeated
Fuchs et al. (2001) found that only 8% of the standardized readings of the same text, (b) silent independent reading of
reading assessments extant during the 20th century assessed a wide array of texts, and (c) neurological impress methods
ORE From the 1970s through the 1990s, less than 4% of (Flood, Lapp, & Fisher, 2005; N I C H D , 2000; Samuels,
the standardized reading assessments that hecame available 2006). Although little research exists to validate them,
included a measure of ORF. In recent years, curriculum numerous variations of repeated readings (e.g., partner
hased measures (CBM) of ORF have become prevalent in reading, guided reading, choral reading) have heen used in
schools. CBMs typically use a single metric, a correct words classrooms for many years with success (Samuels, 2006).

Adult Basic Education and Literacy Journal Volume 5, Number 1, Spring 2011
Assessment of Oral Reading Fluency

However, some readers wilLnot improve ORF through together provide an understanding of low-literacy adults'
an increased volume of reading, whether with repeated instructional needs? To explore this question, we examined
texts or a wide array of texts. Pikulski (2006) emphasizes subgroups formed on the basis of these two indices.
that developing readers must acquire underlying alphabetic Some researchers suggest that the value of subgroup
skills before increased reading volume will increase ORF. analysis rests with the instructional implications. Aaron
Samuels and Wu (2003) found that the benefits of (2006) found significant results when differentiating
increased independent reading depended on prior reading remedial instruction for children in three subgroups based
ability. Their study showed that lower-ability students who on a component model of reading. Catts, Hogan, and
spent more time reading independeritly did not necessarily Adlof (2005) recommended instructional remediation for
make greater gains in reading achievement than those who emerging and developing reader subgroups formed on the
did not; among higher-ability students, those who spent basis of word recognition and linguistic comprehension
more time reading independently produced greater gains in measures. Likewise, Strucker and Davidson (2003)
reading achievement than thosewho did not. In the case of identified 11 adult reading profiles based on five reading
developing or low-ability readers, instruction in phonetic components, and recommended using the profiles to
decoding, vocabulary, and hijgh-frequency sight word drive instructional decisions. Similarly, in our previous
I

recognition may be more helpful for developing fluency. An work (Mellard, Fall, Si Mark, 2009), a cluster analysis of
integrated approach to instruction that addresses a mixture power and speeded measures of word reading identified
of word-level skills, processing speed, and comprehension seven profiles of adult readers with differing instructional
may produce the greatest ORF (Pressley, Gaskins, & needs. Here, we present an analysis of 295 low-literacy
Fingeret, 2006; Samuels, 2006), adults' passage reading in relation to multiple standardized
measures of reading and reading-related abilities, and we
Fluency in Adults With Low Literacy discuss instructional implications for four groups formed
Most reading fluency research has been conducted with on the basis of total words read and word error rates.
young readers rather than adults. Low-literacy adults
differ from children in several ways. As children learn to METHOD
read, they naturally increase in cognitive processing speeds For our exploratory study, we measured word errors in
for developmental reasons; in contrast, adults' cognitive relation to reading speed with connected prose at a fixed
processing speeds reach a plateau between 18 and 35 years of level of difficulty, that is, word errors per minute (wepm)
age (Kail &C Salthouse, 1994). Thus, the strong connection in relation to total words per minute (twpm). We chose
between reading speed and improved t-eading comprehension to use total word rate rather than correct word rate, the
observed in children may be an oversimplification when typical measure of ORF, because in our analysis correct
assessing and instructing adults' with low literacy. Further, words are not independent of word errors (r = .99). We
adults have life experiences children do not. These generally chose a rate-based measure of word errors because an
include helpfiil prior knowledge and vocabulary that may accuracy percentage has a record ceiling constraint (i.e.,
aid word recognition and reading comprehension. However, 100%) (White & Haring, 1976), and so could limit our
adults with low literacy also may have years of experience investigation. Moreover, "rate measures function better
habitually using inappropriate. awkward, or obstructive than accuracy in detecting reading difficulties" (Jenkins et
reading behaviors; practicing more of the same is not likely al., 2003, p. 244).
to be helpfiil. We formed four groups based on twpm and wepm and
statistically examined each group's relationship to outcomes
Perspectives on Adult Fluency from a standardized test battery of reading-related abilities
Because adults with low literacy differ from children and skills such as phonemic awareness, word recognition,
cognitively and experientially, we sought to better vocabulary, comprehension, and intellectual ability. Finally,
understand their ORF and its ihiplications for assessment, we performed multivariate statistical comparisons of the
instruction, and evaluation. Specifically we asked. Can four groups, controlling for variables that contribute to the
oral reading total words read rates and word error rates differences in twpm and wepm.

Adult Basic Education and Literacy Journal Volume 5, Number 1, Spring 2011
Meilard, Woods, and Fall

volunteers at Levels 1, 2, and 3, we included all available


We collected data ftom 319 individuals enrolled in 13 learners at these levels.
Midwestern Adult Education and Eamily Literacy Act We selected a total of 330 learners, 11 of whom
(AEELA) programs. All were participating in a larger, subsequently declined to participate, most commonly due to
randomized controlled trial study. Programs were selected for "lack of time." We eliminated 11 participants' data because
their proximity to the research team. Each participant had to of incomplete information and 13 more because of validity
(a) be at least 16 years old, (b) have withdrawn ftom secondary concerns (e.g., statistical outliers, cognitive disability such
education, (c) have U.S. citizenship or authorization to work as traumatic brain injury). The remaining 295 learners
in the United States as a foreign national (in order to receive were classified as follows: 25 in Level 1,46 in Level 2, 56 in
a participation payment), and (d) be willing to participate Level 3,57 in Level 4,55 in Level 5, and 56 in Level 6.
in the study. Because this study addressed literacy and not Table 1 describes the sample by gender, age, and race/
language differences, we excluded learners enrolled in English ethnicity. Typical of adult education learners, the sample
as a Second Language (ESL) courses. was 60% female and ranged in age ftom 16 to 73 years, with
Our research design called for a stratified sample a median age of 24 years. Race/ethnicity was representative
with representation from each of the National Reporting of the study region's non-ESL, adult education participants
System's (NRS) six educational functional levelsAdult with 37% White non-Hispanic, 35% African American,
Basic Education Beginning Literacy (Level 1) through 11% White Hispanic, 17% other or not reported.
High Adult Secondary Education (Level 6) (U.S. Table 2 presents standard scores for intellectual
Department of Education [USDE], 2004). NRS levels and reading ability by NRS level and in total. The mean
were based on learners' Comprehensive Adult Student Wechsler Adult Intelligence Scale III (WAIS) prorated
Assessment System (CASAS, 2001) reading diagnostic I Q score (Wechsler, 1997) was 81.6 {SD = 12.5). Further
scores determined at the beginning of their participation illustrating the low literacy of the sample are mean standard
in our study. For Levels 4, 5, and 6, we randomly selected scores ftom Woodcock Reading Mastery Tests-Revised
ftom among the volunteers at each study site for a total of ( W R M T - R ) subtests Word Attack 70.8 (SD = 20.3;
approximately 60 learners per level. Because we had fewer grade equivalent [GE] = 3.8), Word Identification 77.8

Table 1
Sample Distribution by Age Group, Race/Ethnicity, and Gender

m4 4i=i 1
MI )
White non-Hispanic 24 (8%) 31 (10%) 37 (12%) 14 (4%) 3 1% 109 (37%)
Female 13 (4%) 19 (6%) 27 (9%) 7 (2%) 1 0 67 (23%)
Male 11 (4%) 12 (4%) 10 (3%) 7 (2%) 2 1 42 (14%)
African American 15 (5%) 36 (12%) 19 (6%) 24 (8%) 9 3 103 (35%)
Female 7 (2%) 23 (8%) 13 (4%) 9 (3%) 6 2 58 (20%)
Male 8 (3%) 13 (4%) 6 (2%) 15 (5%) 3 1 45 (15%)
White Hispanic 5 (2%) 15 (5%) 9 (3%) 2 (1%) 1 0 32 (11%)
Female 3 (1%) 10 (3%) 5 (2%) 2 (1%) 1 0 21 (7%)
Male 2 (1%) 5 (2%) 4 (1%) 0 (0%) 0 0 11 (4%)
Other/not reported 8 (3%) 14 (5%) 19 (7%) 8 (2%) 2 1 51 (17%)
Female 3 (1%) 8 (3%) 14 (5%) 4 (1%) 2 1 31 (10%)
Male 5 (2%) 6 (2%) 5 (2%) 4 (1%) 0 0 20 (7%)
Total 52 (18%) 96 (33%) 84 (29%) 48 (16%) 15 5 295 (100%)
Female 26 (9%) 60 (20%) 59 (20%) 22 (8%) 10 3 177 (60%)
Male 26 (9%) 36 (12%) 25 (9%) 26 (9%) 5 2 118 (40%)
Note: N = 295,

Adult Basic Education and Literacy Journal Volume 5, Number 1, Spring 2011
Assessment of Oral Reading Fluency

{SD - 19.2; GE = 4.8), and Passage Comprehension 72.3 Additions If reader adds words to the passage or
{SD = 22.8; GE = 4.7) (Woodcock, 1998). adds a letter to the end of a word, count
as an error.
Assessment Instruments Omissions If reader omits entire word, count as an
error.
Independent variables.
I
Self-corrections If reader says word wrong and then
To measure our independent variables, we used two sixth- corrects him- or herself, count one error
grade expository passages and' the error scoring criteria and one correct.
(Figure 1) firom the Qualitative Reading Inventory (QRI) Repetitions If reader says word correctly then rereads
(Leslie 8C Caldwell, 2001). Examiners presented both correctly, count only the first reading as
correct and each repetition of the word
passages to participants in rotating order, asking them to
as an error.
simply read aloud from them. One passage had a lexile score
Mispronunciations If reader mispronounces a word, count
of 660L and described the work of Margaret Mead; the
as an error each time it is read except
other had a lexile score of 710L and discussed methods of when mispronunciation is a plausible
trash handling. Readings were audio-taped for later scoring, pronunciation of a proper noun, which is
then counted as correct (make allowance
and we calculated average rates from these raw scores. No for common dialects).
significant differences were found between passage scores.
I. Qualitative Reading Inventory (QRI) Error Scoring
Dependent variables. Criteria
From the literature, we identified skills and abilities that
contribute to reading in general and to ORF specifically. We Clinical Evaluation of Language Fundamentals
formed an assessment battery of the following instruments: (CELF) Listening Comprehension subtest (Semel,
Wechsler Adult Intelligence Scale III (WAIS) Wiig, & Secord, 1995)
Block Design, Information, and Vocabulary subtests Woodcock-Johnson III (WJ3-AWM) Auditory
(Wechsler, 1997) Working Memory subtest (Mather & Woodcock,
Comprehensive Test of Phonemic Processing 1998)
(CTOPP) Elision, Blending Nonwords, Rapid Color Peabody Picture Vocabulary Test-III (PPVT-3)
Naming, and Rapid Letter Naming subtests (Wagner, (Dunn C Dunn, 1997)
Torgesen, & Rashotte, 1999) Woodcock Reading Mastery Tests-Revised
Test of Word Reading Efficiency (TOWRE) Sight ( W R M T - R ) Word Attack, Word Identification, and
Word Efficiency and Phonemic Decoding Efficiency Passage Comprehension subtests (Woodcock, 1998)
tests (Torgesen, Wagner, C Rashotte, 1999) Comprehensive Adult Student Assessment System
. Test of Silent Word Reading Fluency (TOSWRF) Reading Test Level C-Advanced Basic Skills subtest
(Mather, Hammill, Allen, &C Roberts, 2004) (CASAS, 2001) converted to NRS levels.

Table 2
Mean and Standard Deviation of Ward Attack, Word Identification, Passage Comprehension, and IQ Standard Scores, by NRS Level

25 45.7 (14.7) 38.3 (12.0) 35.0 (15.7) 72.2 (9.7)


46 6K.7 (15.8) 52.5 (17.6) 52.6 (18.8) 72.2 (6.6)
56 74.5 (15.4) 67.0 (15.9) 66.5 (17.6) 78.1 (11.1)
57 81.1 (13.4) 73.9 (11.6) 78.3 (11.9) 80.8 (8.5)
55 88.7 (12.2) 82.2 (10.4) 81.4 (15.1) 85.3 (10.2)
56 92.1 (11.6) 90.7 (7.5) 95.2 (8.7) 94.7 (12.1)
Total 295 70.8 (20.3) 77.8 (19.2) 72.3 (22.8) 81.6 (12.5)

Adult Basic Education and Literacy Journal " Volume 5, Number 1, Spring 2011
Mellard, Woods, and Fall

passage reading rate averages 143 correct words per


Dysfuem Median Tot 1 Words 119 Context
Readers Readers minute (Baer et al., 2009).
n=56
Learners with scores at or above median twpm and
NRS Reading Placement Level
below median wepm formed the group we labeled most
30-
O Adult Basic Education Literacy fluent readers (MFR). For relatively speedy but inaccurate
Beginning Basic Education
D Low Intermediate Basic Education readers with scores at or above median for both variables,
High Intermediate Basic Education
M Low Adult Secondary Education
we borrowed Harris and Sipay's (1990) term, context
High Adult Secondary Education
O O
readers (CR). Relatively slow and accurate readers with
20- scores below median for both variables we labeled print-
O . bound readers (PR) (Harris C Sipay, 1990). Slow and
inaccurate readers with scores below median twpm and at
Median Errors = 8.S
or above median wepm, we labeled dysuent readers (DR).
!2
S We evaluated dependent variables for significant
110-
differences among and patterns within the four groups. We
performed one factor multivariate analysis of covariance
(MANCOVA) to better understand the relationships
between group membership and dependent variables that
were not rate based. We excluded results from the Rapid Color
50 100 ISO 200 2S0

Total Words Read per Minute Naming and Letter Naming, Phonemic Decoding Efficiency,
Sight Word Efficiency, and Silent Word Reading Efficiency
2. Total Word Rate by Word Errors Rate, shown by tests fi-om this analysis because they were rate based and
NRS level. Overall median Total Word Rate = 119; overall
thus highly correlated with the classification variables firom
median Word Error Rate = 8.5.
which the groups were formed. We considered gender, age,
We computed a prorated I Q composite variable from and intelligence as potential covariates because of observed
the three WAIS subtests using procedures specified by differences in the groups' demographic profiles. After
Sattler (2001). examining correlation data, we found age and gender had litde
correlation with dependent variables and eliminated them
Procedures firom the MANCOVA. The MANCOVA excludes prorated
Data collection. IQas a dependent variable because it is a composite score.
Trained examiners individually administered the We chose Block Design as a measure of intelligence
assessments. Learners received $50 payments for because, of the administered WAIS subtests, it is least
participating. Examiners completed procedural related to language abilities and reading. Intelligence was
administration validity checklists, and a data-handling treated as a continuous covariate in the analysis. For all
team followed protocols for ensuring that records were dependent variables, we used raw scores.
complete and accurate, including inter-rater reliability and
validity checks. RESULTS
Group Profiles
Statistical analyses. For each group. Table 3 presents mean scores for the two
We created a scatter plot of twpm and wepm (Figure defining variablestwpm and wepmas well as age and
2), and observed sufficient differences to form four gender. Tables 4 and 5 present the mean score by group for
groups using median splits. The median for total words each administered measure.
read was 119 per minute; for word errors it was 8.5
per minute. For comparison, students in 9th through Group by NRS level.
12th grade normally read between 180 and 200 correct Table 6 presents the distribution of group members by
words per minute (Adams & Brown, 2004; Hasbrouck NRS levels. Each group contained individuals who were
& Tindal, 1992); an adult with a basic prose literacy placed in at least five of the six NRS levels.

Adult Basic Education and Literacy Journal Volume 5, Number 1, Spring 2011
Assessment of Oral Reading Fluency

MANCOVA. largest Cohen's d effect sizes hetween MFR and DR were


Table 7 presents the MANCOVA main effects of Passage Comprehension (k = 2.227), Word Identification
controlling for intellectual ability using Block Design as a (k = 2.504), Word Attack (k = 2.663), and Elision
covariate with group. Significant variance existed hetween (k = 1.857). Between MFR and PR, the greatest differences
groups on all but one dependent variable. Dependent were in Passage Comprehension (k = 1.678), Word
variables with statistical differences by group were Word Identification (k = 1.578), Word Attack (k = 1.525), and
Identification, F(3, 292) = 63.264, p = .00; Word Attack, Elision (k= 1.632). Differences between MFR and CR were
F(3, 292) = 63.113, p - .00; anjd Passage Comprehension, less pronounced but still significant for all variables except
F(3, 292) = 49.484, p = .00. Lack of significance for the CELF and PPVT. The largest effect sizes were for Word
Information variable, F(3, 292) = 2.378, p = .07, may be Identification (k = 1.052) and Word Attack (k = 1.042).
due to the fact that the Block Design covariate accounted CR differed from PR on only four variables with the
for similar elements of the variance. following effect sizes: Passage Comprehension (k = 1.051),
Bonferroni post hoc tests of groups show that MFR Word Identification (k = 1.008), Word Attack (k = .593),
was the most distinct group. It differed firom PR and DR on and C T O P P Ehsion (k = .650). CR differed from DR on
every variable, and from CR ori nearly every variable. The almost every variable (excluding CELF and Information)

Table 3 |
Fluency Measures and Age Means with Standard Deviations and Gender Distribution by Group
Most fluent Context readers Print-bound Dysfluent readers
readers (MFR) (CR) readers (PR) (DR)
Measure M SD M SD M SD M SD
Twpm 156.1 (25.4) 145.8 (20.1) 77.4 (34.3) 73.6 (30.8) 113.7 (47.9)
Wepm 5.1 (1.9) 12.7 (5.1) 6.0 (1.7) 13.9 (5.3) 9.5 (5.6)
Age 25.2 (10.6) 29.5 (13.8) 33.6 (15.2) 36.8 (15.7) 31.2 (14.6)
Percent female 64.1% 76.8% 51.9% 50.5% 60.0%
N 95 56 52 95 295
Note: Twpm = total words read per minute; Wepm = word errors per minute.

Table 4
Intellectual Ability, Listening and Memory, and Vocabulary Raw Score Means and Standard Deviations by Group
Most fluent Context readers Print-bound Dysfluent readers
readers (MFR) (CR) readers (PR) (DR)
Measure M (SD) M SD M SD M SD M SD 1
Intellectual ability
WAIS Block Design 34.8 (12.8) 26.9 (12.0) 24.8 (13.0) 23.2 (10.5) 27.8 (12.9)
WAIS Information 11.5 (4.4) 9.6 (3.6) 8.9 (4.1) 8.6 (3.1) 9.7 (4.0)
WAIS pro-rated IQ 90.3 (12.0) 81.5 (11.6) 77.5 (11.3) 75.7 (9.1) 81.6 (12.5)
Listening and memory
CELF Listening Comp. 8.2 (3.4) 7.2 (3.1) 5.2 (2.9) 6.0 (3.3) 6.7 (3.4)
WJ3 Auditory Working 28.3 (5.3) 23.8 (7.0) 20.9 (5.9) 17.8 (7.6) 22.7 (7.8)
Memory
Vocabulary
PPVT-3 163.9 (17.9) 157.7 (16.9) 147.7 (21.9) 148.8 (18.2) 155.0 (19.7)
WAIS Vocabulary 29.7 (10.8) 24.1 (9.6) 19.6 (8.7) 18.4 (7.7) 23.2 (10.4)
Note: WAIS = Wechsler Adult Intelligence Scale III; CELF = Clinical Evaluation of Language Fundamentals; WJ3 = Woodcock-Johnson III;
PPVT-3 = Peabody Picture Vocabulary Test-III.

Adult Basic Education and Literacy Journal Volume 5, Number 1, Spring 2011
Mellard, Woods, and Fall

with the largest effect sizes for Passage Comprehension lowest abilities for MFR, that is, listening comprehension,
(k = 1.516), Word Identification (k = 1.791), and Word information, and picture vocabulary. Conversely, word-
Attack (k = 1.499). level skills were least demonstrated by learners in the DR
PR and DR were the most similar to each other; the group; they were strengths of the MFR group.
only discriminating variable between these two lowest
performing groups was Word Attack (k = 0.751). Correlations.
High correlations exist between the grouping variables and
Strengths and weaknesses within groups. many dependent variables. Most associated with twpm
In comparison to other learners in the sample, the MFR were Sight Word Efficiency (r^ = .92), Word Identification
group's strongest abilities were word-level skills and (r^ = .89), Passage Comprehension (r = .82), and
phonemic awareness. Areas in which these learners displayed Phonemic Decoding Efficiency (r^ =.81). Most associated
the least ability were listening comprehension, information, with wepm were Word Attack (r = -.54), Phonemic
xy
and picture vocabulary. The CR group's strongest abilities
Decoding Efficiency (r^ = -.47), Word Identification
were sight word reading, rapid naming, and reading
(r^ = -.45), and Passage Comprehension (r = -.45).
comprehension. These learners scored near or below the
sample mean in information, vocabulary, and elision tests. DISCUSSION
The PR group's greatest abilities were phonetic skills and Results demonstrate that groups formed on the basis
nonreading tasks; their greatest skill deficits were in rate- of total word and word error rates are distinct from one
related activities (e.g., word reading efficiency and rapid another in underlying abilities that contribute to reading
naming tasks). The DR group's strengths were the three as well as in knowledge or performance directly related

Table 5
Phonemic Awareness. Processing Speed. Word-Level Skills, and Reading Comprehension Raw Score Means and Standard Deviations by Group

Most fluent Context readers Print-bound Dysfluent readers


readers (MFR) (CR) readers (PR) (DR) Total
Measure M (SD) M SD M SD M SD M SD
Phonemic awareness
CTOPP Elision 15.1 (4.6) 10.8 (5.3) 7.6 (4.6) 6.9 (4.3) 10.3 (5.8)
CTOPP Blending Nonwords 8.5 (2.8) 6.4 (4.0) 5.2 (3.4) 3.9 (3.6) 6.1 (3.9)
Processing speed
CTOPP Rapid Color Naming 41.0 (7.3) 43.7 (8.1) 61.6 (22.7) 58.5 (20.4) 50.6 (18.1)
CTOPP Rapid Letter Naming 26.8 (4.4) 28.7 (5.0) 39.6 (11.5) 39.7 33.6 (11.9) (14.8)
Word-level skills
TOWRE Phonemic Decoding 39.1 (10.4) 29.6 (11.3) 17.8 (11.8) 9.7 (9.5) 24.5 (16.2)
Efficiency
WRMT-R Word Attack 32.8 (5.9) 25.3 (8.4) 19.5 (10.8) 11.9 (9.4) 22.4 (12.1)
TOWRE Sight Words Efficiency 81.3 (9.8) 76.2 (9.3) 51.1 (18.9) 46.8 (16.3) 63.7 (21.0)
WRMT-R Word Identification 86.3 (7.7) 77.7 (8.5) 62.2 (20.0) 54.6 (16.1) 70.3 (19.1)
TOS WRF Silent Word Reading 116.6 (29.4) 99.7 (24.2) 64.9 (31.3) 64.9 (30.1) 87.7 (37.2)
Efficiency
Reading comprehension -
WRMT-R Passage 48.2 (6.8) 42.8 (9.1) 31.3 (12.6) 26.9 (11.8) 37.4 (13.6)
Comprehension

Note: CTOPP = Comprehensive Test of Phonemic Processing; TOWRE = Test of Word Reading Efficiency; WRMT-R = Woodcock Reading
Mastery Tests-Revised; TOSWRF = Test of Silent Word Reading Fluency.

10 Adult Basic Education and Literacy Journal Volume 5, Number 1, Spring 2011
Assessment of Oral Reading Fluency

to reading. These distinctions remained even after taking needs. Lastly, the groups' relative strengths and weaknesses
into account differences in general intellectual ability. indicate possible explanations for differences among
Eurthermore, these groups did not parallel NRS functional groups and suggest instructional priorities for each group.
levels, the classification scheme by which many adult Therefore, fluency grouping may be a helpful way for adult
education programs determine what type of instruction to education programs to assess learners for planning and
provide learners. This finding underscores the limitations evaluation purposes.
of relying on reading comprehension scores ftom TABE As we might easily have guessed, learners in the MFR
or CASAS to represent a learners literacy instruction group had the highest ability scores, most phonemic awareness.
Table 6
National Reporting System Level Distribution Within Fluency Ability Group
Most fluent readers Context readers Print-bound readers Dysfluent readers
(MFR) (CR) (PR) (OR)
NRS level n % n % n % n % n %
1 0 (0%) 1 (2%) 7 (14%) 17 (18%) 25 (9%)
2 1 (1%) 5 (9%) 9 (17%) 31 (33%) 46 (16%)
3 9 (10%) 8 (14%) 12 (23%) 27 (28%) 56 (19%)
4 13 (14%) 19 (34%) 9 (17%) 16 (17%) 57 (19%)
5 28 (30%) 15 (27%) 10 (19%) 2 (2%) 55 (19%)
6 41 (45%) 8 (14%) 5 (10%) 2 (2%) 56 (19%)
Total 92 (100%) 56 (100%) 52 (100%) 95 (100%) 295 (100%)
Note: Numbers in bold represent the largestfluencygroup at each NRS level.
Table 7 j
Multivariate Analysis of Covariance (MANGOVA) by Fluency Ability Group and Intelligence
Source Dependent variable at ^ W P
Fluency ability group WRMT-R Word Identification 3 63.264 .425 .000
WRMT-R Word Attack 3 63.113 .424 .000
WRMT-R Passage Comprehension 3 49.484 .366 .000
CTOPP Elision 3 32.863 .277 .000
Wj3 Auditory Working Memory 3 19.700 .187 .000
CTOPP Nonword Blending 3 15.560 .154 .000
WAIS Vocabulary 3 10.855 .112 .000
PI^VT-3 3 4.479 .050 .004
CELF Listening Comprehension 3 4.457 .049 ,005
WAIS Information 3 2.378 .027 .070
WAIS Block Design CTOPP Elision 1 42.873 .143 .000
W R1 M T - R Passage Comprehension 1 38.665 .131 .000
WAIS Information 1 35.351 .121 .000
1
WAIS Vocabulary 1 33.986 .117 .000
PRVT-3 1 31.694 .110 .000
WJ3 Auditory Working Memory 1 27.099 .095 .000
CTOPP Blending Nonwords 1 24.749 .088 .000
WRMT-R Word Identification 1 17.929 .065 .000
1
WRMT-R Word Attack 1 16.412 .060 .000
1 14.760 .054 .000
CELF Listening Comprehension 1
Note: WRMT-R = Woodcock Reading Mastery Tests-Revised; CTOPP = ComprehensiveTest of Phonemic Procesing; WJ3 = Woodcock-Johnson III;
WAIS = Wechsler Adult Intelligence Scale III; PPVT-3 = Peabody Picture Vocabulary Test-III; CELF = Clinical Evaluation of Language Fundamentals.

Adult Basic Education and Literacy Journal Volume 5, Number 1, Spring 2011 11
Mellard, Woods, and Fall

festest processing speed, keenest listening memory and ratealthough with more than an acceptable word error
comprehension, largest vocabulary, best word recognition rateand demonstrated about third-grade abilities on
and attack skills, and highest reading comprehension. Three the other skills subtests. They were very similar to the
quarters of this group were classified in NRS levels 5 or 6, DR group in measures of intellectual ability, processing
indicating that they were approaching GED attainment. speed, vocabulary, and listening skills, but they had better
However, they averaged only a fifth-grade fluency rate with phonemic awareness and word recognition abilities. Their
word error frequency that fell within an acceptable range apparent ability to decode words is outweighed by their
(less than 5% of total words according to Sundbye, 2001). slower processing speed, which may be a demonstration of
Their other subskill scores were at about an eighth-grade the limited capacity theory of reading (Lesgold & Perfetti,
level. These learners seemed to have achieved this level of 1978; Perfetti, 1985) wherein cognitive resourcessuch as
reading proficiency through phonetic and sight word reading working memoryare allocated to word decoding tasks
skills. The reason for their status as low-literacy adults may be and are less available for comprehension. For these learners,
explained by lack of opportunity, or prior instruction that feiled instruction that develops word recognition automaticity
to build knowledge, vocabulary, memory, or inferential abilities. (e.g., sight words, context cues) may be a priority, with
Because Samuels and Wu (2003) found that higher-ability subsequent reading practice to improve processing speed.
students benefited from more reading practice, we speculate DR group learners were most often classified in the
that this group of learners would likely benefit from (a) a wide lowest NRS levels, had less than second-grade fluency rates
array of reading materials to increase background knowledge with nearly four times the acceptable level of word errors,
and vocabulary, and (b) metacognidve strategy instruction for and had second-grade equivalent subtest scores. They were
building memory capacity and the ability to draw inferences. weakest in both word decoding and sight word skills, yet had
The CR group performed nearly as well as MFR on relative strengths in listening memory and inference skills,
rapid naming and silent word reading efficiency, but lower on prior knowledge, and picture vocabulary. In some instances,
all other measures. About 40% of these readers were placed while still performing at a low level, they scored as well or
in NRS Level 4, which equates to eighth grade. The CR better than the PR group in tasks that did not require word
group's relative strengths were sight word recognition and recognition or decoding. With children who performed at
passage comprehension at about a sixth-grade level, despite this level, teachers would typically emphasize acquisition
about twice the acceptable rate of word errors. In fact, the of alphabetic skills before increasing their reading volume.
group's word attack skills were at the fourth-grade level. However, if these adults are part of the 25-30% of the
Perhaps many members of this group did not make word population who lack a component of phonemic awareness
errors that changed meaning, allowing them to comprehend termed comparator function"an ability to hold a phoneme
better than other readers with similar word error rates and/or syllable segments of two phonological structures
(Daane et al., 2005). Nevertheless, absence of word attack in mind and compare and represent any variations in the
skills may relegate them to low-literacy status even more than number, identity, or order of their segments" (Lindamood,
does limited vocabulary or lack of background knowledge. Bell, & Lindamood, 1992, p. 242)more than phonics
For this group, increased reading practice to improve fluency instruction may be needed. Most likely a more comprehensive
may not help. It could possibly hurt by reinforcing bad habits assessment of phonemic awareness and targeted, intensive
such as overusing context cues or ignoring graphic cues. interventions would be needed for these readers.
Instruction that helps these readers attend to the details of a
textwhole words, letters in words, punctuationmay be Application of ORF Measures With Adults
most helpful for developing fluency and reading proficiency. The two-minute oral reading assessment that we used to
First, we suggest extensive practice in applying those skills group low-literacy adults could be used to make initial
in controlled textual materials. Later, learners in this group instructional decisions for adult learners. Further, our
can read more widely to build knowledge and vocabulary, median twpm and wepm rates could be used for ongoing
especially in texts matched to their interests. progress monitoring and instructional needs as the learners
Members of the PR group were categorized into become more fluent. For example (Figure 3), a learner
nearly every NRS level. They read at about a second-grade who enters adult literacy instruction reading less than 119

12 Adult Basic Education and Literacy Journal Volume 5, Number 1, Spring 2011
Assessment of Oral Reading Fluency

twpm with fewer than 8.5 wepm could begin instruction Oral Reading Fluency Progress Monitoring Chart
appropriate for a print-bound eader. An educator could
easily monitor whether an instructifional plan aimed at Baseline Instruction 1 Instruction 2

developing word recognition utomaticity was helping



the learner increase twpm without increasing wepm. If *
errors became unacceptably high the educator could adjust
mstruction. (A

Limitations and Future Research


I n "

Our sample was drawn from adult volunteers already


enrolled in adult education programs, which implies
motivation to improve literacy skills and educational Trial
credentials. In addition, these leat'ners were from one - - Twpm/l 0 - O - Wepm

region of the country. Future studies with other adult 3. Oral Reading Fluency Progress Monitoring Chart.
populations may validate the median' cut scores we suggest Twpm/10 = total words per minute divided by 10. Wepm = word
errors per minute.
here for instructional grouping and progress monitoring.
Given the distinct fluency groups identified in comparable correct word rates can have widely different
our exploratory analysis, future research may validate total word and word error rates. These differences
instructional methods and curriculum for each group. We were evidenced across other reading components, adult
anticipate that additional experimental and descriptive education placement levels, and general ability levels. By
Studies can help disentangle the relationship between skill using two indicators of fluencytotal words per minute
level and the value of targeted interventions. and word errors per minutea fairly clear picture of a
learner's current reading abilities emerges and suggests
CONCLUSION emphases for initial instruction. Further study may help us
Adult educators may be able to help many learners achieve understand the attentional, memory, language, and strategic
greater reading proficiency by turning attention to oral components associated with these differences and may lead
reading Huency. The data indicate that adults reading at to improved curricular and instructional models.

REFERENCES
Aaron, P. (2006, July). Tbe validity of the corriponent model oj reading: Comprehensive Adult Student Assessment System (CASAS).
Outcome oj an instructional procedure. Paper presented at the (2001). CASAS technical manual. San Diego, CA: Author.
meeting of the Society for the Scientific Study of Reading, Daane, M., Campbell, J., Grigg, W., Goodman, M., & Oranje, A.
Vancouver, BC, Canada. Retrieved from http://www.triplesr.org/ (2005). Fourth-grade students reading aloud: NAEP 2002 special
conference/archive/2006/docs/06Abstrats-061026.htm# Aaron study of oral reading (NCES 2006-469). Washington, DC: U.S.
Adams, G., & Brown, S. (2004). The six-minute solution: A reading Department of Education, Institute of Education Sciences,
fluency program. Longmont, CO: Sopris West Educational Services. National Center for Education Statistics.
AUington, R. (1983). Fluency: The neglected reading goal. The Dunn, L., & Dunn, L. (1997). Peabody Picture Vocabulary Test-Ill
Reading Teacher, 36, 556-561. ' (PPVT). Circle Pines, M N : American Guidance Service.
Baer,J., Kutner, M., 8C Sabadni,J. (2009). Basic reading skills and the literacy Flood, J., Lapp, D., & Fisher, D. (2005) Neurological impress method
of America's least literate adults: Resultsfromthe 2003 National Assessment plus.Reading Psychology: An International Quarterly, 26{2), 1476Q.
oj Adult Literacy (NAAL) supplemental studies (NCES 2009-481). Frederiksen, J. R. (1981). Sources of process interactions in reading. In
Washington, DC: U.S. Department of Education, Institute of A. M. Lesgold 8C C. A. Perfetti (Eds.), Interactive processes in reading
Education Sciences, National Center, for Education Statistics. (pp. 361-386). Hillsdale, NJ: Lawrence Earlbaum.
Calfee, R., & Piontkowski, D. (1981). "The reading diary: Acquisition Fuchs, L., Fuchs, D., Hosp, M., & Jenkins, J. (2001). Oral reading
of decoding. Reading Research Quarterly, 16(3), 346-373. fluency as an indicator of reading competence: A theoretical,
Catts, H., Hogan, T., & Adlof, S. (2005). Developmental changes empirical, and historical analysis. Scientific Studies of Reading, 5(3),
in reading and reading disabilities. In H. Catts & A. Kamhi 239-236.
(Eds.), The connections between language^ and reading disabilities Good, R., & Kaminski, R. (2002). Dynamic Indicators of Basic Early
(pp. 25-40). Mahwah, NJ: Erlbaum.j Literacy Skills (DIBELS) (6th ed.). Eugene, OR: Institute for the

Adult Basic Education and Literacy Jo^urnal' Volume 5, Number 1, Spring 2011 13
Mellard, Woods, and Fall

Development of Educational Achievement. Retrieved from the Pinnell, G., Pikulski, J., Wixson, K., Campbell, J., Gough, P, & Beatty, A.
University of Oregon's DIBELS Data System site: http://dibels (1995). Listening to children read aloud: Data from NAEP's Integrated
.uoregon.edu/measures/orf.php ReadingPerformance Record (IRPR) at grade 4. Washington, DC: U.S.
Harris, A., & Sipay, E. (1990). How to increase reading ability: A guide Department of Education, Office of Research and Improvement,
to developmental and remedial methods. White Plains, NY: Longman. National Center for Educational Statistics.
Harris, T., & Hodges, R. (1995). The literacy dictionary. Newark, DE: Pressley, M., Gaskins, I., & Fingeret, L. (2006). Instruction and
International Reading Association. development of readingfluencyin struggling readers. In S. J. Samuels &
Hasbrouck, J., & Tindal, G. (1992). Curriculum-based oral reading A. E. Farstrup (Eds.), What research has to say aboutfluencyinstruction
fluency norms for students in grades 2 through 5. Teaching (pp. 47-69). Newark, DE: International Reading Association.
Exceptional Children, 24(3), 41-44. Rasinsld, T. (2006). A brief history of readingfluency.In S.J. Samuels &
Herman, P. (1985). The effect of repeated readings on reading rate, A. E. Farstrup (Eds.), What research has to say aboutfluencyinstruction
speech pauses, and word recognition accuracy. Reading Research (pp. 4-23). Newark, DE: International Reading Association.
Quarterly, 20(5), 553-565. Rasinsld, T , & Zuteil, J. (1996). Is fluency yet a goal of the reading
Hoover, W , & Gough, P. (1990). The simple view of reading. In C. curriculum? In E. G. Sturtevant and W. M. Linelc (Eds.), Growing
Cornoldi & J. Oakhill (Eds.), Reading comprehension difficulties (pp. literacy (18th yearbook of the College Reading Association,
1-13). Mahwah, NJ: Erlbaum. pp. 237246). Harrisburg, VA: College Reading Association.
Jenkins, J., Fuchs, L., van den Broek, P, Espin, C , & Deno, S. (2003). Samuels, S. (2006).Toward a model of readingfluency.In S.J. Samuels Si
Accuracy and fluency in list and context reading of skilled and A. E. Farstrup (Eds.), M/hat research has to say aboutfluencyinstruction
RD groups: Absolute and relative performance levels. Learning (pp. 24-46). Newark, DE: International Reading Association.
Disabilities Research & Practice, 18(4), 237-245. Samuels, S., & Wu, Y. (2003). How the amount of time spent on
Kail, R., & Salthouse, T. (1994). Processing speed as a mental independent reading affects reading achievement: A response to
capacity. Acta Psychologica, 86(2/3), 199-225. the National Reading Panel. Retrieved from http://www.tc.umn
Kruidenier, J. (2002). Research-based principles for adult basic education .edu/~samue001/web%20pdf/time_spent_on_reading.pdf
reading instruction. Washington, DC: National Institute for Literacy. Sattler, J. (2001). Assessment of children: Cognitive applications (4th
Kutner, M., Greenberg, E., Jin,Y., Boyle, B., Hsu, Y., & Dunleavy, E. ed.). LaMesa, CA: Author.
(2007). Literacy in everyday life: Results from the 2003 National Semel, E., Wiig, E., 8c Secord, W. (1995). Clinical Evaluation of
Assessment of Adult Literacy (NCES 2007-480). Washington, Language Fundamentals (CELF) (3rd ed.). San Antonio, T X : The
DC: U.S. Department of Education, Insticute of Education Psychological Corporation/Harcourt Brace.
Sciences, National Center for Education Statistics. Stanovich, K. (1986). Matthew effects in reading: Some consequences
Lesgold, A., & Perfetti, C. (1978). Interactive processes in reading of individual differences in the acquisition of literacy. Reading
comprehension. Discourse Processes, 1, 323336. Research Quarterly, 22, 360-406.
Leslie, L., & Caldwell, J. (2001). Qualitative reading inventory, 3. New Strucker, J., & Davidson, R. (2003). Adult Reading Components Study
York, NY: Addison Wesley Longman. (ARCS) (a NCSALL Research Brief). Retrieved from NCSALL
Lindamood, P., Bell, N., & Lindamood, P. (1992). Issues in phonemic Website: http://www.ncsall.net/fileadmin/resources/research/
awareness assessment. Annals of Dyslexia, 42, 242259. brief_strucker2.pdf
Mather, N., Hammill, D., Allen, E., & Roberts, R. (2004). Test of Silent Sundbye, N. (2001). Assessing the struggling reader: What to look for
Reading Word Proficiency (TOSRWP). Austin, TX: PRO-ED. and how to make sense of it. Lawrence, KS: Curriculum Solutions.
Mather, R , & Woodcock, R. W (1998). Woodcock Johnson-III Torgesen, J., Wagner R., & Rashotte C. (1999). Test of Word Reading
(WJ3). Itasca, IL: Riverside. Efficiency (TOWRE). Austin, T X : PRO-ED.
Mellard, D., Fall, E., & Mark, C. (2009). Reading profiles for adults U.S. Department of Education (USDE). (2004). Enrollment and
with low literacy: Cluster analysis with power and speeded participation in the state-administered adult education program.
measures. Reading and Writing, 22(8), 975-992. Washington, DC: U.S. Department of Education, Office of
National Center for Family Literacy (2005). Applying research in Vocational and Adult Education. Retrieved from http://www
reading instruction for adults. Louisville, KY: Author. .ed.gov/about/offices/list/ovae/pi/AdultEd/aedatatables.html
National Institute of Child Health and Human Development (2000). Vadasy, P, Sanders, E., & Peyton, J. (2005). Relative effectiveness of
Report of the National Reading Panel. Teaching children to read: An reading practice or word-level instruction in supplemental tutoring:
evidence-based assessment of the scientific research literature on reading How text matters.Jbwrtia/ of Learning Disabilities, 38(4), 264-380.
and its implications for reading instruction. Reports of the subgroups. Wagner, R., Torgesen, J., & Rashotte, C. (1999). The Comprehensive
( N I H Publication No. 00-4754). Washington, DC: Author. Test of Phonemic Processing (CTOPP). Austin, T X : PRO-ED.
Perfetti, C. (1985). Reading ability. New York, NY: Oxford University Wechsler, D. (1997). Manual for the Wechsler Adult Intelligence Scale
Press. (WAIS) (3rd ed.). San Antonio, TX: The Psychological Corporation.
Pikulski, J. (2006). Fluency: A developmental and language White, O., & Haring, N. (1976). Exceptional teaching. Columbus,
perspective. In S. J. Samuels & A. E. Farstrup (Eds.), What research O H : Charles E. Merrill.
has to say about fluency instruction (pp. 70-93). Newark, DE: Wolf, M., C Katzir-Cohen, T. (2001). Reading fluency and its
International Reading Association. intervention. Scientific Studies of Reading, 5(3), 211-239.
Pikulski, J., & Chard, D. (2005). Fluency: Bridge between decoding Woodcock, R. (1998). Woodcock Reading Mastery Tests-Revised
and reading comprehension. The Reading Teacher, 58(6), 510-519. (WRMTR): Examiner's manual. Circle Pines, M N : American
Guidance Service.

14 Adult Basic Education and Literacy Journal Volume 5, Number 1, Spring 2011
Copyright of Adult Basic Education & Literacy Journal is the property of Commission on Adult Basic
Education and its content may not be copied or emailed to multiple sites or posted to a listserv without the
copyright holder's express written permission. However, users may print, download, or email articles for
individual use.

Das könnte Ihnen auch gefallen