Beruflich Dokumente
Kultur Dokumente
AND ALIGNMENT TO
DETERMINE THE
EFFECTIVENESS OF
ASSESSMENT
ASSESSMENT
ALIGNMENT
VALIDITY RELIABILITY
STRATEGIES STANDARDS
ASSESSMENT
Assessment is the process of gathering
and discussing information from multiple
and diverse sources in order to develop a
deep understanding of what students
know, understand, and can do with their
knowledge as a result of their educational
experiences. (Huba and Freed,2000)
VALIDITY
- refers to what the assessment is actually
testing.
RELIABILITY
- refers to the consistency of the
assessment.
ALIGNMENT
- refers to the connection between learning
objectives, learning activities and
assessment
A. VALIDITY
Definitions:
Validity - refers to what the assessment is
actually testing
- refers to how accurately a conclusion,
measurement or concept corresponds to what is
being tested
- defined as the extent to which an
assessment accurately measures what it is
intended to measure.
Factors Affecting Validity:
1. Student’s reading ability - Educators should
ensure that an assessment is at the correct
reading level of the students.
2. Student self-efficacy - If students have low
self-efficacy or beliefs about their abilities in
the particular area they are being tested in,
they will typically perform lower.
3. Student test anxiety level - Students with high
test anxiety will underperform due to
emotional and physiological factors
Types of Validity:
1. Face Validity - ascertains that the measure appears to be
assessing the intended construct under study.
2. Construct Validity - is used to ensure that the measure is
actually measure what it is intended to measure and not
other variables
3. Criterion-Related Validity - is used to predict future or
current performance - it correlates test results with another
criterion of interest.
4. Formative Validity - when applied to outcomes assessment it
is used to assess how well a measure is able to provide
information to help improve the program under study.
5. Sampling Validity - ensures that the measure covers the
broad range of areas within the concept under study
Kinds of Validity Claim:
Strategies
Standards
Alignment
STRATEGIES FOR DEVELOPING
AN EFFECTIVE ASSESSMENT
1. Remember the effect of assessment on
student learning behaviors and outcomes.
2. Align the course assessment with the
learning outcomes and curriculum.
3. Prepare students for assessment by
providing formative tasks and explaining
the structure of the assessment for their
course.
STRATEGIES…
4. Design quality assessment tasks and
items.
5. Review Assessment Data.
6. Understand how to set standards and
grade cut-offs.
7. Give feedback to students.
STANDARDS
1. Assessment of Higher-Order Cognitive
Skills
2. High-Fidelity Assessment of Critical
Abilities
3. Assessments that Are Internationally
Benchmarked
4. Use of Items that Are Instructionally
Sensitive and Educationally Valuable
1. Assessment of Higher-Order
Cognitive Skills
One widely used approach in
conceptualizing knowledge and skills represented in
curriculum, teaching, and assessment Webb’s Depth of
Knowledge (DOK) taxonomy.
Using the DOK framework as a guide, if
assessments are to reflect and encourage transferable
abilities, a substantial majority of the items and tasks
(at least two-thirds) should tap conceptual knowledge
and abilities.
Webb’s Depth of Knowledge (DOK)
taxonomy
2. High-Fidelity Assessment of
Critical Abilities
This standard identifies a number of areas of knowledge
and skills that are clearly so critical for college and career
readiness that they should be targeted for inclusion in new
assessment systems. As described in the standard, these
includes:
Research
Analysis and Synthesis of Information
Experimentation and Evaluation
Communication in Oral, Written, Graphic, and Multi-Media
Forms
Collaboration and Interpersonal Interaction
Modeling, Design, and Complex Problem Solving
3. Assessments that Are
Internationally Benchmarked
The assessments should be as rigorous as those of
the leading education countries, in terms of the kind of
content and tasks they present, as well as the level of
performance they expect.
Such assessments sought were, in order of
importance:
1) teamwork
2) problem solving
3) interpersonal skills
4) oral communications
5) listening skills
4. Use of Items that Are
Instructionally Sensitive and
Educationally Valuable