PRINCIPLES OF LANGUAGE

ASSESMENT

Dosen Pengampu : Mr. Yatno, M.Pd.

 JOB DESCRIPTION
• VALIDITY
• a • RELIABILITY

1 • PRACTICALITY
• AUTHENTICITY

• WASHBACK
• APPLYING PRINCIPLES TO THE EVALUATION OF CLASSROOM
2 TEST
 How do you know
if a test is effective?
There are Five cardinal criteria for ‘’testing a test’’ :

1. Practicality

2. Reliability

3. Validity

4. Authenticity

5. Washback 3
 PRACTICALITY
What is practicality??
An effective test is Practical:
• Is not excessively expensive,
• Stays within appropriate time constraints,
• Is relatively easy to administer, and
• Has a scoring/evaluation procedure that is
specific and time-efficient.
4
 RELIABILITY
• A reliable test is consistent and dependable. If
you give the same test to the same student or
matched students on two different occasion, the
test should yield similar results.
Test I Test II

First occasion Second occasion 5

 RELIABILITY
Reliability refers to consistency and dependability. A same test deliveredto a same student
across time administration must yield same results. Factors affecting reliability are :

student-related reliability

rater reliability

test administration reliability

test reliability
 RELIABILITY
test-retest/re-
administer

Method to gain
reliability of parallel
split-half method form/equivalent-
assessment forms method

test-retest with intra-rater and

equivalent forms inter-rater
 VALIDITY
WHAT IS VALIDITY ????
Face Validity

Content-related Evidence

Five types of validity Criterion-related Evidence

Construct-related Evidence

Consequential Validity
8
 AUTHENTICITY
A test must be authentic. Bachman and Palmer (as cited in Brown, 2004:28)
defined authenticity as the degree of correspondence of the characteristics of a
given language test task to the features of a target language.

Several things must be considered in making an authentic test:

1. language used in the test should be natural,
2. the items are contextual,
3. topics brought in the test should be meaningful and interesting for the
learners,
4. the items should be organized thematically, and
5. the test must be based on the real-world.
9
 5. WASHBACK

Washback is the effects of tests

on teaching and learning.
Applying Principles to The
Evaluation of Classroom Test
The five principles of practicality, reliability,
validity, authenticity and washback go a long way
towards providing useful guidelines for both
evaluating an existing assessment procedure and
designing one on your own.
The five principles cited here serve as an
excellent foundation on which to evaluate
existing instruments and to build your own.
1. The ultimate test procedures are practical?
Practicality is determined by the teacher's (and
the students') time constraints, costs, and
administrative details, and test the context by what
happened before after the test.

2. Is the test reliable?

Test and test administration reliability can
be achieved by making sure that all students
receive the same quality of input whether written
or auditory.
3. Does The Procedure Demonstrate
Content Validity?
There are two steps to evaluating the
content validity of a classroom test :
1.Are classroom objectives identified
and appropriately framed?
2.Are lesson objectives represented in
the form of test specifications?
4. Is The Procedure Face Valid And “Biased For
Best”?
Face validity is “biased for best” a term
that goes a little beyond how the student
views the test to a degree to strategic
involvement on the part of student and
teacher in preparing for, setting up, and
following up on the test itself.
5.Are The Test Tasks As Authentic As Possible ?
Evaluate the extent to which a test is authentic.

6.Does The Test Offer Beneficial

Washback To The Learner?
The design of an effective test should point
the way to beneficial wash back.
THANK YOU