Evaluasi Pembelajaran

RELIABILITY
Presented by: Eko G Samudro Fadhil Mochsin Robi Davit Hidayat Yogi Saputra Mahmud

SCORER RELIABILITY
When scoring requires no judgment, and could in principle or in practice be carried out by a computer, the test is said to be objective. Only carelessness should cause the scorer reliability coefficients of objective tests to fall below 1.

HOW TO MAKE TESTS MORE RELIABLE

There are 2 components of test reliability : 1. The performance of candidates from occasion to occasion 2. The reliability of the scoring

TAKE ENOUGH SAMPLES OF BEHAVIOR

If we wanted to know how good an archer someone was, we wouldnt rely on the evidence of a single shot at the target. To be satisfied that we had a really reliable measure of the ability we would want to see a large number of shots at the target.

EXCLUDE ITEMS WHICH DO NOT DISCRIMINATE

WELL BETWEEN WEAKER AND STRONGER STUDENTS

Items on which strong students and weak students perform with similar degree of success contribute little to the reliability of a test.

DO NOT GIVE CANDIDATES TOO MUCH

FREEDOM

In some kinds of language test there is a tendency to offer candidates a choice of question and then to allow them a great deal of freedom in the way that they answer the one that they have chosen.

Write Unambiguous Items - Avoid writing ambiguous items - Ask your colleagues - Pre-testing of the items Provide clear & explicit instructions - Asking your colleagues Ensure that tests are well laid out and perfectly legible - Avoid giving badly typed or handwritten test set Make Candidates Familiar with Format and Testing Techniques - Making sure candidates understand Format & Techniques of the test

Provide Uniform and Non-distracting Conditions of Administration - Uniformity affects candidates performance Use Items That Permit Scoring Which is as Objective as Possible - Multiple choice items are recommended

CONTINUED...
Make comparisons between candidates as direct as possible Example: use one topic instead of giving options Provide a detailed scoring key Train scorers Agree acceptable responses and appropriate scores at outset of scoring

Scorer 1
Script

Scorer 2

Identify candidates by number, not name Employ multiple, independent scoring

RELIABILITY AND VALIDITY

A TEST
Validity What happened? Will always be Not always Reliability