YEREVAN STATE UNIVERSITY

ESG-3. STUDENT ASSESSMENT

A. Budaghyan

28.09.2012

A. Budaghyan /

YSU DIUSAS Project

Effective approach to assessment:

validly, reliably and fairly measures student performance of intended learning outcomes

guides and encourages effective student learning

provides mechanisms for enhancing teaching, learning and assessment

28.09.2012

A. Budaghyan /

YSU DIUSAS Project

Valid assessment
valid assessment engages students in tasks aligned with the units intended learning outcomes and measures students achievement of those learning outcomes

28.09.2012

A. Budaghyan /

YSU DIUSAS Project

Reliable assessment
reliability refers to a demonstrated consistency of marking over time, between multiple markers, and across a cohort of students

28.09.2012

A. Budaghyan /

YSU DIUSAS Project

Fair assessment

A fair assessment task is one in which students are given equitable opportunities to demonstrate their learning

28.09.2012

A. Budaghyan /

YSU DIUSAS Project

YSU DIUS Assignment 4

ESG 3: Assessment of Students

Standard

Procedure

Policy

Tools

Development of Student Assessment Methodology

Student Assessment Guide

Faculty surveys (on methodology) Faculty focus groups External review

QA of Student Assessment in YSU

Student Assessment Regulations
Student surveys Graduate surveys Success rates (dropout rates) Faculty surveys (on implementation) Review of samples (on random basis)

Implementation of Student Assessment

Exists and does not need any revision Exists but needs revision Does not exist, but will be developed during the DIUS project life time 28.09.2012 A. Budaghyan /

YSU DIUSAS Project

259 STUDENTS VIEW

FACULTY OF JOURNALISM -90 FACULTY OF BIOLOGY - 169

28.09.2012

A. Budaghyan /

YSU DIUSAS Project

STUDENT SURVEY ON STUDENT ASSESSMENT AT YSU

Please indicate your level of agreement on the following statements about student assessment at YSU Response Options: 0 = not applicable 1 = disagree strongly 2 = disagree somewhat 3 = no strong view 4 = agree somewhat 5 = agree strongly

# Assessment criteria

Survey Question

1. The assessment requirements(criteria) are easy to understand 2. Teachers follow the assessment criteria in the assessment tasks Assessment modes and methods 3. 4. Interim (written) exams allow me to convey what I learned Final (oral) exams allow me to convey what I learned

5. Multiple-choice tests allow me to convey what I learned Effectiveness of assessment 6. My performance on exams usually reflects my skill-level completely Feedback on assessment 7. Usually I receive feedback or advice from my teacher after each assessment based on my performance in assessment task 8. The appeal system on assessment is efficient
28.09.2012 A. Budaghyan / YSU DIUSAS Project 8

Assessment criteria are easy to understand

agree strongly agree somewhat no strong view disagree somewhat disagree strongly not applicable 3 8 18 26

95 109

28.09.2012

A. Budaghyan /

YSU DIUSAS Project

Teachers follow the assessment criteria

agree strongly agree somewhat no strong view disagree somewhat disagree strongly not applicable 1 5 29

100
99

24

28.09.2012

A. Budaghyan /

YSU DIUSAS Project

10

Written exams allow me to convey what I learned

agree strongly 89

agree somewhat

89

no strong view

27

disagree somewhat

30

disagree strongly

15

not applicable

28.09.2012

A. Budaghyan /

YSU DIUSAS Project

11

Oral exams allow me to convey what I learned

agree strongly 141

agree somewhat

66

no strong view

25

disagree somewhat

13

disagree strongly

not applicable

28.09.2012

A. Budaghyan /

YSU DIUSAS Project

12

Multiple-choice tests allow me to convey what I learned

agree strongly

82

agree somewhat

83

no strong view

26

disagree somewhat

41

disagree strongly

16

not applicable

10

28.09.2012

A. Budaghyan /

YSU DIUSAS Project

13

My performance on exams reflects my skill-level

agree strongly 58 108 28 41 15 9

agree somewhat
no strong view disagree somewhat

disagree strongly
not applicable

28.09.2012

A. Budaghyan /

YSU DIUSAS Project

14

I receive feedback from my teacher after each assessment

agree strongly 59

agree somewhat

83

no strong view

46

disagree somewhat

32

disagree strongly

14

not applicable

25

28.09.2012

A. Budaghyan /

YSU DIUSAS Project

15

Appeal system on assessment is efficient

agree strongly 50

agree somewhat

71

no strong view

61

disagree somewhat

38

disagree strongly

15

not applicable

23

28.09.2012

A. Budaghyan /

YSU DIUSAS Project

16

Mean grade
Appeal system on assessment is efficient I receive feedback from my teacher after each assessment My performance on exams reflects my skilllevel Multiple-choice tests allow me to convey what I learned Oral exams allow me to convey what I learned Written exams allow me to convey what I learned Teachers follow the assessment criteria Assessment criteria are easy to understand 3,44 3,60 3,61 3,70 4,29 3,83 4,03 4,04

28.09.2012

A. Budaghyan /

YSU DIUSAS Project

17

CONCLUSIONS
Majority of the questioned students evaluates positively the clarity and intelligibility of assessment criteria (requirements) and how the teaching staff follows those criteria during examination process (79% and 77% accordingly) Majority of the questioned students more favours written and oral exams (69% and 80% accordingly) and less countenance to multiple-choice tests (only 64%) Only 22% of the surveyed students finds that their performance on exams does not reflect completely their skill-level and 64% of the students considers that there is a match/conformity between exam results and their knowledge Only 55% of the surveyed students finds that they receive feedback or advice from their teachers after each assessment based on their performance in assessment task/exam although 18% of the students does not agree with this statement. As far as these results are above our expectations this issue needs to be explored more detailed The 44% of the questioned students is not satisfied or dispute efficiency of the current appeal system which indicates to necessity of its revision
A. Budaghyan / YSU DIUSAS Project 18

28.09.2012

50 TEACHERS VIEW
FACULTY OF JOURNALISM - 12 FACULTY OF BIOLOGY - 38

28.09.2012

A. Budaghyan /

YSU DIUSAS Project

19

TEACHING STAFF SURVEY ON STUDENT ASSESSMENT AT YSU

Please indicate your level of agreement on the following statements about student assessment at YSU Response Options: 0 = not applicable 1 = disagree strongly 2 = disagree somewhat 3 = no strong view 4 = agree somewhat 5 = agree strongly

Survey Question
Interim (written) exams allow students to convey what they learned

Assessment modes and methods 1.

2. Final (oral) exams allow students to convey what they learned 3. Multiple-choice tests allow students to convey what they learned Effectiveness of assessment 4. The assessment methods and criteria used allow to accurately measure of what student learned Use of assessment data 5. I use student assessment results to improve my own teaching and learning methods Feedback on assessment 6. Usually I provide feedback or advice to students after each assessment based on their performance in assessment task 7. The appeal system on assessment is efficient
28.09.2012 A. Budaghyan / YSU DIUSAS Project 20

Written exams allow students to convey what they learned

agree strongly 8

agree somewhat

30

no strong view

disagree somewhat

disagree strongly

not applicable

28.09.2012

A. Budaghyan /

YSU DIUSAS Project

21

Oral exams allow students to convey what they learned

agree strongly 39

agree somewhat

10

no strong view

disagree somewhat

disagree strongly

not applicable

28.09.2012

A. Budaghyan /

YSU DIUSAS Project

22

Multiple-choice tests allow students to convey what they learned

agree strongly 5

agree somewhat

23

no strong view

10

disagree somewhat

disagree strongly

not applicable

28.09.2012

A. Budaghyan /

YSU DIUSAS Project

23

Assessment methods/criteria allow to measure of what students learned

agree strongly

12

agree somewhat

24

no strong view

disagree somewhat

disagree strongly

not applicable

28.09.2012

A. Budaghyan /

YSU DIUSAS Project

24

I use student assessment results to improve my own teaching methods

agree strongly agree somewhat no strong view disagree somewhat disagree strongly not applicable 0 1 7 12 13 17

28.09.2012

A. Budaghyan /

YSU DIUSAS Project

25

I provide feedback to students after each assessment

agree strongly 36

agree somewhat

no strong view

disagree somewhat

disagree strongly

not applicable

28.09.2012

A. Budaghyan /

YSU DIUSAS Project

26

Appeal system on assessment is efficient

agree strongly
agree somewhat no strong view disagree somewhat disagree strongly not applicable 1 2 6 10

16 13

28.09.2012

A. Budaghyan /

YSU DIUSAS Project

27

Mean grade
Appeal system on assessment is efficient I provide feedback to students after each assessment I use student assessment results to improve my own teaching methods Assessment methods/criteria allow to measure of what students learned Multiple-choice tests allow students to convey what they learned Oral exams allow students to convey what they learned Written exams allow students to convey what they learned
28.09.2012 A. Budaghyan / YSU DIUSAS Project

3,80

4,59

3,76

3,78

3,44

4,76

3,72

28

CONCLUSIONS
Majority of the surveyed teachers finds written or oral modes of exams more efficient (76% 98% accordingly), and only 46% of the teachers consider multiplechoice tests appropriate for the effective student assessment

72% of the questioned teaching staff finds that the assessment methods and criteria used by them allow to accurately measure of what students learned
Although 60% of the questioned teachers answered that they use student assessment results to improve their own teaching and learning methods/activities, nevertheless these results could not be considered as reliable, therefore the issue needs further exploration 88% of the surveyed teaching staff answered that they provide feedback or advice to students after each assessment based on their performance in assessment task. As far as these results are above our expectations the issue needs to be further explored Only 14% of the surveyed teachers considers that the appeal system on student assessment is not efficient

28.09.2012

A. Budaghyan /

YSU DIUSAS Project

29

Measures to be taken
The question on teacher feedback should be reformulated

The question on formative function of assessment should be reformulated

The appeal system needs to be revised

The oral exams and other interactive methods of assessment should be encouraged Learning outcome based assessment criteria and standards should be adopted
28.09.2012 A. Budaghyan / YSU DIUSAS Project 30

IMPLEMENTING CRITERIA AND STANDARDS-BASED ASSESSMENT

Review and (if necessary) write clear learning outcomes: What students will be able to do by the end of the unit Use the marking scheme as the basis for giving meaningful feedback to students

Derive criteria (key characteristics) from the learning outcomes: What students will be able to do in the assessment task

Organize all criteria and standards in a marking scheme to communicate expectations to students

Select an appropriate method of assessment that validly measures what students will to be able to do

Describe clear standards: Levels of quality of performance (the quality of what students will be able to do in the assessment)

28.09.2012

A. Budaghyan /

YSU DIUSAS Project

31

THANK YOU FOR YOUR ATTENTION !

ANY QUESTIONS ?

28.09.2012

A. Budaghyan /

YSU DIUSAS Project

32