Success depends on knowing what works.

Bill Gates

EVALUATION
Quantifies/Qualifies the

outcome/impact of the OHS program

and measure/determine whether
resources were used efficiently and
effectively.
Did we hit the target?

OHS EVALUATION QUESTIONS:

1. Did it work to achieve

expected outcomes & impacts?

2. How did it work?
3. Can it improve?

Sphere of influence

Short Term Outcomes

Outcomes: measure changes in
target groups practices

Education/Long Term Outcomes

Impacts: measure ultimate
effects of program on target
population

Teachers use OHS

curriculum as planned
Performance of OHS
Students at par with or
better than regular
students in major
subjects

No. of OHS graduates

went to college
No. of OHS graduates
employed (locally or
overseas)

M&E Focus
Control
BSE-OHS
PROGRAM INPUTS

Activities

Outputs

What did you do?

Influence
OHS STUDENTS
& LEARNING
FACILITATORS

Outcomes

Impacts

What did they do?

How did they
change?

Contribution

MDG/EFA

Greater
objective
What happened
beyond the
program scope?

OHS M&E Focus

Control

Influence
GAPS
Did it work?
How did it work?
Can it improve?

Participation Rate
Net Enrolment
Rate

Activities

Outputs

Policies & Trainings

Curriculum
Learning Modules
Learning mode/system
Assessment Methods

Contribution

No. of OHS Graduates

in College and
Employed

Outcomes

Impacts

Teachers use the

OHS curriculum as
prescribed
Student Learning
Competencies
(OHS vs Regular)

Increase access &

improve quality of
education

Greater
objective

OHSP EVALUATION OBJECTIVES

1) Determine the viability of
OHSP as an ADM strategy.
Why ADM is a very promising strategy?

What works in the OHS system?

DATA: Strengths and success factors of OHSP as a

tipping point for secondary education.

External factors influence

outcomes

OUTPUT:
Training for
OHS
teachers

OUTCOME:
Home
schooled
learners at
par with
regular
students

IMPACT:
Home
schooled
graduates
accepted in
college

2) Investigate the inefficiencies

of OHSP as an ADM system.
What is not currently working in OHSP?
How might the efficiency and effectiveness of OHSP be

improved?
DATA: Weaknesses, gaps, loopholes/bottlenecks in OHSP
Social norms and influence on demand
Legal & policy framework
National budget available
Strong governance framework
Available supply chain & human resources for O&M
Financial barriers at schools

Assess barriers from all angles

Social norms and influence on demand
Legal & policy framework
National budget available
Strong governance framework

Available supply chain & human resources for O&M

Financial barriers at schools
Social, cultural barriers to demand

3) Establish whether the

students of OHSP are
competitive and/or at par with
regular students.
Whats happening to student learning?

How competitive are ADM students/graduates with

regular students/graduates?
DATA: Tracking of student learning outcomes and
OHSP graduates

4) Develop propositions to
improve and adapt the OHSP
for K to 12.
How best to improve the OHS System to adjust it to

the needs of children with specific learning abilities?

How might OHSP be adapted to align with K to 12
reform agenda specifically to Senior High School?
DATA: Action-Recommendations to improve ADM
practice using the OHS system

Data Gathering Methodology

Survey of 300 (out of 855) schools (public and private) with

promising results (adopting OHSP) including schools

which did not take off.
Qualitative /in-depth study using appreciative inquiry to
discover the strengths and potentials of OHSP and/or OST
to investigate the weaknesses and barriers to make OHSP
sustainable and adaptable for K to 12.
Key Informants: School Administrators, Teachers and
Partner Organizations
Survey and/or interview of 400 students (6,179) and
graduates (22,159) of OHSP and the regular High School;
select 3 students per school (i.e., independent and
instructional learners)

Selecting a comparison group

Seek similar characteristics as target group
Similar school size, wealth, public/private, similar

location/climate, similar access to secondary

education
Use national census, other data
Typically done in quasi-experimental way (rather
than pure random selection)

Random selection we are making sure our

sample represents all in terms of age, gender,
SES, and other variables we do not even know to
measure!

Implementation Activities
Consultation with the BSE from concept note to final

report presentation.
Desk review of literature on OHSP as an innovative
ADM solution for improving secondary education.
Preparation of evaluation design with framework,
methodologies to be utilized, scope of evaluation
tasks, instrument preparation, data gathering, plan for
data analysis; selection of key informants and
secondary schools.
Data gathering in sample schools using appreciative
inquiry, open space technology, focus group discussion
and survey instruments.

 Analytical review of the immediate impact and

changes on secondary education services in terms of

program management, teacher and student
performance, competitive advantage OHSP graduates
compared with regular students and other relevant
performance outcomes.
Draft evaluation report for approval.
Preparation of final evaluation report.
Packaging and printing of approved OHSP Evaluation
Report.
Forum to present the OHSP Evaluation findings and
action-recommendations to DepED-BSE officials and
other key project stakeholders.

TIMELINE

DELIVERABLES
Consultation Meetings
Desk Review
Evaluation Design &
Instruments
Data Gathering
Data Consolidation and
Analytical Review
Draft Evaluation Report
Final Evaluation Report
Packaging & printing
Forum on OHSP Viability for
K to 12

TIMEFRAME
beginning July 24, 2012
August, 2012
September 2012
October to December 2012
January 2013
EO January 2012
EO March 2013
EO April 2013
EO June 2013