Beruflich Dokumente
Kultur Dokumente
LESSON 1, ACTIVITY 1
KIRKPATRICK’S LEVELS OF
THEORY OF CHANGE MONITORING AND
EVALUATION OF TRAINING
It is focused in particular on Training evaluation allows
mapping out or “filling in” what programs to determine the extent
What is
has been described as the to which workers are meeting
the main
“missing middle” between what expectations and applying what
interest of
a program or change initiative they learn. Using evidence-based
M&E in
does (its activities or methods strengthens a program’s
each
interventions) and how these ability to provide training that
framework
lead to desired goals being yields expected results.
achieved.
1 ⬄ Reaction
M&E 2 ⬄ Learning
LEVELS 3 ⬄ Behaviors
4 ⬄ Results
LESSON 1, ACTIVITY 2
MONITORING EVALUATION
m Process of objective data collection and e Analysis of information to make judgment that
information gathering that will be used by affects the institution/project/program.
management / leadership e Systematic investigation of the worth or merit
m Purposive gathering of pertinent of an object.”
information relative to how targets and the e Internal assessment of information (which is
manner with which these targets were collected through monitoring) regarding the
achieved extent to which actual progress in
m Systematic observation and implementation conforms to (or deviates from)
documentation of information on the the objectives set in the plan
implementation of initiatives based on the e The process of determining the worth or
plan. significance of a development activity, policy
m “A continuing function that uses or program ….. to determine the relevance of
systematic collection of data on specified objectives, the efficacy of design and
indicators to provide management and the implementation, the efficiency or resource
main stakeholders of an ongoing use, and the sustainability of results.
development intervention with indications e Studies the outcome of a project (changes in
of the extent of progress and achievement income, benefits distribution, cost-
of objectives and progress in the use of effectiveness, etc.)
allocated funds. e A periodic assessment of the efficiency,
m Systematic and continuous collecting, effectiveness, impact, sustainability and
analysis relevance of a project in the context of stated
m Monitoring generates data that can be objectives.
used in evaluations
Common Words from the Common Words from the
definitions above definitions above
Data gathering/ data collection for Assessment, judgement , efficiency of the
monitoring purposes implementation in short – for evaluation
purposes
is the continuing function and systematic the process of determining the worth or
process of collecting, analyzing, significance of the outputs and results in
interpreting, storing of data and reporting terms of: efficiency, relevance, effectiveness
information thereby setting into motion a and sustainability in conformity to the
series of managerial actions, for objectives set in the program design.
ascertaining the realization of set
objectives.
The relationship or link between Monitoring and Evaluation is:
The link between Monitoring and Evaluation is highlighting “Learning” as a main focus or
purpose.
LESSON 2, ACTIVITY 2
ANSWERS FROM YOUR
QUESTION YOUR ANSWER
FELLOW LAC MEMBERS
What M&E data will you Learning Survey Enrolment Survey Forms
need to decide to change or Form (LESF)
make adjustments to the
LDMs of your school?
THOUGHT ORGANIZERS
LESSON 1, ACTIVITY 1
KIRKPATRICK’S LEVELS OF
THEORY OF CHANGE MONITORING AND
EVALUATION OF TRAINING
What is Theory of Change is The Kirpatrick's model is used
the main essentially a comprehensive to evaluate the effectiveness of
interest of description and illustration of a training program in order to
M&E in how and why a desired determine if a training is
each
change is expected to yielding the intended outcomes
framework
happen in a particular and results? In simple terms it
context. It is focused in determines the extent to which
particular on mapping out or the training "hit the mark" in
“filling in” what has been balance to the cost/effort (was it
described as the “missing worth the time, effort and cost
middle” between what a to provide the training). This is
program or change initiative answered differently for each
does (its activities or program but the methods used
interventions) and how these can be applied consistently
lead to desired goals being cross-program.
achieved. It does this by first
identifying the desired long-
term goals and then works
back from these to identify all
the conditions (outcomes)
that must be in place (and
how these related to one
another causally) for the
goals to occur.
⬄
Level 2 Methods used to evaluate
whether participants Learned. This
⬄ example uses two parts to position
context; (the instruction) and
(evaluating learning).
Level 3 Methods used to evaluate
whether the learning that took
place in the classroom transferred
to the workplace. The best method
is work observation, but other
methods include using confidence
intervals and structured interviews.
It is suggested that evaluations are
M&E ⬄ conducted 90 days or more after
LEVELS initial training to determine if the
behaviors have “Stuck.” It is also
suggested that evaluation is
performed using a random sample
of 20 or more. The following is an
example of a structured work
observation rubric that is aligned
to the learning objectives.
Level 4 To what extent did the
training improve
business/performance results
⬄ (ROI/ROE) or in the case of
safety, improved metrics as
evidenced by a decrease in
incidents/accidents, for example.
LESSON 1, ACTIVITY 2
MONITORING EVALUATION
m Process of objective data collection and e Analysis of information to make judgment that
information gathering that will be used by affects the institution/project/program.
management / leadership e Systematic investigation of the worth or merit
m Purposive gathering of pertinent of an object.”
information relative to how targets and the e Internal assessment of information (which is
manner with which these targets were collected through monitoring) regarding the
achieved extent to which actual progress in
m Systematic observation and implementation conforms to (or deviates from)
documentation of information on the the objectives set in the plan
implementation of initiatives based on the e The process of determining the worth or
plan. significance of a development activity, policy
m “A continuing function that uses or program ….. to determine the relevance of
systematic collection of data on specified objectives, the efficacy of design and
indicators to provide management and the implementation, the efficiency or resource
main stakeholders of an ongoing use, and the sustainability of results.
development intervention with indications e Studies the outcome of a project (changes in
of the extent of progress and achievement income, benefits distribution, cost-
of objectives and progress in the use of effectiveness, etc.)
allocated funds. e A periodic assessment of the efficiency,
m Systematic and continuous collecting, effectiveness, impact, sustainability and
analysis relevance of a project in the context of stated
m Monitoring generates data that can be objectives.
used in evaluations
Common Words from the Common Words from the
definitions above definitions above
Monitoring is checking progress against plans. ... Evaluations appraise data and
information that inform strategic decisions, thus improving the project or
programme in the future.
LESSON 2, ACTIVITY 2
ANSWERS FROM YOUR
QUESTION YOUR ANSWER
FELLOW LAC MEMBERS