Measuring Learning

Impacts

Prepared By: Imran Khalid

Manager L&D - AFAQ
 What would you like to take home from this
training today?
After attending this session you would be able to understand following
concepts;
 Introduction to course
 Evaluation and Feedback Exchange
 Commonly Used Evaluation Models
 Kirkpatrick Model of Measuring Learning
 Other Evaluation Approaches Contributing to Measuring
Learning
 Application in Measuring Learning Results
 Course Wrap Up
 Measuring Learning Results
Evaluation is important to the learner, the learning professional, and the
organization. Without a strategy for evaluation, how do you know if
learning programs are achieving their intended objectives? Explore the
importance of collecting and exchanging feedback to improve learning
programs.

This course provides the learning professional with useful tools,

processes, and principles that create the foundation for determining
what the learner actually learns. Participants are also introduced to
ideas for how to use the evidence of learning results.
 Measuring Learning Results…
Only by evaluating learning experiences and measuring their results
can you determine if you are having an impact on your learners and
your organization.

Only 29% of organizations measure application and implementation of

learning programs to the highest extent. Only 17% measuring the
business impact of learning to the highest extend.
 Beginning with the Ending in Mind
The andragogical instructor prepares in advance a set of
procedures for involving the learners and other relevant
parties, evaluating the learning outcomes and re-diagnosing
learning needs.
 Teaching, Training and Facilitating

Training

Facilitation Trainees can learn a great Teaching

deal from each other AND
Bringing out and the trainer;
focusing the wisdom Equal focus on knowledge, Telling the students
of the group, often as the skills, attitudes about new skills and
group creates something knowledge;
new or solves a problem teacher plays active
role and students
Presented is not the participate only as
subject matter expert directed by teacher
 Teaching, Training and Facilitating…

Facilitation Training Teaching

 Understanding Adult Learner
"Pedagogy" literally means "leading children.“

"Andragogy" was a term coined to refer to the art/science of teaching

adults.

"the art and science of helping adults learn," andragogy has come to be
understood as an alternative to pedagogy; a learner-focused approach for
people of all ages.

Pedagogy can also be thought of as "teacher-centered or directive"

learning, and andragogy as "learner-centered/directed."
 Understanding Adult Learner…
The Adult Learning Cycle

Practice, Refine, Teach EXPERIENCING Observe, Absorb, Comprehend

1

APPLYING PROCESSING
4 2

Re-think, Relate, Review, Discuss, Assess

Conclude
GENERALIZING
3
Understanding Adult Learner…
Knowles four andragogical assumptions are that adults:

1) Move from dependency to self-directedness;

2) Draw upon their reservoir of experience for learning;
3) Are ready to learn when they assume new roles; and
4) Want to solve problems and apply new knowledge immediately.
 Understanding Adult Learner…
Andragogy asserts that adults learn best when

 They feel the need to learn

 They have some input into what, why, and how they learn
 They have as much autonomy as possible
 Their learning styles are taken into account
 There is a cooperative learning climate
 We create mechanisms for mutual planning
 We design sequential activities for achieving the objectives
 The learning climate minimizes anxiety and encourages freedom to experiment.
 Learning Styles
What is the route of transfer of knowledge from one source e.g. a person or
a book etc. to another source e.g. a person or a computer or some other
medium?

smelling OR seeing OR tasting OR touching OR hearing

And in the next stage we form relations in our brain and test the newly
delivered knowledge from the perspective of our previous knowledge and
other factors that we are already learned about.

There are further stages which make us accept, reject, retain or unlearn this
learning.
 Learning Styles…

Visual Learners: Visual learners learn best through seeing.

These learners need to see body language and facial
expression to fully understand content.
Auditory Learners: Auditory learners learn best through
hearing. Verbal lectures, discussions, processing information
through conversation and listening to what others have to say
are their preferred methods of learning.
Kinesthetic Learners: Kinesthetic Learners, also known as
tactile learners, learn best by physically experiencing
dynamics or manipulating objects in their environment. They
prefer to actively explore the physical world around them.
 Obstacles to Learning
Learning & Development Professionals encounter participants who are
resistant to learning. This resistance can be caused by external or
internal factors.
 Low Tolerance for Change
 Lack of Trust
 Peer Group Pressure
 Lack of Intercultural Communication
 Evaluation and Feedback Exchange
Adults take in information from various sources every day. As learning
professionals, how can we know what information is derived from actual
learning experiences? By measuring learning, we are able to determine
what the learner knows and demonstrates as a result of a learning
experience.

Evaluations should start at the very

beginning because, if you don’t know
what success looks like before you begin,
you will never ever know if you really
got there.
 Evaluation and Feedback Exchange…
What is Learning Evaluation?

Successful learning experiences are made possible through careful planning

and development that takes place long before the learning experience
occurs. Evaluation is performed throughout that process as well as after the
experience.
“Organizations are always searching for ways to demonstrate the
increasing value of training . . . . Although many are taking the initial steps
to achieve excellent learning evaluation for their training programs, there
is still much ground to cover in their pursuit to master the measurement
techniques and to overcome the challenges they face”
 Evaluation and Feedback Exchange…
Activity: Gathering and Interpreting Feedback

Gathering and Interpreting Feedback is not an exact science, but there are some
basic parameters that can guide you. Read each question to learn more about who,
what, when, and how of the exchange of feedback.

Whose feedback is important to

What can the feedback tell us?
collect?

When should we collect How should we collect the

feedback? feedback?
 Evaluation and Feedback Exchange…
Activity: Gathering the Right Feedback

Look at the sheet provided to you, these are all things you might want to know
about learning experience. Who is the best person to give you this kind of
feedback? You have to attempts to complete this exercise.
Methods for collecting Feedback
There are various ways feedback feedback can be collected and exchanged.

• User Testing
• Stakeholder’s Review
• Pilot Testing
• A/B Testing
• Surveys
• Interviews
 Learning Styles…

Visual Learners: Visual learners learn best through seeing.

These learners need to see body language and facial
expression to fully understand content.
Auditory Learners: Auditory learners learn best through
hearing. Verbal lectures, discussions, processing information
through conversation and listening to what others have to say
are their preferred methods of learning.
Kinesthetic Learners: Kinesthetic Learners, also known as
tactile learners, learn best by physically experiencing
dynamics or manipulating objects in their environment. They
prefer to actively explore the physical world around them.
 Learning Styles…

Visual Learners: Visual learners learn best through seeing.

These learners need to see body language and facial
expression to fully understand content.
Auditory Learners: Auditory learners learn best through
hearing. Verbal lectures, discussions, processing information
through conversation and listening to what others have to say
are their preferred methods of learning.
Kinesthetic Learners: Kinesthetic Learners, also known as
tactile learners, learn best by physically experiencing
dynamics or manipulating objects in their environment. They
prefer to actively explore the physical world around them.
 Beginning with the Ending in Mind
The andragogical instructor prepares in advance a set of
procedures for involving the learners and other relevant
parties, evaluating the learning outcomes and re-diagnosing
learning needs.