SCC/MLA 2007

Albuquerque, New Mexico

Library
Assessment:
From
Accountability
to
Improvement
Introduction
•Instructors
Tell us:
•Agenda Name
What you do
•Objectives Where you work
Complete this sentence:
•Attendees One year from today I will ………….
Pre-Test
Section 1: Overview
Why are we here today?
• Background
• Evaluation
• Assessment outputs
Impacts
outcomes
inputs

Library
It’s about CHANGE.
Assessment
Is it evaluation or is it
assessment?
Program Evaluation
• Efficiency • Inputs
• Effectiveness • Outputs
• Accountability • Outcomes
• Impact
Is this Library Assessment?

How do you measure your library’s success? Is it circulation numbers? Is it the number of
patrons? The number of searches of your electronic databases? – Stranton Lloyd
Outcomes Evaluation and
Outcomes Assessment
Question has changed
• From What have we done to accomplish
our goals
• To What has changed as a result of our
work
Library Assessment
“Old” Measures “New” Measures
• Program Evaluation • Quality (e.g., service)
• Efficiency • Learner Performance
• Accountability • Improvements in
• Statistics, numbers, Student Learning
data
“Regardless of the specific strategy selected by the institution, assessment strategies and methods should be adapted
to the unique context of the institution to produce multiple indices of quality and effectiveness….” – Hernon and
Dugan, 2004
“Library assessment” is….
• Definitions
• Perspectives
• Experts
Why should we care about
assessment?

• Mouse cages
• Ejournals
A Check
:-/ >:/
confused bring it on
Break
Section II: Library Assessment in
Higher Education
• Primary performance indicator
• Differences among inputs, outputs, and
outcomes
Activity 1
Student Learning Outcomes
and Technology
Outcomes Assessment and
Service Quality
• Assessing Organizations
• Assessment Tools
• LibQUAL+
LibQUAL+™
• The LibQUAL+™ Premise
• What is service quality?
• Definition: difference between what
customers expect and their perceptions of
the service performance.
Bar Charts
2007
9
Core Questions Dimensions Summary

7
Mean

4
Affect of Information Library as Overall
Service Control Place

Dimension
Quantitative and Qualitative
Elements
• LibQUAL+™ Comments
Content Analysis and Atlas.ti
• Data file,Descriptive
Statistics,Reliability, and SPSS
 A Tool
“LibQUAL+™ is ‘another tool in the box’…
it complements other information you
have about service performance and
quality” (Hiller)

Note: After the Radar Chart, Steve Hiller, 2002.

Collecting statistics begins the
road trip.
Defusing Statistics
Developing an Assessment Plan

Assessment Plan
Columbia University Libraries
2007 through 2009
 The Assessment Cycle

Gather Evidence Interpret Evidence

Mission/Purposes
and
Objectives

Repeat the assessment cycle

after changes have been Identify Outcomes Implement Change
implemented.

Source: Hernon and Dugan, 2004

Obstacles to Assessment
• No single model
• How do AHSL’s show impact? Improved healthcare,
reduced costs, increased access to health information?
• Lack of adequate data-gathering systems
• Hard to compare results from disparate data sources
• Lack of staff skills
• No support from library leadership
The Value of Information
• How do you quantify the value of
information?
• What is the return on investment (ROI)?
• Worth Their Weight
Successful Assessment
• Staff training
• Technical support and systems
• Focus on processes/services, not individuals
• Select the appropriate measures
• Realistic scope and schedules
• Senior leadership support
• Results are used in decision-making
A Culture of Assessment
• Decision based on facts, research, and
analysis
• Staff are informed about results
• Change occurs based on results
Pulling it Together
• The 21st Century Library is very different!
• User-centered libraries
• Outcomes assessment is complex
• Evaluation and assessment focus on user/customer
outcomes
• Assessment Toolbox
Do you have a culture of
assessment?
Resources
• Our Ning
By the end of this session you will be able to:

• Define “culture of assessment”

• Provide an example of an input, output, impact, and
outcome
• Explain how assessment differs from evaluation
• List two examples of student learning objectives
• List two tools useful in library assessment
• Describe two obstacles to assessment
• List two elements to include in an assessment plan
• Be able to access the 2007 SCC/MLA CE Course Ning
“…accountability has shifted from ‘are we spending our money
efficiently and wisely’ to ‘what difference does the library make?’”
– Steve Hiller

“The information acquired through library assessment is used in an

iterative manner to improve library programs and services and make
libraries responsive to the needs of their communities.”
– Steve Hiller

Photo source: Charlotte Self

Thank you.
• Other resources
• URL for Ning: http://libassess.ning.com/
• Class Evaluation
• Survey