TA for Developing Your Logic Model: Peak Parent Center ~ PTAC

Brought to you by

Barbara Buswell Beth Schaffner Jacey Tramutt Susan Moore

Fine Tuning your Logic Model Asking the Key Questions

Susan M. Moore Clinical Professor University of Colorado, Boulder

Agenda

Call #3: 11/14/2011~ Refinement with Alignment to Goals and Evaluation Planning Questions & Answers

Alignment with performance measures as well as project measures

The Logic Model tells OSEP and others

What you do? Who you do it with/for? How they benefit? (Useful? Relevant? High Quality?) How you know they benefit? Measurement

What is your RFP saying?

WHO

This priority supports Parent Training and Information Centers (PTIs) in the areas to be served by the centers that will: provide parents of children with disabilities, including low- What income parents, parents of limited English proficient children, and parents with disabilities, with the training and information they need to enable them to participate cooperatively and effectively in helping their children with Why disabilities to (a) Meet developmental and functional goals, and challenging academic achievement goals that have been established for all children; and (b) Be prepared to lead productive, independent adult lives, to the maximum extent possible.
Outcomes

Logic Models RFP D 9&10

(a)

A logic model that depicts, at a minimum, the goals, activities, outputs, and outcomes of the proposed project. A logic model communicates how a project will achieve its outcomes and provides a framework for both the formative and summative evaluations of the project;

More from RFP

A plan, linked to the proposed projects logic model, for a formative evaluation of the proposed projects activities. The plan must describe how the formative evaluation will use clear performance objectives to ensure continuous improvement in the operation of the proposed project, including objective measures of progress in implementing the project and ensuring the quality of products and services;

Logic Model

Using a logic model for planning a sequence of change strategies or activities that cumulatively would achieve the desired multi-level outcomes Ongoing and cyclical evaluation and monitoring of the accomplishment of benchmarks identified for activities in the plans, to allow mid-course corrections and fine tuning Evaluating the effectiveness of the plan in making the intended improvements at the state, services, and family and child levels ww.nectac.org

What is a logic model?...A Framework

If then causal sequence Graphic display Based upon a situations /priorities and assumptions and is influenced by external conditions Critical components: resources, activities, initial outcomes, intermediate outcomes and intended long term results/impact a framework for both the formative and summative evaluations of the project;

Ask Questions

Step 5: Select Performance Measures to

Track Progress

Q: How will you assess your programs

family engagement activities and progress towards desired outcomes?

Asking the right ?s

Activities Outputs
ST Outcome Intermediate Outcome

Long Term Outcomes

How is the program Implemented? Are activities delivered as intended?

Who attended/ did not attend? Did the targeted parents participate?

Did knowledge increase? To what extent did knowledge & skills increase?

To what extent are desired behavior changes occurring? For whom? Why?

To what extent are desired changes occurring? For whom? Under what conditions?

Definition of terms

Formative evaluation is an: Analysis of how program operates, implementation and potential barriersundertaken to inform and improve the program along the way conducted throughout program

Killion, J.,(2008)

Definition of Terms

Summative evaluation is an Analysis to determine outcomes of the program and overall impactstypically at end of program to share overall results with funder Killion, J.,(2008)

What are you evaluating ?

Caution: Evaluation of a series of events is not necessarily program evaluation you need a comprehensive plan E.g.. Workshops might be a staff development event or activity versus A comprehensive, ongoing plan might involve the workshops, ongoing coaching and follow-up, learning labs etcall designed to develop educator knowledge, attitudes and skills

Goals & Objectives Aligned with Specific Activities

Website

Webinars

Newsletter

I:I Parent Advising

Goal: Disseminati on of High Quality Relevant & Useful Information Regarding Current IDEA information to parent of children with disabilities

Workshops

Hotline

Mentors

Why are you evaluating your programs?

To facilitate improvements through analysis of strengths, progress, identification of benefits and barriers To determine merit, worth, and impactoverall effectiveness, expansion, continuation or discontinuation or compare with other programs

Alignment With Outcomes

Conference Feedback _ Formative

Webinar Feedback ~Formative

Newsletter Feedback ~ Summative

Increased knowledge of Procedural Safeguards and IEP Procedures

Annual Survey: Summative Breakout Questions Annual Follow-up PHONE Interviews : Randomized 25 + 25 Summative

Immediate Post Community Workshop Survey ~ Formative

Questions & Answers

??????

Resources & References

http://www.nectac.org http://www.cdc.gov/eval/resources.htm. http://www.uwex.edu/ces/pdande Westmoreland, Lopez, & Rosenberg, (2009) How to Develop a Logic Model for District wide Family Engagement Strategies, Harvard Family Research Project http://www.hfrp.org Killion, J., (2008) Assessing Impact, 2nd Edition, Thousand Oaks: CA, Corwin Press.