An Evaluation of the Implementation of the New State Standards

for Mathematics and Problem-based Learning

FRIT 7237

Fall 2017

Stephanie Joyner
Marie Roberson
Amy Nash Shell
Damon Smith
Implementation of Project

Implementation
Implementation Schedule of
Evaluation Person responsible
Questions completion
tools/method

Were the initial ● Pre-project ● October 2011 ● Great

experiences and survey ● June 2015 Southern
follow up activities ● Observation ● January 2016 University
implemented as ● Post-project Faculty
planned? survey

What is the quality of ● Program ● January to ● Project SME -

the initial program review May 2015 NSSM, Math,
activities? ● Teacher ● June 2015 and
questionnaire ● Fall 2015 Instructional
● Mid design and
-implementati technology
on discussion ● Great
Southern
University
Faculty

Who are the program ● Email and ● January to ● Dr. Carlos

participants, and how paper May 2015 Hedges,
were they recruited? advertisement project
of the project director

What is the quality of ● Teacher self- ● Fall 2015 to ● Great

follow up and evaluation January 2016 Southern
support activities? ● Teacher University
interviews Faculty

Were the initial experiences and follow up activities implemented as planned?

To evaluate the fidelity of implementation, several data sources will be consulted. Surveys and

observations conducted prior to, during, and after experiences and activities will reveal a view of

project implementation in its entirety. Faculty from Great Southern University will conduct

observations during the Summer Workshop. The observers will use a checklist with criteria to
ensure trainers and teachers were successful during the workshop. A mid-implementation

meeting will be held to discuss questions and concerns about the program. A debrief meeting

will be held after the program to discuss implementation and outcomes of the project. These

meetings will provide insight into the participants’ perceptions of the effectiveness of training.

What is the quality of the initial program activities?

Prior to the implementation of the program a team of subject matter experts will review the

training materials and agenda. Subject matter experts will give feedback to Great Southern

University Faculty to make sure the project is ready for implementation. Teacher questionnaires

and a mid-implementation meeting will ensure the project met project objectives. The teacher

questionnaire will be based on Kirkpatrick's Model of evaluating the effectiveness of training.

Who are the program participants, and how were they recruited?

Program participants are sixth, seventh, and eighth grade math teachers from Braxton County

School District. The project director will consult with the school district’s director of

professional learning, Ms. Carla Lawton, to recruit the 16 participants needed.

What is the quality of follow up and support activities?

Faculty of Great Southern University will conduct teacher interviews during the Debrief Meeting

after the completion of the program. Teachers will also create a self-evaluation and participate in

a post-project survey that will include questions about the quality of the project.
Summative Evaluation

Objective Indicator Data Source

Create PBL modules for Modules created by teachers Professional development

mathematics based on with the help of the Great workshops
examples from local Southern Faculty Lesson plans created by
businesses and industries teacher
Visits to local business to see
math in context

Create PBL modules, which Modules created by teachers Lesson Plans

addresses NSSM with the help of the Great Observations
Southern Faculty are aligned Wiki
with NSSM

Integrate available PBL contains activities that Technology Integration

instructional technology into use technology effectively Rubric
PBL experiences.

Implement and evaluate the Pre/post survey of PBL Post -evaluation

learning modules created. modules Student work samples

The summative evaluation report will aim to answer the following questions:

● Q1: To what extent were teachers able to develop PBL modules that were connected to

local businesses and industries, aligned with NSSM, and incorporated appropriate uses of

technology? (Objectives 1, 2, and 3)

● Q2: To what extent were teachers able to implement and evaluate those modules?

(Objective 4)

The evaluation will take place at the conclusion of the project and will evaluate the effectiveness

of the PBL modules based on NSSM alignment as well as objective alignment. The data will be

evaluated using data sources such as surveys, observations, rubrics, as well as student work

samples to determine if the PBL resulted in the effective development and implementation of

appropriate modules.
Data Collection Schedule

Data Set Date of collection Instrument Data collected by:

Developed?

Pre-Project Survey October 2011 Yes Great Southern

University Staff

Meeting June 25 No Consultant

Notes/Attendance
Verification

Meeting June 26 No Great Southern

Notes/Attendance University Staff
Verification

Create PBL June 28-29 Yes Teacher Participants

Refine PBL module July 2-July 20 Yes Great Southern

University Staff
Teacher Participants

Self- Evaluation and Fall 2015 No Teacher Participants\

Rubric Great Southern
University Staff

Student Work Fall 2015-Winter No Students participating

Samples 2016 in PBL module

Post Evaluation Fall 2015-Winter No Great Southern

Meeting 2016 University Staff