Beruflich Dokumente
Kultur Dokumente
Table of Contents
Introduction ............................................................................................................................... 3
AdvancED Standards Diagnostic Results .................................................................................... 4
Leadership Capacity Domain............................................................................................................... 4
Learning Capacity Domain .................................................................................................................. 5
Resource Capacity Domain ................................................................................................................. 6
Effective Learning Environments Observation Tool® (eleot®) Results ....................................... 7
eleot Narrative.................................................................................................................................. 11
Findings .................................................................................................................................... 13
Improvement Priorities ..................................................................................................................... 13
Insights from the Review .................................................................................................................. 19
Next Steps......................................................................................................................................... 20
Team Roster ............................................................................................................................. 21
Addenda................................................................................................................................... 23
Student Performance Data ............................................................................................................... 23
Schedule ........................................................................................................................................... 26
Introduction
The AdvancED Diagnostic Review is carried out by a team of highly qualified evaluators who examine the
institution’s adherence and commitment to the research aligned to AdvancED Standards. The Diagnostic Review
Process is designed to energize and equip the leadership and stakeholders of an institution to achieve higher levels
of performance and address those areas that may be hindering efforts to reach desired performance levels. The
Diagnostic Review is a rigorous process that includes the in-depth examination of evidence and relevant
performance data, interviews with stakeholders, and observations of instruction, learning, and operations.
Standards help delineate what matters. They provide a common language through which an education community
can engage in conversations about educational improvement, institution effectiveness, and achievement. They
serve as a foundation for planning and implementing improvement strategies and activities and for measuring
success. AdvancED Standards were developed by a committee composed of educators from the fields of practice,
research, and policy. These talented leaders applied professional wisdom, deep knowledge of effective practice,
and the best available research to craft a set of robust standards that define institutional quality and guide
continuous improvement.
The Diagnostic Review Team used the AdvancED Standards and related criteria to guide its evaluation, looking not
only for adherence to standards, but also for how the institution functioned as a whole and embodied the
practices and characteristics of quality. Using the evidence they gathered, the Diagnostic Review Team arrived at a
set of findings contained in this report.
As a part of the Diagnostic Review, stakeholders were interviewed by members of the Diagnostic Review Team
about their perspectives on topics relevant to the institution's learning environment and organizational
effectiveness. The feedback gained through the stakeholder interviews was considered with other evidence and
data to support the findings of the Diagnostic Review. The following table lists the numbers of interviewed
representatives of various stakeholder groups.
1.1 The institution commits to a purpose statement that defines beliefs about teaching Emerging
and learning, including the expectations for learners.
1.3 The institution engages in a continuous improvement process that produces Emerging
evidence, including measurable results of improving student learning and
professional practice.
1.6 Leaders implement staff supervision and evaluation processes to improve Emerging
professional practice and organizational effectiveness.
1.7 Leaders implement operational process and procedures to ensure organizational Emerging
effectiveness in support of teaching and learning.
1.8 Leaders engage stakeholders to support the achievement of the institution’s Meets
purpose and direction. Expectations
1.9 The institution provides experiences that cultivate and improve leadership Emerging
effectiveness.
1.10 Leaders collect and analyze a range of feedback data from multiple stakeholder Emerging
groups to inform decision-making that results in improvement.
2.1 Learners have equitable opportunities to develop skills and achieve the content Needs
and learning priorities established by the institution. Improvement
2.2 The learning culture promotes creativity, innovation and collaborative problem- Needs
solving. Improvement
2.5 Educators implement a curriculum that is based on high expectations and prepares Needs
learners for their next levels. Improvement
2.7 Instruction is monitored and adjusted to meet individual learners’ needs and the Needs
institution’s learning expectations. Improvement
2.9 The institution implements, evaluates, and monitors processes to identify and Needs
address the specialized social, emotional, developmental, and academic needs of Improvement
students.
2.10 Learning progress is reliably assessed and consistently and clearly communicated. Needs
Improvement
2.11 Educators gather, analyze, and use formative and summative data that lead to Needs
demonstrable improvement of student learning. Improvement
2.12 The institution implements a process to continuously assess its programs and Needs
organizational conditions to improve student learning. Improvement
3.1 The institution plans and delivers professional learning to improve the learning Emerging
environment, learner achievement, and the institution’s effectiveness.
3.2 The institution’s professional learning structure and expectations promote Emerging
collaboration and collegiality to improve learner performance and organizational
effectiveness.
3.4 The institution attracts and retains qualified personnel who support the institution’s Needs
purpose and direction. Improvement
3.7 The institution demonstrates strategic resource management that includes long- Meets
range planning and use of resources in support of the institution’s purpose and Expectations
direction.
3.8 The institution allocates human, material, and fiscal resources in alignment with the Meets
institution’s identified needs and priorities to improve student performance and Expectations
organizational effectiveness.
Every member of the Diagnostic Review Team was eleot certified and passed a certification exam that established
inter-rater reliability. Team members conducted 12 observations during the Diagnostic Review process, including
all core content learning environments. The following charts provide aggregate data across multiple observations
for each of the seven learning environments.
2.7
2.4
2.3
1.9 2.0
1.8
1.4
Environment Averages
eleot Narrative
The Diagnostic Review Team collected data in twelve core content classrooms. Data from classroom observations
revealed that students generally were well-behaved and followed classroom rules. For example, in 41 percent of
classrooms, students who “demonstrate knowledge of and/or follow classroom rules and behavioral expectations
and work well with others” (F2) were evident/very evident. Additionally, in 66 percent of classrooms, it was
evident/very evident that “Learners speak and interact respectfully with teacher(s) and each other” (F1).
Conversely, the classroom observation data also showed that most instruction was whole group or center based. It
was evident/very evident in 16 percent of classrooms, for instance, that students “engage in differentiated
learning opportunities and/or activities that meet their needs” (A1). Additionally, it was evident/very evident in 17
percent of classrooms that “Learners demonstrate and/or have opportunities to develop
empathy/respect/appreciation for differences in abilities, aptitudes, backgrounds, cultures, and/or other human
characteristics, conditions and dispositions” (A4).
Another concern of the team was the lack of expectations in most classrooms, as it was evident/very evident in 16
percent of classrooms that students “take responsibility for and are self-directed in their learning.” (B5). The
observation data further revealed that it was evident/very evident in 17 percent of classrooms that students
“engage in rigorous coursework, discussions, and/or tasks that require the use of higher order thinking (e.g.,
analyzing, applying, evaluating, synthesizing)” (B4). It was evident/very evident in 17 percent of classrooms that
students “strive to meet or are able to articulate the high expectations established by themselves and/or the
teacher” (B1). In addition, students who “engage in activities and learning that are challenging but attainable” (B2)
were evident/very evident in 33 percent of classrooms. Collectively, these findings illustrate the need to establish
high academic expectations and implement instruction that embeds the appropriate level of rigor.
Similarly, it was evident/very evident in 8 percent of classrooms that students “understand and/or are able to
explain how their work is assessed” (E4) and “monitor their own progress or have mechanisms whereby their
learning progress is monitored” (E1). In addition, the team noted that students rarely used rubrics or examples of
high-quality work to guide their learning and help them understand the attributes of proficiency. Instances of
students who “demonstrate and/or verbalize understanding of the lesson/content” (E3) were evident/very evident
in 33 percent of classrooms. Finally, observers noted that in 17 percent of classrooms, students who “collaborate
with their peers to accomplish/complete projects, activities, tasks and/or assignments” (D4) were evident/very
evident.
The overall average rating for the Digital Learning Environment was 1.4 on a four-point scale, which made it the
lowest-rated of the seven learning environments. Students who use “digital tools/technology to communicate and
work collaboratively for learning” (G3) were evident/very evident in zero percent of classrooms. Also, instances of
students who use “digital tools/technology to conduct research, solve problems, and/or create original works for
learning” (G2) were evident/very evident in 8 percent of classrooms. The observation data also revealed that in 33
percent of classrooms, it was evident/very evident that students use “digital tools/technology to gather, evaluate,
and/or use information for learning” (G1). The Diagnostic Review Team observed students using technology
individually and in groups with little depth, differentiation, and rigor. The low scores for items within this learning
environment provide an opportunity to systemically increase the depth and breadth of student use of technology
to conduct research, solve problems, and create original work with a level of rigor that is enhanced by these tools.
The Diagnostic Review Team suggests school administration and staff members carefully examine all items to
identify additional areas that can be leveraged to increase instructional capacity and improve student learning. In
addition, each Improvement Priority outlined within this report can help prioritize areas of focus.
Findings
Improvement Priorities
Improvement priorities are developed to enhance the capacity of the institution to reach a higher level of
performance and reflect the areas identified by the Diagnostic Review Team to have the greatest impact on
improving student performance and organizational effectiveness.
Improvement Priority #1
Systematically implement and monitor the adopted curriculum. Ensure faculty and staff are highly skilled in
understanding and delivering rigorous instruction. Ensure instructional practices are based on high expectations
and prepare learners for the next level. (Standard 2.5)
Evidence:
The 2017-2018 student performance data showed that the student growth index in reading was 12 compared to
the state index of 19.7, math was 18.4 compared to the state index of 14.5, and the student growth indicator was
15.2 compared to the state growth index of 17.1. The math growth index of Maupin Elementary was higher than
the state growth index for 2017-2018.
The percentage of students who scored Proficient/Distinguished in third-grade reading in 2016-2017 was 19
percent but declined to 8.9 in 2017-2018. However, 2017-2018 reading performance data showed fourth-grade
increased from 8.1 percent to 17 percent from 2016-2017 to 2017-2018, and fifth-grade increased from 5.9
percent to 16.4 percent during the same time.
The survey data indicated that 78 percent of parents agreed/strongly agreed that “My child knows the
expectations for learning in all classes” (E10). Eighty-nine percent of parents agreed/strongly agreed that “My child
is given multiple assessments to measure his/her understanding of what was taught” (E12). The student survey
data showed that 86 percent agreed with the statement, “In my school I am learning new things that will help me”
(C2), and 90 percent of students agreed that “My teachers help me learn things I will need in the future” (E1).
Additionally, 91 percent of students agreed that “My teachers tell me how I should behave and do my work.” (E4).
The Diagnostic Review Team observed disconnect amongst the survey, interview, and classroom observation data
related to using data-driven instructional strategies that engage students in rigorous activities and higher-order
thinking skills.
Improvement Priority #2
Establish clear and concise expectations for all staff. Monitor instructional practices to include differentiation to
meet the need of students. Include formal guidelines for the expectations of the instructional process, meaningful
engagement of all students, and a system to ensure instruction is adjusted to meet individual student needs.
(Standard 2.7)
Evidence:
Students who “use digital tools/technology to communicate and work collaboratively for learning” (G3) were
evident/very evident in zero percent of classrooms. Also, instances of students who “use digital tools/technology
to conduct research, solve problems, and/or create original works for learning” (G2) were evident/very evident in 8
percent of classrooms. It was evident/very evident in 33 percent of classrooms that students “use digital
tools/technology to gather, evaluate, and/or use information for learning” (G1).
The survey data indicated that 81 percent of parents agreed/strongly agreed that “All of my child's teachers use a
variety of teaching strategies and learning activities” (E3) and 87 percent of parents agreed/strongly agreed that
“All of my child's teachers meet his/her learning needs by individualizing instruction” (E4). Student survey data
showed that 86 percent of students agreed with the statement, “In my school I am learning new things that will
help me” (C2), and 90 percent agreed that “My teachers help me learn things I will need in the future” (E1).
Additionally, 91 percent of students agreed that “My teachers tell me how I should behave and do my work.” (E4).
The Diagnostic Review Team observed disconnect amongst the survey, interview, and classroom observation data
related to using data-driven instructional strategies that engage students in rigorous activities and higher-order
thinking skills.
Improvement Priority #3
Design and implement a process for teachers to develop, analyze, and use formative and summative assessments
based on the Kentucky Academic Standards. Create a protocol for all instructional staff to engage in data analysis
and data-based instructional decision-making that leads to improved student learning. (Standard 2.11)
Evidence:
The parent survey data showed that 89 percent of parents agreed/strongly agreed that “My child is given multiple
assessments to measure his/her understanding of what was taught” (E12). The data revealed that 82 percent of
staff members agreed/strongly agreed that “Our school uses multiple assessment measures to determine student
learning and school performance” (G1). Also, the survey data indicated that 64 percent of staff members
agreed/strongly agreed that “Our school employs consistent assessment measures across classrooms and courses”
(G2) and “Our school ensures all staff members are trained in the evaluation, interpretation, and use of data” (G4).
The survey data revealed that 93 percent of staff members agreed/strongly agreed that “Our school leaders
monitor data related to student achievement” (G6). Finally, survey data showed that 82 percent of staff members
agreed/strongly agreed with the statement, “Our school uses data to monitor student readiness and success at the
next level,” (G5).
how instructional programs, resources, and practices were evaluated for effectiveness. Additionally, there was
minimal evidence that showed longitudinal results were used to evaluate instructional programs and
organizational practices to determine the impact on student learning. Although there was evidence that the school
used multiple instructional programs, the team found no evidence suggesting a formalized cycle and timeline
existed to evaluate academic and organizational programs and services.
Engagement is the level of involvement and frequency with which stakeholders are engaged in the desired
practices, processes, or programs within the institution. Implementation is the degree to which the desired
practices, processes, or programs are monitored and adjusted for quality and fidelity of implementation. Results
represent the collection, analysis, and use of data and evidence to demonstrate attaining the desired result(s).
Sustainability is results achieved consistently to demonstrate growth and improvement over time (minimum of
three years). Embeddedness is the degree to which the desired practices, processes, or programs are deeply
ingrained in the culture and operation of the institution.
Strengths:
Parents, teachers, support staff, and the administrative team at Maupin Elementary School demonstrated a sense
of pride for their school and community. Staff members expressed commitment to and deeply cared about their
students. The principal was focused on creating a positive school culture to lessen the impact of a high rate of
poverty and transient student populations and that is based on her belief that all students are valued and can
learn. District administrators, staff members, parents, and students all expressed confidence and support for the
school leadership team and were optimistic that the school was working to establish high expectations for all
students. The Diagnostic Review Team observed a well-maintained and aesthetically pleasing facility. Many
resources were available at the school, which allowed the leadership team to implement different programs and
provided teachers with additional support to help them meet the unique needs of their individual students.
Students were treated in a fair and consistent manner.
School leaders are encouraged to establish and implement systematic processes that monitor and adjust student
behavior and the level of instruction necessary to meet the individual needs of students and the learning
expectations of the school. The processes should be based on the rigor of Kentucky Academic Standards, current
research regarding the effectiveness of instructional practices and student learning needs, and schoolwide positive
behavioral management. The processes could include frequent classroom observations; consistent, meaningful
and targeted feedback; follow-up observations and ongoing support; data-driven decisions to identify and address
individual student academic needs and positive student behaviors.
While many positive initiatives were being implemented, the Diagnostic Review Team encourages stakeholders to
focus on a few priorities with consistent monitoring and data analysis to inform instructional improvements and
achieve the desired outcomes. Additionally, streamlining and formalizing the PLC process to ensure standard
mastery through assessment reviews and adjustments to instruction would potentially provide for immediate,
positive, and productive collegial experiences. Developing next steps, monitoring the fidelity of implementation,
and evaluating effectiveness provides for optimal opportunities for professional growth and increased student
achievement and acceptable student behavior. A systemic approach would allow for continual connections,
consistent implementation of research-based and rigorous instructional practices, reliable and actionable data
analysis, and consistent student programing and high-yield strategies for instructional success. Documentation of
processes, monitoring, and evaluation provides for replicable outcomes and situational adjustments as desired.
Next Steps
The results of the Diagnostic Review provide the next step for guiding the improvement journey of the institution
with their efforts to improve the quality of educational opportunities for all learners. The findings are aligned to
research-based criteria designed to improve student learning and organizational effectiveness. The feedback
provided in the Diagnostic Review Report will assist the institution in reflecting on current improvement efforts
and adapting and adjusting their plans to continuously strive for improvement.
Upon receiving the Diagnostic Review Report, the institution is encouraged to implement the following steps:
• Review and share the findings with stakeholders.
• Develop plans to address the Improvement Priorities identified by the Diagnostic Review Team.
• Use the findings and data from the report to guide and strengthen the institution’s continuous improvement
efforts.
• Celebrate the successes noted in the report.
Team Roster
Diagnostic Review Teams comprise professionals with varied backgrounds and professional experiences. All Lead
Evaluators and Diagnostic Review Team members complete AdvancED training and eleot® certification to provide
knowledge and understanding of the AdvancED tools and processes. The following professionals served on the
Diagnostic Review Team:
Addenda
Student Performance Data
Section I: School and Student Proficiency and Separate Academic Indicator Results
Content Area %P/D School %P/D State %P/D School %P/D State
(16-17) (16-17) (17-18) (17-18)
“All Student Group” “All Student Group”
rd
Reading 3 19 55.8 8.9 52.3
Plus
• The percentage of students who scored Proficient/Distinguished in fourth-grade reading increased by 8.9
percentage points from 2016-2017 to 2017-2018.
• The percentage of students who scored Proficient/Distinguished in fifth-grade reading increased by 10.5
percentage points from 2016-2017 to 2017-2018.
• The percentage of students who scored Proficient/Distinguished in fourth-grade math increased by 6.9
percentage points from 2016-2017 to 2017-2018.
• The percentage of students who scored Proficient/Distinguished in fifth-grade math increased by 3.5
percentage points from 2016-2017 to 2017-2018.
• The percentage of students who scored Proficient/Distinguished in fifth-grade writing increased by 12.7
percentage points from 2016-2017 to 2017-2018.
Delta
• The percentage of students who scored Proficient/Distinguished was below the state average in all content
areas in all grade levels in 2016-2017 and 2017-2018.
EL N/A 31.9
Plus
• The growth index for math was above the state index by 3.9 points in 2017-2018.
Delta
• The growth index for reading was below the state index by 7.7 points in 2017-2018.
• The growth indicator was below the state indicator by 1.9 points in 2017-2018.
Plus
Delta
• The percentage of students in the Disability-with IEP (Total) group who scored Proficient/Distinguished in
reading was 8.3 percent and in math was 8.3 percent in 2017-2018.
• The percentage of students in the Disability-with IEP (No Alt) group who scored Proficient/Distinguished in
reading was 8.3 percent and in math was 8.3 percent in 2017-2018.
• The percentage of students in the Female group who scored Proficient/Distinguished in math was 3.8 percent,
in science was 7.7 percent, and in social studies was 3.2 percent in 2017-2018.
• The percentage of students in the Male group who scored Proficient/Distinguished in math was 8.9 percent, in
science was 4.8 percent, in social studies was 8.3 percent, and in writing was 8.3 percent in 2017-2018.
• The percentage of students in the African-American group who scored Proficient/Distinguished in math was
3.5 percent, in science was 7 percent, and in social studies was 2.1 percent in 2017-2018.
• The percentage of students in the Title 1 group who scored Proficient/Distinguished in math was 6.3 percent,
in science was 6.4 percent, and in social studies was 5.5 percent in 2017-2018.
• The percentage of students in the Economically Disadvantaged group who scored Proficient/Distinguished in
math was 5.3 percent in 2017-2018.
Schedule
Monday, March 4, 2019
Time Event Where Who
4:00 p.m. Brief Team Meeting Hotel Diagnostic
Conference Review Team
Room Members
5:00 p.m.– Principal Presentation Hotel Diagnostic
5:45 p.m. Conference Review Team
Room Members
5:50 p.m.– Team Work Session #1 Hotel Diagnostic
9:00 p.m. Conference Review Team
Room Members
About AdvancED
professionals in the world. Founded on more than 100 years of work in continuous improvement,
AdvancED combines the knowledge and expertise of a research institute, the skills of a management
consulting firm and the passion of a grassroots movement for educational change to empower
Pre-K-12 schools and school systems to ensure that all learners realize their full potential.
©Advance Education, Inc. AdvancED® grants to the Institution, which is the subject of the Engagement Review Report,
and its designees and stakeholders a non-exclusive, perpetual, irrevocable, royalty-free license, and release to
reproduce, reprint, and distribute this report in accordance with and as protected by the Copyright Laws of the United
States of America and all foreign countries. All other rights not expressly conveyed are reserved by AdvancED.