Beruflich Dokumente
Kultur Dokumente
Table of Contents
Introduction ............................................................................................................................... 3
AdvancED Standards Diagnostic Results .................................................................................... 4
Leadership Capacity Domain............................................................................................................... 4
Learning Capacity Domain .................................................................................................................. 5
Resource Capacity Domain ................................................................................................................. 6
Effective Learning Environments Observation Tool® (eleot®) Results ....................................... 7
eleot Narrative.................................................................................................................................. 11
Findings .................................................................................................................................... 13
Improvement Priorities ..................................................................................................................... 13
Insights from the Review .................................................................................................................. 19
Next Steps......................................................................................................................................... 20
Team Roster ............................................................................................................................. 21
Addenda................................................................................................................................... 23
Student Performance Data ............................................................................................................... 23
Schedule ........................................................................................................................................... 26
Introduction
The AdvancED Diagnostic Review is carried out by a team of highly qualified evaluators who examine the
institution’s adherence and commitment to the research aligned to AdvancED Standards. The Diagnostic Review
Process is designed to energize and equip the leadership and stakeholders of an institution to achieve higher levels
of performance and address those areas that may be hindering efforts to reach desired performance levels. The
Diagnostic Review is a rigorous process that includes the in-depth examination of evidence and relevant
performance data, interviews with stakeholders, and observations of instruction, learning, and operations.
Standards help delineate what matters. They provide a common language through which an education community
can engage in conversations about educational improvement, institution effectiveness, and achievement. They
serve as a foundation for planning and implementing improvement strategies and activities and for measuring
success. AdvancED Standards were developed by a committee composed of educators from the fields of practice,
research, and policy. These talented leaders applied professional wisdom, deep knowledge of effective practice,
and the best available research to craft a set of robust standards that define institutional quality and guide
continuous improvement.
The Diagnostic Review Team used the AdvancED Standards and related criteria to guide its evaluation, looking not
only for adherence to standards, but also for how the institution functioned as a whole and embodied the
practices and characteristics of quality. Using the evidence they gathered, the Diagnostic Review Team arrived at a
set of findings contained in this report.
As a part of the Diagnostic Review, stakeholders were interviewed by members of the Diagnostic Review Team
about their perspectives on topics relevant to the institution's learning environment and organizational
effectiveness. The feedback gained through the stakeholder interviews was considered with other evidence and
data to support the findings of the Diagnostic Review. The following table lists the numbers of interviewed
representatives of various stakeholder groups.
1.1 The institution commits to a purpose statement that defines beliefs about teaching Needs
and learning, including the expectations for learners. Improvement
1.3 The institution engages in a continuous improvement process that produces Needs
evidence, including measurable results of improving student learning and Improvement
professional practice.
1.6 Leaders implement staff supervision and evaluation processes to improve Emerging
professional practice and organizational effectiveness.
1.7 Leaders implement operational process and procedures to ensure organizational Needs
effectiveness in support of teaching and learning. Improvement
1.8 Leaders engage stakeholders to support the achievement of the institution’s Emerging
purpose and direction.
1.9 The institution provides experiences that cultivate and improve leadership Needs
effectiveness. Improvement
1.10 Leaders collect and analyze a range of feedback data from multiple stakeholder Needs
groups to inform decision-making that results in improvement. Improvement
2.1 Learners have equitable opportunities to develop skills and achieve the content Needs
and learning priorities established by the institution. Improvement
2.2 The learning culture promotes creativity, innovation and collaborative problem- Needs
solving. Improvement
2.5 Educators implement a curriculum that is based on high expectations and prepares Needs
learners for their next levels. Improvement
2.7 Instruction is monitored and adjusted to meet individual learners’ needs and the Needs
institution’s learning expectations. Improvement
2.9 The institution implements, evaluates, and monitors processes to identify and Emerging
address the specialized social, emotional, developmental, and academic needs of
students.
2.10 Learning progress is reliably assessed and consistently and clearly communicated. Needs
Improvement
2.11 Educators gather, analyze, and use formative and summative data that lead to Needs
demonstrable improvement of student learning. Improvement
2.12 The institution implements a process to continuously assess its programs and Needs
organizational conditions to improve student learning. Improvement
3.1 The institution plans and delivers professional learning to improve the learning Needs
environment, learner achievement, and the institution’s effectiveness. Improvement
3.2 The institution’s professional learning structure and expectations promote Needs
collaboration and collegiality to improve learner performance and organizational Improvement
effectiveness.
3.4 The institution attracts and retains qualified personnel who support the institution’s Needs
purpose and direction. Improvement
3.7 The institution demonstrates strategic resource management that includes long- Needs
range planning and use of resources in support of the institution’s purpose and Improvement
direction.
3.8 The institution allocates human, material, and fiscal resources in alignment with the Needs
institution’s identified needs and priorities to improve student performance and Improvement
organizational effectiveness.
Every member of the Diagnostic Review Team was eleot certified and passed a certification exam that established
inter-rater reliability. Team members conducted 29 observations during the Diagnostic Review process, including
all core content learning environments. The following charts provide aggregate data across multiple observations
for each of the seven learning environments.
2.4 2.4
2.1
1.8 1.9
1.7
1.2
Environment Averages
Very Evident
Somewhat
Observed
Indicators Average Description
Evident
Evident
Not
Learners engage in differentiated learning opportunities
A1 1.7 55% 21% 21% 3%
and/or activities that meet their needs.
A3 2.8 Learners are treated in a fair, clear, and consistent manner. 3% 24% 62% 10%
Very Evident
Somewhat
Indicators Average Description Observed
Evident
Evident
Not
Overall rating on a 4
point scale:
1.8
Very Evident
Somewhat
Observed
Indicators Average Description
Evident
Evident
Not
Learners demonstrate a sense of community that is
C1 2.3 14% 45% 38% 3%
positive, cohesive, engaged, and purposeful.
Overall rating on a 4
point scale:
2.4
Very Evident
Somewhat
Indicators Average Description Observed
Evident
Evident
Not
D3 2.2 Learners are actively engaged in the learning activities. 17% 48% 31% 3%
Very Evident
Somewhat
Observed
Indicators Average Description
Evident
Evident
Not
Learners monitor their own progress or have
E1 1.3 mechanisms whereby their learning progress is 76% 21% 3% 0%
monitored.
Learners receive/respond to feedback (from
E2 2.1 teachers/peers/other resources) to improve 21% 55% 21% 3%
understanding and/or revise work.
Overall rating on a 4
point scale:
1.7
Very Evident
Somewhat
Indicators Average Description Observed
Evident
Evident
Not
Overall rating on a 4
point scale:
2.4
Very Evident
Somewhat
Observed
Indicators Average Description
Evident
Evident
Not
Learners use digital tools/technology to gather,
G1 1.3 79% 10% 7% 3%
evaluate, and/or use information for learning.
Overall rating on a 4
point scale:
1.2
eleot Narrative
The Diagnostic Review Team conducted 29 classroom observations, providing ample opportunity to observe
learning environments in all core classrooms. Several items emerged in the seven learning environments that
could serve as levers to improve instructional capacity and student learning. The Supportive Learning Environment
and the Well-Managed Learning Environment earned the highest overall average rating of 2.4 on a four-point
scale, while the Digital Learning Environment had the lowest overall average rating of 1.2.
In the Supportive Learning Environment, it was evident/very evident in 51 percent of classrooms that students
were “supported by the teacher, their peers, and/or other resources to understand content and accomplish tasks”
(C3). In 65 percent of classrooms, it was evident/very evident that students “demonstrate a congenial and
supportive relationship with their teacher” (C4). When observing the Well-Managed Learning Environment, it was
evident/very evident in 65 percent of classrooms that students “speak and interact respectfully with teacher(s) and
each other” (F1). It was evident/very evident in 62 percent of classrooms that students “demonstrate knowledge
of and/or follow classroom rules and behavioral expectations and work well with others” (F2). These data revealed
that students were compliant and demonstrated behaviors consistent with a respectful and supportive learning
environment.
While the Digital Learning Environment earned the lowest overall average rating of 1.2 on the four-point scale, the
Diagnostic Review Team was more concerned about the Progress Monitoring and Feedback, High Expectations,
Equitable Learning, and Active Learning Environments. Several items within the Progress Monitoring and Feedback
Learning Environment were of particular concern. For example, it was evident/very evident in three percent of
classrooms that students “monitor their own learning progress or have mechanisms whereby their learning
progress is monitored” (E1) and in seven percent of classrooms that students “understand and/or are able to
explain how their work is assessed” (E4). The team rarely observed students using rubrics or checklists to monitor
their progress or to understand the criteria by which their work would be assessed. This suggested a need for
students to be provided exemplars, rubrics, and explanations to guide their understanding of the attributes of
proficient work.
While high academic expectations were mentioned by teachers and school leaders, the ratings in the High
Expectations Learning Environment were rated low. Instances in which students “demonstrate and/or are able to
describe high quality work” (B3) were evident/very evident in three percent of classrooms. Students who “engage
in rigorous coursework, discussions, and/or tasks that require the use of higher order thinking (e.g., analyzing,
applying, evaluating, synthesizing)” (B4) were evident/very evident in 10 percent of classrooms. The observation
data suggested a need for school leaders to monitor instructional practices that ensure students are engaged in
rigorous tasks requiring higher order thinking.
The Equitable Learning Environment ratings revealed the need for increased opportunities for students to be
engaged in learning activities that meet their needs. It was evident/very evident in 24 percent of classrooms that
students “engage in differentiated learning opportunities and/or activities that meet their needs” (A1). In 14
percent of classrooms, it was evident/very evident that students “demonstrate and/or have opportunities to
develop empathy/respect/appreciation for differences in abilities, aptitudes, backgrounds, cultures, and/or other
human characteristics, conditions and dispositions” (A4). These percentages suggested the need to design
instruction aligned to student needs, including high-yield instructional practices.
Finally, the Active Learning Environment emerged as another area to leverage for improvement. This learning
environment received an overall average rating of 1.9 and had two specific areas of concern: connecting content to
the real-world and creating a collaborative learning environment for students. It was evident/very evident in 13
percent of classrooms that students “make connections from content to real life experiences” (D2). Instances in
which students “collaborate with their peers to accomplish/complete projects, activities, tasks and/or
assignments” were evident/very evident in 21 percent of classrooms (D4). Collectively, these data build upon the
need described above in the High Expectations Learning Environment to provide rigorous tasks connected to
authentic real-world and collaborative learning experiences for students.
By carefully reviewing all items across the seven learning environments, school leaders and staff members can
identify additional areas that can be leveraged to improve instructional capacity and increase student learning.
Findings
Improvement Priorities
Improvement priorities are developed to enhance the capacity of the institution to reach a higher level of
performance and reflect the areas identified by the Diagnostic Review Team to have the greatest impact on
improving student performance and organizational effectiveness.
Improvement Priority #1
Implement and monitor a continuous improvement process that identifies specific goals, a limited number of
manageable strategies, activities, and measures (e.g., incremental benchmarks, data sources to determine the
degree to which goals are attained). Continuously monitor the process to determine adjustments needed to reach
or exceed all goals within the school improvement plan. Establish and communicate stakeholder involvement
needed for a comprehensive plan and identify persons responsible for implementing, monitoring, and revising
each component of the continuous improvement process. (Standard 1.3)
Evidence:
The student survey data revealed that 49 percent agreed with the statement, “My principal and teachers ask me
what I think about school” (G1). The parent survey results indicated that 86 percent agreed/strongly agreed that
“Our school has established goals and a plan for improving student learning” (C3) and that 90 percent
agreed/strongly agreed that “Our school communicates effectively about the school’s goals and activities” (D5).
Additionally, the parent survey data showed that 86 percent agreed/strongly agreed that “Our school ensures that
all staff members monitor and report the achievement of school goals” (G1). A disconnect was observed among
the survey data and interview data related to using the CSIP process to implement, monitor, and revise the
continuous improvement plan.
Improvement Priority #2
Ensure that a complete lesson cycle with research-based practices is followed to deliver quality, first-time
instruction that prompts and supports higher-order thinking skills and active student learning. Develop,
implement, and monitor a systemic process to adjust instruction to meet individual student needs. Collect and
analyze data to identify gaps in student learning and adjust instructional practices to meet student academic
needs. (Standard 2.7)
Evidence:
Many stakeholders indicated concerns about inconsistencies in instruction, assessments, and expectations across
and among grade levels. These data revealed the need to develop specific student goals, using a systematic
process for adjusting instruction to meet individual student needs. The resulting data could be used to change the
belief system of teachers who believe students will remain at the novice level. Additionally, providing a system of
support for students based on specific needs was identified by many parents who reported a need for additional
tutoring time either before or after school to help their child improve academically.
Data from classroom observations and staff interviews suggested that teachers frequently lacked understanding of
how to effectively monitor student learning to inform and adjust instruction to meet differentiated learning needs.
Survey data showed 51 percent of staff members agreed/strongly agreed with the statement, “All teachers in our
school have been trained to implement a formal process that promotes discussion about student learning (e.g.,
action research, examination of student work, reflection, study teams, and peer coaching)” (E10).
Improvement Priority #3
Ensure the effectiveness of professional learning community (PLC) meetings by engaging in activities (e.g., creating
common formative assessments, differentiating student assignments, using upper-level questioning, implementing
small group instruction, planning vertically, reviewing student data, making instructional changes based on data)
that address the needs of students. Monitor implementation of strategies discussed in PLC meetings for impact in
the classroom. Differentiate information introduced within the various PLC grade-level groups. (Standard 3.2)
Evidence:
A district Multi-Tiered System of Supports (MTSS) person was present at the PLC meeting on February 13, 2019.
Discussion ensued to determine whether she would present her information or whether the meeting would be
team-led. It was determined to be team-led. The principal and assistant principal were both present. At one point,
the district support person added necessary instruction to be taught and showed some modeling of the lesson to
be done in the classroom before an independent assignment would be given to students. Collectively, the
interview and observation data indicated a need to differentiate information introduced within the various PLC
grade-level groups and establish specific protocols for operation.
Engagement is the level of involvement and frequency with which stakeholders are engaged in the desired
practices, processes, or programs within the institution. Implementation is the degree to which the desired
practices, processes, or programs are monitored and adjusted for quality and fidelity of implementation. Results
represent the collection, analysis, and use of data and evidence to demonstrate attaining the desired result(s).
Sustainability is results achieved consistently to demonstrate growth and improvement over time (minimum of
three years). Embeddedness is the degree to which the desired practices, processes, or programs are deeply
ingrained in the culture and operation of the institution.
Strengths:
The school operates through a strong belief in the vision and mission. The mission statement, “Touch the heart,
teach the mind,” was referenced as a basis for the school’s work several times by administrators and other
stakeholders. The Diagnostic Review Team observed students enter the school in the mornings and be greeted by
name, hugged, or comforted. Parents indicated that they felt their children were safe and well taken care of at
school. Students reported that their teachers were the best thing about the school. The retention of staff members
was 100 percent last year, providing continuity as the same teachers developed and continued relationships with
the students. Stephen Foster Traditional Academy is at the implementation stage concerning its mission, vision,
and beliefs.
The administration is visible throughout the building, in classrooms, and in PLC meetings. The walkthrough
observations (i.e., “PowerWalk” system) provide teachers with immediate feedback concerning particular criteria
of the lesson being observed. Interviews with staff indicated mostly positive responses about the process. One
teacher said, “I am being observed to death,” which indicated that school leaders frequently monitored
classrooms.
Community partnerships (e.g., area stores, churches, sororities, fraternities) provide support (e.g., school supplies,
snacks, and/or volunteer time) and help the school gather necessary resources.
Stephen Foster Traditional Academy staff members have implemented numerous student behavior programs and
initiatives that are evident in common areas and in most classrooms. Other supports for students who need to cool
down have also been initiated.
Staff members have been awarded the Ron Clark grant, which allows five teachers to attend the Ron Clark
Academy in July 2019. After these teachers attend, the school plans to have them train the remaining teachers.
The Academy provides professional development experiences in school culture, reflection, rigor, and student
engagement that can advance significant changes.
The school designed the PLC model to ensure that students were not only taught, but also to ensure that they
learned, requiring the PLC team to disaggregate common grade-level assessment data and redistribute students
for reteaching in a new way. The PLC groups were based, in theory, upon the four DuFour questions: 1) What do
we want students to learn? 2) How will we know if they have learned? 3) What will we do if they do not learn, and
4) What will we do if they already know it?
While the school had established structures (e.g., professional learning communities, multi-tiered system of
supports [MTSS], faculty meetings) to provide time for teachers to collaboratively review and analyze some
student data, the Diagnostic Review Team suggests that the school focus on non-negotiable items to ensure each
teacher implements quality instruction with fidelity and embeds differentiation and rigor into teaching and
learning. Although the Diagnostic Team observed some research-based teaching practices, instruction in many
classrooms lacked the depth and consistency necessary to promote high levels of student learning. While time
spent achieving behavior objectives was beneficial, the school should build on this investment and focus on
instructional goals. Additionally, instructional time could be maximized by using organized and effective transitions
between classes and by starting classes on time.
An analysis of data indicated the need for a systematic teaching process that uses strategies to meet student
needs, including differentiation in learning tasks. In addition, the team suggests that the school focus on raising the
level of questions posed to students and increase the rigor in instructional activities. The Diagnostic Review Team
encourages the school to use these findings as leverage points for engaging students in differentiated learning
tasks that meet their diverse needs. The Diagnostic Review Team also suggests that school leaders monitor and
adjust strategies that help teachers improve their professional practices.
Next Steps
The results of the Diagnostic Review provide the next step for guiding the improvement journey of the institution
with their efforts to improve the quality of educational opportunities for all learners. The findings are aligned to
research-based criteria designed to improve student learning and organizational effectiveness. The feedback
provided in the Diagnostic Review Report will assist the institution in reflecting on current improvement efforts
and adapting and adjusting their plans to continuously strive for improvement.
Upon receiving the Diagnostic Review Report, the institution is encouraged to implement the following steps:
• Review and share the findings with stakeholders.
• Develop plans to address the Improvement Priorities identified by the Diagnostic Review Team.
• Use the findings and data from the report to guide and strengthen the institution’s continuous improvement
efforts.
• Celebrate the successes noted in the report.
Team Roster
Diagnostic Review Teams comprise professionals with varied backgrounds and professional experiences. All Lead
Evaluators and Diagnostic Review Team members complete AdvancED training and eleot® certification to provide
knowledge and understanding of the AdvancED tools and processes. The following professionals served on the
Diagnostic Review Team:
Addenda
Student Performance Data
Section I: School and Student Proficiency and Separate Academic Indicator Results
Content Area %P/D School %P/D State %P/D School %P/D State
(16-17) (16-17) (17-18) (17-18)
“All Student “All Student Group”
Group”
Reading 3rd 28.7 55.8 35.4 52.3
Plus:
• The percentage of students scoring Proficient/Distinguished in reading increased 6.7 percentage points in
third grade and 6.2 percentage points in fourth grade from 2016-2017 to 2017-2018.
• The percentage of students scoring Proficient/Distinguished increased 1.9 percentage points in fifth-grade
reading and 1.2 percentage points in fifth-grade math from 2016-2017 to 2017-2018.
Delta:
• The percentage of students scoring Proficient/Distinguished was below the state average in all content areas
and at all grade levels in 2016-2017 and 2017-2018.
EL 31.9
Plus:
• Both the math index and the state index in 2017-2018 were 14.5.
Delta:
• The reading index and growth indicator were both below the state index.
Foster
Military
English Learner (EL)
English Learner plus
Monitored
Economically 30.1 22.9 10.1 13.8 8.8
Disadvantaged
Gifted/Talented
Disability-With IEP 10.3 10.3 8.3 0
(Total)
Disability-With IEP 10.3 10.3 8.3 0
(No Alt)
Disability (no ALT) 5.6 5.6
with
Accommodation
Consolidated 31.3 22.8 10.1 11.7 9.1
Student Group
Plus:
• The African-American gap group scored above the All Students group in writing by 0.4 percentage points.
Delta:
• The African-American gap group scored below the All Students group in all content areas, except in writing.
• The Disability group with IEPs (Total) scored below the All Students group in reading, math, science, and social
studies.
• The Disability group with IEPs (No Alt) scored below the All Students group in reading, math, science, and
social studies.
• The Disability group (No Alt) with Accommodations scored significantly lower in reading and math than all
other groups.
• The Consolidated Student Group scored below the All Students group in all content areas.
Schedule
Monday, February 11, 2019
Time Event Where Who
4:00 p.m. – Brief Team Meeting Hotel Conference Diagnostic Review
4:30 p.m. Room Team Members
4:30 p.m. – Principal Presentation Hotel Conference Diagnostic Review
5:15 p.m. Room Team Members
5:30 p.m. – Dr. Meyer Interview – JCPS support for CSI schools Hotel Conference Diagnostic Review
6:00 p.m. Room Team Members
6:00 p.m. – Team Work Session Hotel Conference Diagnostic Review
9:00 p.m. Room Team Members
8:30 a.m. – Continue interviews and artifact review, conduct classroom School Diagnostic Review
4:00 p.m. observations Team Members
11:30 a.m.- Lunch – Team Members eat when it can fit into their individual schedule School Diagnostic Review
12:30 p.m. Team Members
12:30 p.m. – Continue interviews and artifact review, conduct classroom School Diagnostic Review
4:30 p.m. observations Team Members
4:30 p.m. – Team returns to hotel (after dismissal) and has dinner on own
6:00 p.m.
6:00 p.m. – Team Work Session #3 (Agenda provided by Lead Evaluator) Hotel Conference Diagnostic Review
9:00 p.m. Room Team Members
About AdvancED
professionals in the world. Founded on more than 100 years of work in continuous improvement,
AdvancED combines the knowledge and expertise of a research institute, the skills of a management
consulting firm and the passion of a grassroots movement for educational change to empower
Pre-K-12 schools and school systems to ensure that all learners realize their full potential.
©Advance Education, Inc. AdvancED® grants to the Institution, which is the subject of the Engagement Review Report,
and its designees and stakeholders a non-exclusive, perpetual, irrevocable, royalty-free license, and release to
reproduce, reprint, and distribute this report in accordance with and as protected by the Copyright Laws of the United
States of America and all foreign countries. All other rights not expressly conveyed are reserved by AdvancED.