Jordan Dueis Carol Bush South Dakota Focus and Priority School Data Analysis and feedback Process Jordan Dueis Carol Bush

Purpose of the Data Analysis and Feedback Gain a deeper understanding of the work being done in South Dakota’s focus and priority schools Provide DOE with an inside look of what supports to offer focus and priority schools. Provide feedback to the schools regarding the implementation of the turnaround plans.

Who Participates? Coaches (School Support Team Members) DOE Title Team SPED Accountability Data Personnel And more! Comprehensive Center Schools! Coaches and schools do not review their own schools Schools attend on a voluntary basis. Began by encouraging Priority districts. Should be admin or a team leader involved in SD LEAP work.

Process Data Analysis Day Coach’s comments for feedback form DOE Accountability Work Group review/comments Getting feedback to the schools Data Analysis day is when all the participants come together to review the SD LEAP work and provide comments Spend on average one hour per school. Who is the DOE work group? Because of all the different players, typically the feedback gets to the schools in about 3 weeks.

Data Analysis Work Day Groupings Introduction for the day Review Evidence Artifacts Rubric Comments Discuss introduction for the day. This is a refresher for those who have been through the process and an introduction for the new participants. We demonstrate the process of reviewing a school’s plan, talking about each piece of evidence and making observations. We will look at the pieces of evidence in more detail in a couple of slides. Rubric will also be shown in upcoming slides

Groupings Teams of 2-3 Each group has no more than 3 schools to review Coaches and school staff are not reviewing their own schools Each group has no more than 3 schools to review We have Coaches who wish to review their own schools but the point was to get an uninfluenced look at what the school is doing and it would be difficult with the fact that some SSTs have 2 schools, some have 7. so we included a place in the feedback for Coaching comments in regards to the feedback.

Preparing for Feedback In order to provide interrater reliability, we wanted everybody to look at the same pieces of evidence. We will look at each piece more closely in the next few slides…

Goal Monitoring Worksheet is now uploaded by the schools into the Document Upload feature. This is the first year SD has used this feature. There may be other pieces of evidence the school uploads and we want to make sure to look at this as well.

Rubric

Feedback Form Then the comments provided on this worksheet are entered into Indistar. We used to enter them directly into Indistar but decided to review the comments and allow the SSTS to provide comments to the schools based on the review teams feedback. This allows us to have DOE provide feedback as well.

Strengths of the process Transparency Mixed members in the review team Review done quarterly so feedback can be used to make changes DOE listened to schools/coaches to revise process to make it more meaningful Training of the process Being able to adjust within Indistar Having the Feedback archived within Indistar, easily accessible Began by reviewing the requirements such as how many active indicators, etc. Now we are digging to the work. Involving a variety of people including the schools. We’ve received great feedback from the schools who have been involved.

Challenges Interrater Reliability Mindset New attendees and training “Hoop Jumpers” Feedback is seen as a “grade” New attendees and training Even when we are all looking at the same pieces of evidence this continues to be a challenge Feedback has been received as “grade” rather than feedback. Changing mindset from monitoring to a continuous improvement process. Who are we doing this for??

Observations or next steps More than 3 schools is difficult Need to intentionally remark on good things that are going on in the schools Schools take this seriously We are all exhausted at the end of the day! Started with groupings of 4-5 people and each group had 4 or 5 schools

Contact information Jordan Dueis Jordan.dueis@state.sd.us (605) 773-4716 Carol Bush Carol.Bush@state.sd.us (605) 773-8065