District Evaluation of MTSS RtI Innovations 2016 Anna Harms & Jose Castillo.

Slides:



Advertisements
Similar presentations
Consensus Building Infrastructure Developing Implementation Doing & Refining Guiding Principles of RtI Provide working knowledge & understanding of: -
Advertisements

Notes by Ben Boerkoel, Kent ISD, based on a training by Beth Steenwyk –
The Massachusetts Model System for Educator Evaluation Training Module 5: Gathering Evidence August
CA Multi-Tiered System of Supports
Webinar #1 The Webinar will begin shortly. Please make sure your phone is muted. (*6 to Mute, #6 to Unmute) 7/3/20151.
Customer Focus Module Preview
Washington State Teacher and Principal Evaluation Project Preparing and Applying Formative Multiple Measures of Performance Conducting High-Quality Self-Assessments.
1 Let’s Meet! October 13,  All four people have to run.  The baton has to be held and passed by all participants.  You can have world class speed.
1 Ohio’s Entry Year Teacher Program Review Ohio Confederation of Teacher Education Organizations Fall Conference: October 23, 2008 Presenter: Lori Lofton.
FewSomeAll. Multi-Tiered System of Supports A Comprehensive Framework for Implementing the California Common Core State Standards Professional Learning.
Understanding the Standards We Teach – English Language Arts.
PBIS Data Review: Presented by Susan Mack & Steven Vitto.
Assess the effectiveness of strategies Analyze that evidence/data Identify the most powerful teaching strategies Identify and gather evidence/data of student.
Necessary Conditions. Washington Education Association Educational Service Districts Association of Washington School Principals Washington Association.
Introduction to Coaching School-Wide PBS:RtIB. 2 Agenda PBS:RtIB Brief Overview Coaching Tier 1 Coaching Skills and Activities Resources and Barriers.
1. Housekeeping Items June 8 th and 9 th put on calendar for 2 nd round of Iowa Core ***Shenandoah participants*** Module 6 training on March 24 th will.
Designing Local Curriculum Module 5. Objective To assist district leadership facilitate the development of local curricula.
Notes by Ben Boerkoel, Kent ISD, based on a training by Beth Steenwyk.
Suggested Components of a Schoolwide Reading Plan Part 1: Introduction Provides an overview of key components of reading plan. Part 2: Component details.
Brief Overview of Response to Intervention within Glenbrook South Andy Piper & Lindsay Schrand NSSED Problem-Solving Coaches.
1 NH PACE Tier 2 Leadership PLC Session 1 September 28, 2015.
Aligning Academic Review and Performance Evaluation AARPE Session 5 Virginia Department of Education Office of School Improvement.
Welcome To Implementation Science 8 Part Webinar Series Kathleen Ryan Jackson Erin Chaparro, Ph.D University of Oregon.
Leadership Teams Implementing PBIS Module 14. Objectives Define role and function of PBIS Leadership Teams Define Leadership Team’s impact on PBIS implementation.
Vermont Integrated Instruction Model (ViiM) Highlights August 2012.
Kansas Multi-Tier System of Supports: Living a Culture of Engagement.
Module 6.0: Communication Protocol DIT Installation Series Trainer Name Date.
Module 8.0: Selection Process for Effective Innovations DIT Installation Series Trainer Name Date.
Exploration and Readiness Work for a Collaborative Partnership: Session 3 Trainer Name January, 2013.
Module II Creating Capacity for Learning and Equity in Schools: The Mode of Instructional Leadership Dr. Mary A. Hooper Creating Capacity for Learning.
Coaching Critical Feature: Organization Soraya Coccimiglio MiBLSi Content Development Specialist Kalamazoo Regional Educational Service Agency November.
+ Minding the Gap: Data-Based Problem Solving Summer Leadership Conference August 2016.
Bell Ringer Please sit at your assigned table with your team Use the chart paper and markers provided to create a summary of who your team is, the work.
1 Review District Installation Checklist within MIDATA and update status of any incomplete items Create action items to address any items that.
PLC Year 2 Day 2 Inquiry Cycle
Module 6: Coaching System
SAM (Self-Assessment of MTSS Implementation) ADMINISTRATION TRAINING
MiData Innovation in Data Collection and Analysis March, 2014
Module 4: Structuring the District Implementation Team for Success
Module 1: Overview, Assumptions, and Stages of Change/Implementation
Module 5: Communication Plan and Process for Addressing Barriers
Pre-Reading Assignment
Coaching and Supervision:
Module 8: Effective Innovation Review and Selection Process
Module 7: Effective Innovation Alignment
Linking Communication Protocols
Module 1: Introduction to Terminology and Implementation Research
Florida’s MTSS Project: Self-Assessment of MTSS (SAM)
Data Coordination in Action
New Goal Clarity Coach Training October 27, 2017
TAIS Overview for Districts
RtI Innovations: Evaluation Anna Harms & Jose Castillo
SAPSI-S PEP Overview I-RtI Network December, 2012
Component 4 Effective and Reflective Practitioner
How…? Implementation Science
Miblsi.cenmi.org Helping Students Become Better Readers with Social Skills Necessary for Success Steve Goodman Funded through OSEP.
M.A.T.C.H. Professional Series: Module 11
RtI Coordination: Supporting Training
Chicago Public Schools
Systemic Student Support (S3) Academy
Module 3: Implementation
Preparing to Use This Video with Staff:
Analyzing Student Work Sample 2 Instructional Next Steps
What is PACE EH? PACE EH is a process for assessing and analyzing the environmental health of communities and for creating plans to address threats and.
Critical Element: PBIS Team
School-Wide Positive Behavioral Interventions and Supports (SWPBIS)
Facilitated/Presented by:
Instructional Plan and Presentation Cindy Douglas Cur/516: Curriculum Theory and Instructional Design November 7, 2016 Professor Gary Weiss.
Draft Charter Community of Practice for Direct Access Entities
Presentation transcript:

District Evaluation of MTSS RtI Innovations 2016 Anna Harms & Jose Castillo

Who We Are Anna Harms Evaluation & Research Coordinator for Michigan’s Integrated Behavior & Learning Support Initiative Jose Castillo Currently - Evaluation Coordinator for the FL PS/RtI Project Previously - RtI Coach in a FL school district

Introductions Share with others at your table: Name Why you selected this session Where you work How you’re involved with the evaluation of MTSS

Agenda & Objectives AgendaObjectives Discussions from the online modules Establish a foundation for today’s session Evaluation planning Cameo from Florida District Capacity Assessment (DCA) Explore how the evaluation of MTSS fits into the work of a district implementation team -Communication -Evaluation questions -Access to data -Process for data-based decision making -Reporting

DISCUSSIONS FROM THE ONLINE MODULES Establish a foundation for today’s session

District MTSS Evaluation Strand Format Pre-recorded online modules In-person discussion and activities Scope and sequence Module 1: Overview, Assumptions, and Stages of Change/Implementation Module 2: Exploration/Adoption and Installation Module 3: Initial Implementation: Illustration of District MTSS Evaluation, Elaboration, Continuous Regeneration

Online Module Check-In Did you view Module 1? Module 2? Module 3? Detailed feedback can be provided to us individually and through the session evaluation survey ( ).

Partner Activity: Assumptions Consider the assumptions presented regarding evaluating MTSS implementation at the district level Which assumptions do you agree with? For which assumptions do you disagree? How might differences in people’s assumptions regarding MTSS and evaluation create variations in the implementation and evaluation of MTSS?

Stages of Change/Implementation Should we do it? Exploration/Ad option Consensus Work to do it right! InstallationInfrastructure Initial Implementation Implementation Work to do it better! Elaboration Continuous Regeneration “It” is the district evaluation of MTSS.

Discuss as a table: Exploration/Adoption What are some of the successful strategies you have used to ensure readiness for evaluating MTSS? What could you do differently to support readiness for evaluating MTSS? Select 1 idea to share with the whole group

EVALUATION PLANNING Cameo from Florida

DISTRICT CAPACITY ASSESSMENT DCA

District Capacity Assessment The primary purpose of the District Capacity Assessment (DCA) is to assist school districts to implement effective innovations that benefit students. The capacity of a district to facilitate building-level implementation refers to the systems, activities, and resources that are necessary for schools to successfully adopt and sustain Effective Innovations. Focus in this session: Access to data & using data for decision making Communication & reporting DCA Administrator Short Course: capacity-assessment-dca capacity-assessment-dca

Activity: Preview DCA In the DCA document, read the list of 26 items on page 10 Highlight the following 4 items: Item 10: District Implementation Team uses a communication plan Item 14: DIT has access to data for the effective innovation Item 15: DIT has a process for using data for decision making Item 16: District provides a status report on the effective innovation to the school board

DCA Item 10 District Implementation Team uses a communication plan 1. Read the full item scoring guide on page Highlight or underline the criteria your district has met 3. What score would you give your district (use responder)?

Formal process or system for gathering and disseminating important information specific to a common focus that has been mutually agreed upon by all groups / teams who will be impacted by its use Communication Plan

1. Groups / Teams or staff 2. Protocols for what information needs to be gathered and disseminated to each group / team, in what format, and in a pre-determined timeframe 1. Designees from each team that are assigned the task of gathering and disseminating information 1. Survey and dates to assess the effectiveness of communication Plan Components

Considerations for including groups / teams or staff to the communication plan: Team’s / group’s overlap in the components of an integrated behavior and reading MTSS model Leadership groups / teams that have the ability to remove barriers impeding people’s use of the MTSS components (e.g., central office, administrative team) People in critical roles who will be in a supporting role for MTSS components Other groups / teams who can influence PD, curriculum and assessment decisions since the MTSS work touches on curriculum, instruction, intervention and assessment Groups / Teams

1. Groups / Teams or staff 2. Protocols for what information needs to be gathered and disseminated to each group / team, in what format, and in a pre-determined timeframe 1. Designees from each team that are assigned the task of gathering and disseminating information 1. Survey and dates to assess the effectiveness of communication Plan Components

1. Groups / Teams or staff 2. Protocols for what information needs to be gathered and disseminated to each group / team, in what format, and in a pre-determined timeframe 1. Designees from each team that are assigned the task of gathering and disseminating information 1. Survey and dates to assess the effectiveness of communication Plan Components

Consider the following: The information that needs to be gathered “from” and disseminated “to” might suggest one DIT member over others; especially if there are follow-up questions that would require deeper knowledge about the information Easy access to the team or members of the team Ability to follow through with communication shortly following team meetings (1-2 days) Communication Designees

Timelines: General rule of thumb: 3-5 business days for responding to challenges; 20 business days for addressing challenges (e.g., either eliminating the challenge or starting to address the challenge with other groups / teams, or entities) Format: Gathering information: , face-to-face, phone call Responding to challenges: Timelines and Format Considerations

1. Groups / Teams or staff 2. Protocols for what information needs to be gathered and disseminated to each group / team, in what format, and in a pre-determined timeframe 1. Designees from each team that are assigned the task of gathering and disseminating information 1. Survey and dates to assess the effectiveness of communication Plan Components

Regular opportunity to assess the effectiveness of communication Refinements are done based on data Conveys the message that communication is important Reduces comments about poor communication since the survey data and transparency about refinements based on data are provided on a regular basis Benefits of a Communication Survey

Example Communication Survey

Activity Use this sentence frame to describe the benefits of a Communication Plan: One benefit of a Communication Plan is _____________. At your table: Take turns sharing benefits of a communication plan, starting with the sentence frame.

Evaluation Questions 1. What is the reach of our MTSS supports across the district? 2. To what extent are students in our district meeting expectations for performance and growth? 1. To what extent are district schools implementing MTSS with fidelity? 2. What is our capacity to support implementation of MTSS? 3. What level of buy-in exists for implementing MTSS?

Individual Activity: Evaluation Questions Review the sample evaluation questions, data sources, and decision rules Start generating questions, data sources, and decision rules that fit your context in the following areas: Student outcomes (academic and behavior) Implementation Fidelity If relevant: district capacity, reach How close are you to being able to answer these questions and evaluate MTSS implementation and impact? What work needs to be done related to: Exploration/adoption and consensus? Installation of necessary data, systems and practices?

DCA Item 14 DIT has access to data for the effective innovation Recall critical features of the MIBLSI Database (module 3): Data views designed to align with the questions being asked and the problem solving process Single point of data entry to feed up to district, ISD, and state views of the same data Pulls together multiple data sources, not replicate functions of other systems Based on multiple rounds of usability testing 1. Read the full item scoring guide on page Highlight or underline the criteria your district has met 3. What score would you give your district (use responder)?

DCA Item 15 DIT has a process for using data for decision making What specific model is being used for data-based decision making in your district? How often are data analyzed and when? What decisions are made? 1. Read the full item scoring guide on page Highlight or underline the criteria your district has met 3. What score would you give your district (use responder)?

Gather – Study – Plan – Do

Timeline of Data Reviews School Data Review Fall Winter Spring  Coaching Support Session School Data Review Coaching Support Session School Data Review Coaching Support Session District Data Review

DCA Item 16 District provides a status report on the effective innovation to the school board Consider alignment with the communication plan and the evaluation questions Consider format and audience 1. Read the full item scoring guide on page Highlight or underline the criteria your district has met 3. What score would you give your district (use responder)?

Tying the Pieces Together Each table will be assigned 1 of the 4 DCA items Independently complete these 2 sentences: One criteria our district has met for this DCA item is ______. One thing our district did to meet this criteria was ______. When done with the independent task, move to the area of the room for your assigned DCA item. Share and record your ideas on the chart paper. Rotate as a group and read what others wrote on their poster paper for the remaining 3 items.

Takeaways Share one takeaway with the group. Sentence starters: One thing I would like to learn more about next is _____ One tip I will try out in my district is _____ One connection I made is _____

Contact Us Anna Harms Michigan’s Integrated Behavior and Learning Support Initiative Jose Castillo University of South Florida, Florida Problem Solving/Response to Intervention Project