Vision: Every child in every district receives the instruction that they need and deserve…every day. How are we doing? Tools for reviewing strengths & areas of need in your RTI system

Data-Based Decision Making 2 CORE (TIER 1): 100% Meetings INTERVENTIONS (TIER 2/3) 20% Meetings INTERVENTIONS (TIER 3) Individual Problem Solving Meetings IEP Meetings (for SPED eligible students)

The Problem Solving Process 3 Improved Student Achievement 2. Problem Analysis 1. Problem Identification 3. Plan Development 4. Plan Implementation & Evaluation What is the problem? Why is the problem occurring? What are we going to do about the problem? How is it working?

Data-Based Decision Making 4 CORE (TIER 1): 100% Meetings INTERVENTIONS (TIER 2/3) 20% Meetings INTERVENTIONS (TIER 3) Individual Problem Solving Meetings IEP Meetings (for SPED eligible students)

Data-Based Decision Making 5 CORE (TIER 1): 100% Meetings INTERVENTIONS (TIER 2/3) 20% Meetings INTERVENTIONS (TIER 3) Individual Problem Solving Meetings IEP Meetings (for SPED eligible students) Data-Based Review of entire RTI system

Data-Based Decision Making 6 Data-Based Review of entire RTI system

The Problem Solving Process 7 Improved Student Achievement 2. Problem Analysis 1. Problem Identification 3. Plan Development 4. Plan Implementation & Evaluation What is the problem? Why is the problem occurring? What are we going to do about the problem? How is it working?

Data-Based Decision Making with Decision Rules Training Coaching Fidelity Training Coaching Fidelity Standards of Practice Standards of Practice Culture Leadership Teaming/Data- Based Decision Making Professional Learning & Support RTI Essential Components Core Screening Interventions Progress Monitoring SLD Decision Making RTI is not a singular “thing”

“Without proper self-evaluation, failure is inevitable” -John Wooden

The Problem Solving Process 10 Improved Student Achievement 2. Problem Analysis 1. Problem Identification 3. Plan Development 4. Plan Implementation & Evaluation What is the problem? Why is the problem occurring? What are we going to do about the problem? How is it working?

How do you currently evaluate your RTI system? –Self-evaluation? Informal Formal (with a rubric/checklist) –External evaluation? –Staff Survey? –Walkthroughs/Fidelity Checks? –Other tools/resources? Talk Time

Completed once yearly (Spring) Compiles data from 3 different sources to give a multifaceted look at RTI implementation at the school level DIET-SB2 District Implementation Evaluation Tool (School-Based v2)

What information is used to get a “score”? DIET-SB2 Score Interview Evidenc e Review Staff Survey

Why we’ve included the Staff Survey in the DIET-SB2 Strongly Agree Somewhat Agree Strongly Disagree Somewhat Disagree I don’t know or N/A

Self-report can be unreliable –“The more we know, the less we know” –Inflation of scores –Leadership team vs. school staff Having policies & procedures does not ensure effective RTI Implementation –RTI handbook as “Paper implementation”

What information is used to get a “score”? DIET-SB2 Score Interview Evidenc e Review Staff Survey

DIET-SB2 Score 37 items categorized into the 9 RTI components *A fully functioning RTI system would have every item fully implemented with high quality Cultur e (3) Leadership (5) Professional Learning & Support (5) Data-Based Decision Making (8) Core (5) Screening (2) Interventions (5) Progress Monitoring (3) SLD Decision Making (1)

DIET-SB2 Score Interview Evidenc e Review Staff Survey

Completed once yearly (Spring) Scheduled minutes with school Principal and school RTI “expert” –For Current ORTIi districts: Conducted by ORTIi staff for at least 3 of your schools –For Non-ORTIi (in Oregon)/Past ORTIi districts: Conducted by trained district personnel DIET-SB2 Interview & Evidence Review

Interview: –16 questions (see principal’s packet) Evidence Review: –5-10 Evidence items Completed 100% Agendas Building schedules Screening & Progress Monitoring databases Reading Protocols Walkthrough forms Individual Problem Solving forms SLD reports (if available) DIET-SB2 Interview & Evidence Review

19. Decision rules are created and followed for when to change interventions Interview Evidenc e Review Staff Survey Sample Item: Data-Based Decision Making 3 pts Evidence of documented decision rules followed on student progress monitoring graphs 2 pts N/A 1 pts Decision rules created but not followed 0 pts No decision rules created

DIET-SB2 Score Interview Evidenc e Review Staff Survey

Completed once yearly (Spring) Completed online by all school staff who help implement your RTI system –32 questions –5-10 minutes to complete, anonymous –Data integrated into the DIET-SB2 results or survey data can be viewed independently ORSIS Oregon RTIi Staff Implementation Survey Strongly Agree Somewhat Agree Somewhat Disagree Strongly Disagree

11. District provides ongoing coaching to support trained practices Interview Evidenc e Review Staff Survey Sample Item: Professional Learning & Support I receive coaching/mentoring to help me implement instructional supports and/or data-based decision making 3 pts Most staff agree (>80%) 2 pts Many Staff agree (60 – 79%) 1 pts Half of Staff agree (40 – 59% ) 0 pts Few Staff agree (<40% )

7. Principal monitors instructional practices (e.g. walkthroughs) and provides actionable feedback to staff* Interview Evidenc e Review Staff Survey Sample Item: Leadership +1 Pt Principal does regular walkthroughs with a form +1 Pt My principal regularly does walkthroughs in my classroom to ensure fidelity of core implementation and effective instructional practices. Most Teachers Agree (>70%) +1 Pt I am provided with actionable feedback from principal walkthroughs Most Teachers Agree (>70%)

Viewing Reports Oregon RTIi Assessment System for Implementation Supports OASIS

OASIS:

Click on the School Name for the full school report

DIET-SB (School Report) One for each school that completed the assessment

DIET-SB (School Report) One for each school that completed the assessment

Bottom 33% of schools (Below Average) Middle 33% of schools (Average) Top 33% of schools (Above Average) Your school’s score Your school’s score as compared to all other schools

StrengthsAreas of Need

DIET-SB (Digging Deeper) Will show you your specific staff survey data related to this issue Links to resources and ideas for how to address your high need areas ( Coming soon )

Average DIET-SB2 scores (2014 – 2015) n = 39 Schools

The DIET-SB2 is not a perfect assessment, however… …the 3 data sources help provide a fairly accurate picture (interview, evidence review, staff survey) How can you make this a more accurate reflection of your school? –How do we get more staff to complete the survey? Allocate time at staff meeting Explain to staff what the DIET-SB2 is and how it will it be used Include classified staff? Things to Consider

If you have not used this tool, could it be helpful to your school/district? If you have used this tool, how has it been helpful in evaluating your RTI Implementation? Talk Time

Current ORTIi districts - Required –Interview and Evidence review conducted by ORTIi staff in the Spring –Staff Survey given to staff starting in March Non-ORTIi/Past ORTIi districts – Available –Interview and Evidence review can be conducted by trained district personnel –Staff Survey given to staff starting in March How can you access this tool? **Currently only available to Oregon School Districts

Current ORTIi districts –COSA Summer Assessment Institute Half Day DIET-SB training (Administration & Scoring) –Partner with your ORTIi coach to attend DIET- SB2 visits Non-ORTI/Past ORTIi districts –COSA Summer Assessment Institute Half Day DIET-SB training (Administration & Scoring) Contact an ORTIi coach to inquire about attending DIET-SB2 visits Training Opportunities **Currently only available to Oregon School Districts

For non-ORTIi districts who want to evaluate your RTI system, but are not able to utilize this multi-method data collection system, we have a DIET-SB2 Self-Report measure. –Evaluates the same items as the full DIET- SB2 –No online graphs/reports –Available to all schools/districts including those outside of Oregon Alternative: DIET-SB2 Self Report

Contact Info: Jon Potter Questions/Comments