1. Establishing Multi-tiered Behavior Support Frameworks to Achieve Positive School-wide Climate George Sugai Tim Lewis Rob Horner University of Connecticut, University of Missouri University of Oregon www.pbis.org

2. Enhancing Decision Systems Collecting and Using Data for Decision-making

3. Goals Define Data Collection and Use for Schools Using Multi- tiered Systems of Behavior Support. Four Key Data Systems

4. Main Message Providing the right information, in the right format, at the right time is among the single most effective ways of improving the problem solving effectiveness of school teams.

5. Decision-Systems for MTSS Accountability System o Used by district decision-makers to meet state and federal requirements. o Assess district improvement Decision System o Used by school teams to improve academic and behavior support in schools Fidelity System o Used to determine if selected interventions are being implemented as planned Data Use Capacity o Training in how to use data for decision-making and problem solving.

6. 1. Accountability System Examples: ARIES, Synergy, Skyward, PowerSchool Content o Demographics o Grade progression o Standardized Assessment Data o Attendance Uses o Federal and state reporting o Assessment against district improvement plan

7. 2. Multi-tiered Decision System Tier III Individualized Plans Specific academic and social behavior targets Tier II Targeted group Daily point card Tier I Whole school ODR, Attendance, Suspension, Expulsion

8. Tier I Decision System Identifying that a problem exists Defining a problem with the precision Start with how often problem behaviors occur then use the data base to determine: What behaviors are a barrier and how often are they performed? Where they most and least likely Who is engaging in the behaviors When the problem behaviors are most and least likely Why do the behaviors keep occurring? Disproportionality patterns Ability to drill down for detailed data summary :

9. Elementary School with 150 Students 9 Questions to Ask of the Data What is happening? What is typical? What is possible? What is needed? Questions to Ask of the Data What is happening? What is typical? What is possible? What is needed?

10. Example Do we have a problem?

12. Defiance What Behavior(s) Questions: 1. Are most common behavior problems (a) Student- Student, or (b) Adult-Student related? 2. Are problem behaviors MAJOR or MINOR or BOTH?

13. What Behavior(s)

15. Classroom Playground Where? Questions: 1.What location(s) are associated with the most ODRs? 2.Sort by “structured” settings and “non-structured” settings (Classroom & Gym vs. Commons, Cafeteria, Hall, Playground)

16. Where

17. Who Questions: 1.Are there many, a few, or one student associated with the problem? 2.Are there more students emerging?

18. Who

19. 11:45-12:00 When?When? Questions: 1.Are problem behaviors more likely at some times of the day? 2.What is happening during periods when problems are most likely?

20. When

21. When

22. Why?

23. Why ?

24. Ethnicity

25. Risk Ratio = Risk Index/ Risk Index ------------------ Risk Ratio of 1.25 or larger is cause for concern

26. Drill Down for Precision

27. Only in Classroom Only on Playground Only in Classroom Defiance Physical Aggression

28. Classroom Playground Hallway Commons Area Drill Down Capacity

29. Classroom Unstructured Settings

30. Tier I Decision-making Effective decision-making requires o The right data o In the right form o At the right time

31. Tier II Decision System Identification Intervention Development Intervention Implementation and Adaptation

32. Tier II - Identification

33. Tier II Decision System

35. Tier II Decision-System

36. Tier III Decision System

40. The Impact of Effective Data Systems Dr. Sarah Pinkelman, George Mason University.

41. 3. Fidelity Measures Are the strategies that are selected actually being implemented?

42. PBIS Fidelity Measures SET TIC BoQ SAS ISSET BAT MATT Phases of Implementation (POI) Tiered Fidelity Inventory (TFI)

43. 1.1 Team Composition FeatureData Sources Scoring Criteria 0 = Not implemented 1 = Partially implemented 2 = Fully implemented 1.1 Team Composition: Team Composition: Tier I team includes a Tier I systems coordinator, a school administrator, a family member, and individuals able to provide (a) applied behavioral expertise, (b) coaching expertise, (c) knowledge of student academic and behavior patterns, (d) knowledge about the operations of the school across grade levels and programs, and for high schools, (e) student representation.  School organizational chart  Tier I team meeting minutes 0 = Tier I team does not exist or does not include coordinator, school administrator, or individuals with applied behavioral expertise 1 = Tier I team exists, but does not include all identified roles or attendance of these members is below 80% 2 = Tier I team exists with coordinator, administrator, and all identified roles represented, AND attendance of all roles is at or above 80% Main Idea: Teams need people with multiple skills and perspectives to implement PBIS well.

44. Total score (TFI)

45. Sub-scale report

46. PBIS Tiered Fidelity Inventory

47. Sub-subscale report Tier I Teams Implementation Evaluation Tier II Teams Interventions Evaluation Tier III Teams Resources Assessment Support plan Monitoring and adaptation

48. Item Report

49. Action Planning 01. Team to propose teaching template and Fall teaching schedule at Feb 16 Faculty meeting. AlanFeb 16

50. 4. Using Data for Decision-Making Meeting Foundations o Team Roles o Public Meeting Minutes o Meeting protocol Problem Solving o Define problem with precision o Define goal o Build comprehensive support based on function o Establish action plan Implementation o Assess quality of implementation o Assess impact toward goal o Adapt based on implementation data

51. Implement Solution with High Integrity Implement Solution with High Integrity Identify Goal for Change Identify Goal for Change Identify Problem with Precision Identify Problem with Precision Monitor Impact of Solution and Compare against Goal Monitor Impact of Solution and Compare against Goal Make Summative Evaluation Decision Make Summative Evaluation Decision Meeting Foundations Team-Initiated Problem Solving (TIPS II) Model Identify Solution and Create Implementation Plan with Contextual Fit Identify Solution and Create Implementation Plan with Contextual Fit Collect and Use Data What, Who, When, Where, and Why? How do we want the problem to change? What are we going to do to bring about desired change? Did we implement with fidelity? Has the problem been solved? What next?

52. Findings Teams can improve quickly Use of data is critical both for initial problem solving and on-going adaptation

53. Summary Having the right data in the right form at the right time is among the single most efficient ways of improving the decision-making of a team Four Data Systems o Accountability System o Decision System o Fidelity System o Data Use System