Download presentation
Presentation is loading. Please wait.
Published byScot Flynn Modified over 9 years ago
1
Data Driven Decisions: Using the Tools Susan Barrett, Jerry Bloom PBIS Maryland Coaches Meeting October 2007 sbarrett@pbismaryland.org jbloom@pbismaryland.org
2
Acknowledgements Dr. Rob Horner University of Oregon Dr. George Sugai University of Connecticut
3
Goals Define use of data driven decision to reach full implementation of school-wide PBS IPI Team Checklist SWIS
4
Assumptions School teams will be successful if: They start with sufficient resources and commitment They focus on the smallest changes that will result in the biggest difference They have a clear action plan They use on-going self-assessment to determine if they are achieving their plan They have access to an external agent/coach who is supportive, knowledgeable and persistent.
5
Data Driven Solutions- Using the Process Measures Implementation Phase Inventory (IPI) Team Checklist- Form A (TIC) Self-assessment for Primary Prevention systems. Emphasis is on milestones Are we doing what we should be doing?
6
IPI Two times/year Due November 10, April 10 Coach completes with Team Four Phases Preparation Initiation Implementation Maintenance
7
Team Checklist Self-assessment tool for monitoring implementation of School-wide PBS. Start-Up Elements (17 items) Establish Commitment Establish and Maintain Team Self-assessment Establish school-wide expectations (Prevention) Establish consequences for behavioral errors Establish information system Establish capacity for function-based support On-going Elements (6 items) Team Checklist
8
Use of the Team Checklist Who completes the Team Checklist? The school-team (completed together) When is Team Checklist completed? At least quarterly, best if done monthly Check with your local coordinator (www.pbssurveys.org) Who looks at the data? Team Coach Trainers/State Evaluation Action Planning
9
Action Planning with the Team Checklist Define items (or POINTS) In place or Partially in place. Points: 2=in place, 1= partial, 0=not in place Identify the items that will make the biggest impact Define a task analysis of activities to achieve items. Allocate tasks to people, time, reporting event.
10
Implementation by Feature This report shows, for each completed Checklist, the percentage implemented and partially implemented for each of the following features: Establish commitment (questions 1-2) Establish & maintain team (3-5) Conduct self-assessment (6-8) Define expectations (9) Teach expectations (10-12) Establish reward system (13) Establish violations system (14) Establish information system (15) Build capacity for function-based support (16-17)
12
Putting your School in Perspective Use % of Total Items/ or % of points Messages: Trends You don’t need to be perfect immediately
13
Overall Implementation This report shows, for each completed Checklist, overall scores as (a) the percentage of items fully implemented and partially implemented and (b) the percentage of implementation points. The report displays one row of this data for each Checklist in ascending date order. The associated column chart shows the percentage of items implemented and partially implemented on each Checklist and, in a separate area, the percentage of implementation points.
15
Team Checklist Total Scores
16
Data Driven Solutions Using Outcome Measures to Make Decisions School-wide Information System www.swis.org
17
Improving Decision-Making Problem Solution From To Problem Solving Solution Information
18
Key features of data systems that work. The data are accurate and valid The data are very easy to collect (1% of staff time) Data are presented in picture (graph) format Data are used for decision-making The data must be available when decisions need to be made (weekly?) Difference between data needs at a school building versus data needs for a district The people who collect the data must see the information used for decision-making.
19
Why Collect Discipline Information? Decision making Professional Accountability Decisions made with data (information) are more likely to be (a) implemented, and (b) effective
20
What data to collect for decision-making? USE WHAT YOU HAVE Office Discipline Referrals/Detentions Measure of overall environment. Referrals are affected by (a) student behavior, (b) staff behavior, (c) administrative context An under-estimate of what is really happening Office Referrals per Day per Month Attendance Suspensions/Expulsions Vandalism
21
Office Discipline Referral Processes/Form Coherent system in place to collect office discipline referral data Faculty and staff agree on categories Faculty and staff agree on process Office Discipline Referral Form includes needed information Name, date, time Staff Problem Behavior, maintaining function Location
22
When Should Data be Collected? Continuously Data collection should be an embedded part of the school cycle not something “extra” Data should be summarized prior to meetings of decision-makers (e.g. weekly) Data will be inaccurate and irrelevant unless the people who collect and summarize it see the data used for decision-making.
23
Organizing Data for “active decision-making” Counts are good, but not always useful To compare across months use “average office discipline referrals per day per month”
24
January 10
26
Using Data for On-Going Problem Solving Start with the decisions not the data Use data in “decision layers” (Gilbert, 1978) Is there a problem? (overall rate of ODR) Localize the problem (location, problem behavior, students, time of day) Get specific Don’t drown in the data It’s “OK” to be doing well Be efficient
27
Is there a problem? Office Referrals per Day per Month Attendance Faculty Reports
28
SWIS summary 04-05 (Majors Only) 1210 schools: 595,742 students Grade Range Number of Schools Number of Students Mean ODRs per 100 per school day K-6673292,021 Mean = 434.39 (sd=.43) 6-9255170,700 Mean = 669.96 (sd=.72) 9-126762,244 Mean = 929 1.28 (sd=1.32) K-(8-12)16765,862 Mean = 394.88 (sd=.96) Alt/JJ483,915 Mean = 82 11.89 (9.03)
29
Interpreting Office Referral Data: Is there a problem? Absolute level (depending on size of school) Middle, High Schools (> 1 per day per 100) Elementary Schools (> 1 per day per 250) Trends Peaks before breaks? Gradual increasing trend across year? Compare levels to last year Improvement?
30
Elementary School with 250 students
31
Middle School with 500 students
34
Is there a problem? Middle school with 500 students (Dec)
35
Is there a problem? Middle School with 500 students (Dec 04-05)
36
What systems are problematic? Referrals by problem behavior? What problem behaviors are most common? Referrals by location? Are there specific problem locations? Referrals by student? Are there many students receiving referrals or only a small number of students with many referrals? Referrals by time of day? Are there specific times when problems occur?
39
Elementary School
40
Referrals per Student
43
Quote of the Day “Without data, you are just another person with an opinion”
Similar presentations
© 2025 SlidePlayer.com. Inc.
All rights reserved.