1. Chris Borgmeier, Dave McKay, Anne Todd, Celeste Dickey, Rob Horner October 2008 cborgmei@pdx.educborgmei@pdx.edu; david.McKay@lblesd.k12.or.usdavid.McKay@lblesd.k12.or.us awt@uoregon.eduawt@uoregon.edu; robh@uoregon.edu; cdickey@uoregon.edurobh@uoregon.educdickey@uoregon.edu

2.  Clarify evaluation questions for effective decision making around discipline and school climate  Define critical features for organizing the data  Define data sources needed ◦ Pbseval for discipline, SIS for achievement & attendance  Define the cycles and timelines for data collection and reporting

3.  Guide Decision Making ◦ Plan ◦ Progress monitor ◦ Inform Change/Need  Visibility/Support  FUNDING  Celebrate accomplishments

4.  How many schools are adopting PBIS? ◦ What percentage of schools in state, region/district?  SET, TIC, BoQ  How many schools are implementing SWPBIS at criteria?  SET, TIC, BoQ  Are schools implementing SWPBIS perceived as safe?  School Safety Survey  What are discipline patterns?  SWIS  What are attendance patterns?  SIS  What are achievement patterns?  SIS, State Testing scores DIBELS, AIMS Web

5.  Written Documents ◦ Visual/Graphic Display ◦ Easy to Read  Oral Reports/presentations ◦ Status reports  Website ◦ Post surveys and other resources ◦ Schedule reminders to school to complete survey  Make fair comparisons ◦ Account for 20% change in attendance ◦ Calculate per 100 students ◦ Percent of total ◦ Account for days of week if used for report

6.  District/ Regional Leadership Team Meetings ◦ To guide decision making  Quarterly, annually  Monitor Progress  Annual Action Planning  School Board Meetings  State Leadership Team Meetings  State/regional conferences  Newsletters  Establish a rhythm

7. Measure Year OneYear 2Year Three Q1Q2Q3Q4Q1Q2Q3Q4Q1Q2Q3Q4 EBS Survey X Team Checklist (TIC) XXXXX SET or BoQ XXX Classroom Self- Assessment XXXX CISS XXXX I-SSET or I-BoQ XX An Evaluation Model for School-wide PBS Designed for a school or cohort of schools

8.  SWIS + PBS Surveys + PBS Eval

9.  Online survey application for school teams and staff (free of charge) ◦ www.pbssurveys.org www.pbssurveys.org ◦ Complete Local Coordinator Form and submit to  PBS Applications Manager  1235 UO  Eugene, Oregon 97403  PBS Surveys 5 different measures for schools to use that measure the: ◦ percent of implementation of SW-PBS ◦ risk and safety factors ◦ Rates of office discipline referrals ◦ Each of the 5 measures are used at different times and for different purposes

10. Team Implementation Checklist EBS Self-Assessment Survey School Safety Survey Benchmarks of Quality SET

11.  PBSEval™ is ◦ a web-based progress monitoring service that permits specific district and state-level organizations such as the Licensee to monitor and review selected area-wide administrative data and generate automated reports (collectively “Data”) in a manner that does not disclose personally identifiable information  Accessing PBS Eval ◦ License agreement  State $1000/year  District $500/year ◦ Participate in 90 minute training

16. 284 schools 674 schools as of 10/24/08 There are 1239 public schools in Oregon

18. SET’s x Year 2004-0573 2005-06148 2006-07224 2007-08249 Elementary Schools (K-6)

19. Elementary Schools TIC’s x Year from OR MS 2004-0527 2005-0630 2006-0776 2007-08107

20. SET’s x Year 2004-0516 2005-0635 2006-0771 2007-0871 Middle School

21. SET’s x Year 2004-057 2005-0618 2006-0721 2007-0844 High School

23. Nat’l Elem Mean.39 ODR/100/ Day Nat’l MS Mean.97 ODR/100/ Day

24. Outcome Data  ODR  Suspension/Expulsion  LRE  Attendance  Academic Achievement  School climate surveys  Staff retention Implementation Data  Self Assessment  SET

25. Outcome Data  Academic Achievement  State Test Scores  CBM/ DIBELS/ EZ CBM/ AimsWeb  LRE  Attendance Implementation Data  PET-R  Healthy Systems Checklist  In Program Assessments  School/ Classroom Observations

26.  Across Schools/District-wide Data ◦ SWIS won’t do it ◦ Capabilities of new SAMI? ◦ PBS Surveys won’t do it  Can access all data but have to compile it your self ◦ DIBELS Survey ◦ PBS Eval ◦ Other programs -- eSIS? Etc? ◦ Need some Excel skills

32. Carol Sadler

33.  16 Schools, 12,000 students ◦ 10 elementary, 1 charter, 3 middle, 2 high  Special Programs participation ◦ 1,200 Special Education (10%) ◦ 1,800 English Language Learners (15%) ◦ 1,500 Talented and Gifted (12%)  Socio-economic status ◦ Title 1 in 5 elementary schools  Free/Reduced ranges from 7% to 58%

34. T-TSD’s SET Scores, years 9 and 10!

35. . 52 T-TSD’s rates of discipline referrals, 1999 - 2005

36. .45

37. .16

38. For 5 th grade students who have attended T-T since kindergarten or first grade (i.e., intact groups) 94% met or exceeded OSA Reading/Literature benchmark in 2004-05

39. ~80% of Students ~15% ~5% (Walker, et al. 1996) 80% received NO referrals; 90% received 0-1 referrals 8% received 2-5 referrals 1% received 6 or more referrals

40.  Dave McKay and Scott Perry