Chris Borgmeier, Dave McKay, Anne Todd, Celeste Dickey, Rob Horner October

 Clarify evaluation questions for effective decision making around discipline and school climate  Define critical features for organizing the data  Define data sources needed ◦ Pbseval for discipline, SIS for achievement & attendance  Define the cycles and timelines for data collection and reporting

 Guide Decision Making ◦ Plan ◦ Progress monitor ◦ Inform Change/Need  Visibility/Support  FUNDING  Celebrate accomplishments

 How many schools are adopting PBIS? ◦ What percentage of schools in state, region/district?  SET, TIC, BoQ  How many schools are implementing SWPBIS at criteria?  SET, TIC, BoQ  Are schools implementing SWPBIS perceived as safe?  School Safety Survey  What are discipline patterns?  SWIS  What are attendance patterns?  SIS  What are achievement patterns?  SIS, State Testing scores DIBELS, AIMS Web

 Written Documents ◦ Visual/Graphic Display ◦ Easy to Read  Oral Reports/presentations ◦ Status reports  Website ◦ Post surveys and other resources ◦ Schedule reminders to school to complete survey  Make fair comparisons ◦ Account for 20% change in attendance ◦ Calculate per 100 students ◦ Percent of total ◦ Account for days of week if used for report

 District/ Regional Leadership Team Meetings ◦ To guide decision making  Quarterly, annually  Monitor Progress  Annual Action Planning  School Board Meetings  State Leadership Team Meetings  State/regional conferences  Newsletters  Establish a rhythm

Measure Year OneYear 2Year Three Q1Q2Q3Q4Q1Q2Q3Q4Q1Q2Q3Q4 EBS Survey X Team Checklist (TIC) XXXXX SET or BoQ XXX Classroom Self- Assessment XXXX CISS XXXX I-SSET or I-BoQ XX An Evaluation Model for School-wide PBS Designed for a school or cohort of schools

 SWIS + PBS Surveys + PBS Eval

 Online survey application for school teams and staff (free of charge) ◦ ◦ Complete Local Coordinator Form and submit to  PBS Applications Manager  1235 UO  Eugene, Oregon  PBS Surveys 5 different measures for schools to use that measure the: ◦ percent of implementation of SW-PBS ◦ risk and safety factors ◦ Rates of office discipline referrals ◦ Each of the 5 measures are used at different times and for different purposes

Team Implementation Checklist EBS Self-Assessment Survey School Safety Survey Benchmarks of Quality SET

 PBSEval™ is ◦ a web-based progress monitoring service that permits specific district and state-level organizations such as the Licensee to monitor and review selected area-wide administrative data and generate automated reports (collectively “Data”) in a manner that does not disclose personally identifiable information  Accessing PBS Eval ◦ License agreement  State $1000/year  District $500/year ◦ Participate in 90 minute training

284 schools 674 schools as of 10/24/08 There are 1239 public schools in Oregon

SET’s x Year Elementary Schools (K-6)

Elementary Schools TIC’s x Year from OR MS

SET’s x Year Middle School

SET’s x Year High School

Nat’l Elem Mean.39 ODR/100/ Day Nat’l MS Mean.97 ODR/100/ Day

Outcome Data  ODR  Suspension/Expulsion  LRE  Attendance  Academic Achievement  School climate surveys  Staff retention Implementation Data  Self Assessment  SET

Outcome Data  Academic Achievement  State Test Scores  CBM/ DIBELS/ EZ CBM/ AimsWeb  LRE  Attendance Implementation Data  PET-R  Healthy Systems Checklist  In Program Assessments  School/ Classroom Observations

 Across Schools/District-wide Data ◦ SWIS won’t do it ◦ Capabilities of new SAMI? ◦ PBS Surveys won’t do it  Can access all data but have to compile it your self ◦ DIBELS Survey ◦ PBS Eval ◦ Other programs -- eSIS? Etc? ◦ Need some Excel skills

Carol Sadler

 16 Schools, 12,000 students ◦ 10 elementary, 1 charter, 3 middle, 2 high  Special Programs participation ◦ 1,200 Special Education (10%) ◦ 1,800 English Language Learners (15%) ◦ 1,500 Talented and Gifted (12%)  Socio-economic status ◦ Title 1 in 5 elementary schools  Free/Reduced ranges from 7% to 58%

T-TSD’s SET Scores, years 9 and 10!

. 52 T-TSD’s rates of discipline referrals,

.45

.16

For 5 th grade students who have attended T-T since kindergarten or first grade (i.e., intact groups) 94% met or exceeded OSA Reading/Literature benchmark in

~80% of Students ~15% ~5% (Walker, et al. 1996) 80% received NO referrals; 90% received 0-1 referrals 8% received 2-5 referrals 1% received 6 or more referrals

 Dave McKay and Scott Perry