Designing and Implementing Evaluation of School-wide Positive Behavior Support Rob HornerHolly Lewandowski University of Oregon Illinois State Board of Education Slides at

Goals  Provide a framework for building state-level evaluation of school-wide PBIS

Main Messages  Start with the evaluation questions  Define information needed for good decisions  What information, in what form, at what time, for whom.  Invest in evaluation plan and evaluation group early.  Use evaluation information at multiple levels

 The role of evaluation in School-wide PBIS

Leadership Team Funding VisibilityPolitical Support TrainingCoachingEvaluation Active Coordination Local School Teams/Demonstrations Behavioral Expertise

Levels of Evaluation Student Classroom School District State Nation

Evaluation Areas/ Questions  Assessment  Are we implementing these procedures already?  What do we need to do? What is the smallest change that will lead to the largest gain?  Implementation  Who is involved? (What schools, activities, effort)  Are we implementing SW-PBIS at criterion? Practices, Systems, Data, Outcomes  What type and level of Technical Assistance is needed?  What is the cost of implementation? What is the cost to continue implementation?  How does this approach compare with alternatives? Most common alternative is what is currently being done

Evaluation Areas/ Questions  Outcomes Behavioral outcomes (Is student social behavior improving?) Office discipline referrals Suspensions/ Expulsions Rate of referrals to special education Attendance Check-in/ Check-out data Individual student progress monitoring Academic outcomes (Are student academic gains occurring?) Literacy progress monitoring (soon math progress monitoring) Standardized test scores Graduation rate; Grades Drop out rate

Evaluation Areas/ Questions  Sustainability Do schools sustain implementation fidelity? Do schools sustain student outcome gains?

Matching Measures to Questions  Scott Spaulding and Claudia Vincent  Every State/District will have additional data sources unique to the setting, or context, that can be integrated into the plan. Examples:  Iowa Youth Survey,  Illinois wraparound tools

Establishing Evaluation as a Priority  Identify and Fund Evaluation Coordinator Internal versus external  Build evaluation plan early Approved by Leadership Team Agree on questions, measures, report schedule  Invest in data collection, summarization, and storage Different levels of investment are possible  Report Evaluation results regularly At least twice a year

Evaluation on  Evaluation Template (Online library/ Tools)  Evaluation Tools/ Measures  Evaluation Examples Holly