Supporting and Evaluating Broad Scale Implementation of Positive Behavior Support Teri Lewis-Palmer University of Oregon

Acknowledgements Students, educators, administrators, school staff, families,…. Community of researchers, personnel preparers, system changers, staff developers,…. Offices of Special Education Programs, US Dept. of Ed.

Research to Practice (Wing Institute, 2005) Efficacy (what works?) Effectiveness (when does it work?) Implementation (how do we make it work?) Monitoring (is it working?)

Challenges to Implementation (Kratochwill, Albers, & Steele Shernoff, 2004) Primary focus on education Lack of emphasis on prevention programs Organization impedes collaboration, working as team Lack of skills, training, resources

Positive Behavior Support (PBS) PBS is a systems approach to proactive school-wide discipline that is designed to increase the capacity of schools to adopt and sustain research-validated practices for all students. Systems Data Practices

SYSTEMS PRACTICES DATA Supporting Staff Behavior Supporting Decision Making Supporting Student Behavior Positive Behavior Support OUTCOMES Social Competence & Academic Achievement

Generic Model School-wide PBS Team Represent school, meet regularly, etc Coach Provide technical assistance to school Link school to state State Leadership Team Guide planning and development Coordinate Training Regional Teams/Structure

Year One Getting Started (Summer/Fall) Overview, School-wide, Non-classroom, Data Decisions, Team meetings, Team Planning Expanding Implementation (Winter) Classroom, Escalation Cycle, Team Status Check, Team planning Sustaining Efforts (Spring) Individual Student, Targeted-group, Team Planning, Long-term Action Planning

Year Two Intensive Behavior Support Linking with other initiatives (i.e., academics, bullyproofing, RtI) District/Regional Systems Working with Parents and Community Roadblocks and Challenges

Critical Features High status leadership team Active administrator participation High priority in school improvement planning Proactive (positive and preventive) systems approach Data-based decision making Continuum of behavior supports Long term commitment Research validated practices

Nonclassroom Setting Systems Classroom Setting Systems Individual Student Systems School-wide Systems School-wide Positive Behavior Support Systems

Emphasis on Prevention Primary Reduce new cases of problem behavior Secondary Reduce current cases of problem behavior Tertiary Reduce complications, intensity, severity of current cases

Academic SystemsBehavioral Systems 1-5% 5-10% 80-90% Intensive, Individual Interventions Individual Students Assessment-based High Intensity Intensive, Individual Interventions Individual Students Assessment-based Intense, durable procedures Targeted Group Interventions Some students (at-risk) High efficiency Rapid response Targeted Group Interventions Some students (at-risk) High efficiency Rapid response Universal Interventions All students Preventive, proactive Universal Interventions All settings, all students Preventive, proactive Designing School-Wide Systems for Student Success

School-wide & Classroom-wide Systems  Common approach to discipline  Positive expectations  Teach expected behavior  Encourage expected behavior  Discourage inappropriate behavior  On-going monitoring & evaluation

Classroom Management Systems Behavior & classroom management Instructional management Environmental management

Specific Setting Systems Routines Active supervision by all staff Scan, move, interact Precorrections & reminders Positive reinforcement

Individual Student Systems Behavioral competence Function-based behavior support planning Team-based model Data-based decision making Comprehensive person-centered planning & wraparound processes

Maryland Model Collaboration between schools, MSDE, Sheppard Pratt, and Johns Hopkins Began in local school systems Over 230 schools About 120 coaches State Leadership Team

Maryland Model, cont. State Level State Leadership Team District/Regional Coordinators School Level Coaches Teams Training Summer Institute Regional Trainings

Overview of Evaluation Model What schools are involved in the implementation? How well are schools with implementation? What impact has implementation had on student success?

Who is Implementing? 232 School Teams have completed training (16% of Maryland Schools) 217 Currently active schools Attrition occurred early in the project when coaches and other regional technical assistance structures were not established

Schools Trained and Active

Expansion Highlights 65% of total schools were trained within the past two years 35% of total schools were trained last year (summer 2004) Anne Arundel (Ginny Dolan), Baltimore (Joey Levina- Parr) and Charles (Elsa Velez) Counties all have had rapid expansion as a result of identifying a facilitator (lead coach)

How Well are Schools Implementing? Systems-wide Evaluation Tool (SET) Annually 7 features of SW implementation Interviews, product review, observations

SET 96 SETs completed during SY 50 schools have SETs for 2 years 80% Total score is considered sustainability level All regions met 80% criterion across schools This represents a 47% increase

Pre-Post SETs by Region

What is the Impact of Implementation? Team Checklist Staff Survey Student Behavior (ODR)

Two Levels

Staff Survey Only 7 staff surveys have been turned in Not enough data to make valid summary Only measure that includes staff feedback and perceptions Piloting on-line entry and summary of measures

Student Behavior (SWIS) 90% of elementary schools are reporting ODRs at.43 per day per 100 students or lower 94% of middle schools are reporting ODRs at.95 per day per 100 students or lower 75% of high schools are reporting ODRs at.95 per day per 100 students or lower

Fidelity of Data 85% of active schools are returning data to Coaches/State Leadership Team

Sustainability Assumptions Implemented with high accuracy Sustained to realize durable changes and expand efforts Implemented by local/natural resources Adapted to “fit” culture Guided by data-based decisions Supported by systems to support staff

Implementation Levels Student Classroom School State District

Leadership Team Funding VisibilityPolitical Support TrainingCoaching Evaluation Active Coordination Local School Teams/Demonstrations PBS Organizational Logic