1 Implementing a Three-Tiered State Evaluation Structure Bob Putnam The May Institute Karen Childs University of South Florida 2009 National PBIS Leadership.

Slides:

Advertisements

Similar presentations

Using the PBIS Tiered Fidelity Inventory (TFI) E-12

Advertisements

Student Services Personnel and RtI: Bridging the Skill Gap FASSA Institute George M. Batsche Professor and Co-Director Institute for School Reform Florida.

Fidelity Instruments and School Burden Patricia Mueller, Ed.D., Brent Garrett, Ph.D., & David Merves, C.A.S. Evergreen Evaluation & Consulting, LLC AEA.

Schoolwide Positive Behavior Interventions and Support -SWPBIS- Mitchell L. Yell, Ph.D. University of South Carolina

Extending RTI to School-wide Behavior Support Rob Horner University of Oregon

Implementing a Three-Tiered State Evaluation Structure Florida’s PBS Project Model Karen Elfner Childs, M.A., University of South Florida.

The Role and Expectations for School-wide PBS Coaches Rob Horner and George Sugai OSEP TA-Center on PBS Pbis.org.

MARY BETH GEORGE, USD 305 PBIS DISTRICT COORDINATOR USD #305 PBIS Evaluation.

John Carter Project Coordinator PBIS Idaho: Menu button: Idaho PBIS Presentations and Webinars.

1 Reading First Internal Evaluation Leadership Tuesday 2/3/03 Scott K. Baker Barbara Gunn Pacific Institutes for Research University of Oregon Portland,

The Importance of Coaching in Implementation of Evidence-based Practices Rob Horner University of Oregon

San Jose Unified School District School-wide PBS Initiative Leadership Team Rob Horner Celeste Rossetto Dickey University of Oregon Pbis.org.

Leadership within SW-PBS: Following the Blueprints for Success Tim Lewis, Ph.D. University of Missouri OSEP Center on Positive Behavioral Intervention.

Positive Behavioral Interventions and Supports Going to Scale in Maryland’s Local School Systems

Evaluation in Michigan’s Model Steve Goodman National PBIS Leadership Forum October, 2011

Evaluation in Michigan’s Model Steve Goodman National PBIS Leadership Forum October, 2010

Northern California PBIS Symposium November 18, 2013.

Washington PBIS Conference Northwest PBIS Network Spokane, WA November 2013 Nadia K. Sampson & Dr. Kelsey R. Morris University of Oregon.

Rob Horner University of Oregon Implementation of Evidence-based practices School-wide behavior support Scaling evidence-based practices.

Support systems and sustained implementation of a data-driven, problem-solving model Margie McGlinchey MAASE Summer Institute August 11, 2009 Steve Goodman.

MU Center for SW-PBS College of Education University of Missouri Missouri SW-PBS Annual Reporting pbismissouri.org.

Dean Fixsen, Karen Blase, Rob Horner, and George Sugai University of North Carolina – Chapel Hill University of Oregon University of Connecticut Scaling.

The District Role in Implementing and Sustaining PBIS

9/15/20151 Scaling Up Presentation: SIG/SPDG Regional Meeting October 2009 Marick Tedesco, Ph.D. State Transformation Specialist for Scaling Up.

Linking Behavior Support and Literacy Support Rob Horner and George Sugai University of Oregon and University of Connecticut OSEP TA Center on Positive.

School-Wide Positive Behavior Support District Planning Louisiana Positive Behavior Support Project.

Rob Horner University of Oregon Current assumptions/research about coaching Define the experience with coaching in SWPBS implementation.

Blending Academics and Behavior Dawn Miller Shawnee Mission School District Steve Goodman Michigan’s Integrated Behavior and Learning.

Establishing Training Capacity for Classroom Management Heather Peshak George, Ph.D. Kim Herrmann, S.S.P. University of South Florida Marla Dewhirst Illinois.

Implementing School-wide PBIS Pennsylvania PBIS Implementer’s Forum Rob Horner University of Oregon.

Scaling up and sustaining an integrated behavior and reading schoolwide model of supports November 18, 2008.

PBIS in Urban Settings Presented by Christine McGrath, Ph.D., PBIS Trainer The May Institute Association for Positive Behavior Supports March 27, 2009.

Coaching for Competence Margie McGlinchey SPDG Regional Mtg. October 1, 2009 Steve Goodman Margie McGlinchey Kathryn Schallmo Co-Directors.

School-wide Positive Behavior Support February 24, 2004 Rachel Freeman, University of Kansas Beth Robinett, Topeka 501 (

Developing a Comprehensive State-wide Evaluation for PBS Heather Peshak George, Ph.D. Donald K. Kincaid, Ed.D.

“Lessons learned” regarding Michigan’s state-wide implementation of schoolwide behavior and reading support Margie McGlinchey Kathryn Schallmo Steve Goodman.

PBIS Meeting for BCPS Team Leaders and Coaches March 14, 2008 Oregon Ridge.

Effective Behavioral & Instructional Support Systems Overview and Guiding Principles Adapted from, Carol Sadler, Ph.D. – EBISS Coordinator Extraordinaire.

Positive Behavioral Interventions and Supports Going to Scale in Maryland’s Local School Systems

PBIS Team Training Baltimore County Public Schools Positive Behavioral Interventions and Supports SYSTEMS PRACTICES DA T A OUTCOMES July 16, 2008 Secondary.

Winston/Salem Forsyth County Schools RESPONSIVENESS TO INSTRUCTION (RTI)

“Sustaining & Expanding Effective Practices: Lessons Learned from Implementation of School-wide Positive Behavior Supports” Susan Barrett, Cyndi Boezio,

IN NORTH THURSTON PUBLIC SCHOOLS KATY LEHMAN PBIS SPECIALIST MAY 22, 2013 PBIS Implementation.

E VALUATION FOR S CHOOL - WIDE PBIS Bob Algozzine University of North Carolina: Charlotte Rob Horner University of Oregon December 9, 2011.

DEVELOPING AN EVALUATION SYSTEM BOB ALGOZZINE AND STEVE GOODMAN National PBIS Leadership Forum Hyatt Regency O’Hare Rosemont, Illinois October 14, 2010.

Bob Algozzine Rob Horner National PBIS Leadership Forum Chicago Hyatt Regency O’Hare October 8, /

DEVELOPING AN EVALUATION SYSTEM FOR SWPBS Rob Horner and Bob Algozzine.

Providing Technical Assistance for Evidence-based Practices Rob Horner OSEP TA-Center on PBIS

“Sustaining & Expanding Effective Practices: Lessons Learned from Implementation of School-wide Positive Behavior Supports” Susan Barrett Cyndi Boezio,

Evaluation Planning & Reporting for School Climate Transformation Grant (SCTG) Sites Bob Algozzine University of North Carolina at Charlotte Steve GoodmanMichigan's.

DEVELOPING AND IMPLEMENTING STATE-LEVEL EVALUATION SYSTEMS BOB ALGOZZINE, HEATHER REYNOLDS, AND STEVE GOODMAN National PBIS Leadership Forum Hyatt Regency.

Evidence-based Practices: A Technical Assistance Perspective Lou Danielson, Chair Brian Cobb, Susan Sanchez, Kathleen Lane, Rob Horner

School-Wide Positive Behavioral Interventions and Supports: District Coaches’ Meeting Donna Morelli Cynthia Zingler Education Specialists Positive Behavioral.

Scaling and Sustaining PBIS: State, District, School Roles Rob Horner University of Oregon

Detroit Public Schools Data Review and Action Planning: Schoolwide Behavior Spring

State and District-level Role in Implementation, Scaling and Sustaining PBIS Session A-3 Washington Leadership Discussion Rob Horner University of Oregon.

Leadership Teams Implementing PBIS Module 14. Objectives Define role and function of PBIS Leadership Teams Define Leadership Team’s impact on PBIS implementation.

School-wide Positive Behavior Support: Linking Social and Academic Gains Washington Association of School Administrators Rob Horner University of Oregon.

Coaching Within a Statewide Multi-Tiered System of Supports (MTSS) Steve Goodman miblsi.cenmi.org December 6, 2010.

Data Driven Decisions: Using the Tools Susan Barrett, Jerry Bloom PBIS Maryland Coaches Meeting October 2007

Scaling & Sustaining Evidence-Based Practices Glen Dunlap, Steve Goodman, Tim Lewis, Rob Horner & George Sugai OSEP Center on PBIS OSEP Project Directors’

Lessons Learned in SWPBS Implementation: Sustainability & Scaling Up George Sugai OSEP Center on PBIS Connecticut January 15,

District Implementation of PBIS C-1 Rob Horner Brian Megert University of Oregon Springfield School District.

PBIS Coaches Training Day 3. OUR NORMS Confidentiality * Active participation * Professional use of technology * Assume best intentions Agenda Welcome.

Iowa Behavior Alliance: School-wide PBS Third Annual State Conference October 2-3, 2007.

School-wide Positive Behavioral Interventions and Supports District-wide Implementation: Ensuring Success Kentucky Center for Instructional Discipline.

D1- Leveraging PBIS Implementation Leader Presenters: Rob Horner, University of Oregon Caryn Ward, University of North Carolina (SISEP) Key Words:

Current Issues Related to MTSS for Academic and Behavior Difficulties: Building Capacity to Implement PBIS District Wide at All Three Tiers OSEP conference.

Miblsi.cenmi.org Helping Students Become Better Readers with Social Skills Necessary for Success Steve Goodman Funded through OSEP.

North Carolina Positive Behavior Support Initiative

Presentation transcript:

1 Implementing a Three-Tiered State Evaluation Structure Bob Putnam The May Institute Karen Childs University of South Florida 2009 National PBIS Leadership Forum

Goals of Session Present the purpose of a state-wide evaluation Provide exemplars of the core components of three tier state-wide evaluations Provide an ongoing state-wide evaluation system

Purpose of Statewide SWPBS Evaluation Evaluation is the process of gathering information for decision-making. SWPBS decisions focus on levels of adoption, adaptation, and replication. –Efficiency –Effectiveness –Sustainability –Wide-spread adoptability 3

Core Indicators These indicators include considerations about the –context in which implementation of SWPBS is to occur –inputs available to guide and assist with implementation –fidelity with which core elements of SWPBS are put in place –impact of those core elements on the social and academic behavior of students. Assess the breadth of adoption, and sustainability of implementation. 5 Algozzine, Horner, Sugai, Barrett, Eber, Kincaid & Lewis, 2009

Context What are/were the goals and objectives for SWPBS implementation? Who provided support for SWPBS implementation? Who received support during SWPBS implementation? 6

Context Who received support during SWPBS implementation?

Input What professional development was part of SWPBS implementation support? Who participated in the professional development? What was the perceived value of the professional development? 8

Participating Schools 2004 Schools (21) 2005 Schools (31) 2006 Schools (50) 2000 Model Demonstration Schools (5) 2008 Schools (95) Who Is Receiving Training and Support?

Training/Technical Assistance More than three-fourths of the counties in the state have at least one school participating in the North Carolina Positive Behavior Support Initiative. Who Is Receiving Training and Support?

Tier 2 & Tier 3 Who Is Receiving Training and Support?

Tier 2 & Tier 3 Who Is Receiving Training and Support?

Tier 3 Who Is Receiving Training and Support?

Fidelity To what extent was SWPBS implemented as designed? To what extent was SWPBS implemented with fidelity? 14

School-Wide Evaluation Tool 35 Coaches trained as SET assessors 15 Contractual SET assessors 97 SETs completed SETs completed SETs completed schools have at least two SET scores 80% Total score is considered Maintenance Phase (IPI) All regions met 80% criterion across schools 69% increase after one year of implementation To What Extent Have Practices Changed?

SET Scores by Region To What Extent Have Practices Changed?

Tier 3 To What Extent Have Practices Changed?

Tier 3 To What Extent Have Practices Changed?

Impact To what extent is SWPBS associated with changes in student outcomes? To what extent is SWPBS associated with changes in other areas of schooling? 21

What extent is SWPBS associated with changes in student behavior?

What extent is SWPBS associated with changes in student behavior?

Tier 2 & 3 What extent is SWPBS associated with changes in student outcomes?

Percent of Students at DIBELS Benchmark (Spring) and Major Discipline Referrals per 100 Students To What Extent has Behavior and Academic Performance Changed?

MiBLSi Schools and Reading MEAP: Average Total Office Discipline Referrals per 100 Students per Day To What Extent has Academic Performance Changed?

MEAP- 4 th grade Reading Assessment 29 Elementary Schools In Michigan Schoolwide: Over 55% of major discipline referrals from classroom Schoolwide: Under 55% of major discipline referrals from classroom Probability of scoring below 75% proficiency on 4 th grade MEAP (Reading):.78 Probability of scoring above 75% proficiency on 4 th grade MEAP (Reading):.75 To What Extent has Academic Performance Changed?

North Carolina Positive Behavior Support Initiative [A]chievement causes [B]ehavior? [B]ehavior causes [A]chievement? [Context causes [A]chievement and [B]ehavior? To What Extent has Academic Performance Changed?

Replication, Sustainability, and Improvement To what extent did SWPBS implementation improved capacity for the state/region/district to replicate, sustain, and improve behavior and other outcomes? To what extent did SWPBS implementation change educational/behavioral policy? To what extent did SWPBS implementation affect systemic educational practice? 29

What is the breadth of adoption, and sustainability of implementation?

What is the breadth of adoption, and sustainability of implementation?

Conclusions Increase of states reporting on the implementation of SWPBS Information on implementation and outcomes of Tier 1 interventions more available than Tier 2 and 3 interventions Research is needed on the types of and presentations of data included in state evaluations that will have best outcome on funding, visibility, political support and policy.

For More Information Bob Putnam, Senior Vice President of School Consultation May Institute Phone: (781) ) Website: Karen Elfner Childs, Research & Evaluation Coordinator Florida’s PBS Project Phone: (813) Website: