“Are We at Fidelity?”: Annual Evaluation and Action Planning

Using Data to Make Decisions There are two types of data that teams must use regularly: Student Outcome Data System Fidelity Data

What is fidelity and why is it important? “Only when effective practices are fully implemented should we expect positive outcomes.” “Implementation matters.” Blasé & Fixsen, 2005

Why Do We Self-Assess? Action Plan Implementation Evaluation Annual Assessments Sustainability

Accessing the PBIS Assessments

Video Tutorials

WI PBIS Network Recommended Assessment Schedule Self-Assessment Survey (SAS) Baseline Annually – fall Full staff Team Implementation Checklist (TIC) Progress monitor 2x per year—fall-Winter Team - consensus Benchmarks of Quality (BoQ) Annually – spring Team Tiered Fidelity Inventory (TFI) Not yet determined Fidelity Score 80% 70% Optional Until more Research is conducted Handout: ASSESSMENTS SUPPORT DOCUMENT:

Primary & Supplemental Fidelity Tools

Benchmark of Quality (BoQ) Examines Universal (Tier I) implementation fidelity. Documents whether the Tier I implementation has been effective. Can be used to identify strengths and weaknesses in the Tier I implementation. Taken annually – usually in the spring. Taken by the PBIS leadership team. Fidelity is reached at 70% or higher.

Uses of the BoQ Formative Assessment – Determine current PBIS practice in place and needed prior to launching implementation. Annual Self-Assessment – Self-assess annually to facilitate sustained implementation of PBIS. State Recognition – Determine schools warranting recognition for their fidelity of PBIS implementation.

Example of BoQ Graphs Total Score Subscale BoQItems

SW-PBIS Tiered Fidelity Inventory (TFI) The purpose of the TFI is to provide an efficient and valid index of the extent to which PBIS core features are in place within a school. Unlike the BoQ, the TFI includes a building walk- though to identify data related to the school-wide acknowledgement system The WI PBIS Network recommends that the TFI is taken annually in the spring (like the BoQ). Taken by the PBIS leadership team. Fidelity is reached at 70% or higher.

Uses of the TFI Formative Assessment – Determine current PBIS practice in place and needed prior to launching implementation. Progress Monitoring – Self-assess PBIS practices by tier to guide implementation efforts and asses progress by tier. Annual Self-Assessment – Self-assess annually to facilitate sustained implementation of PBIS. State Recognition – Determine schools warranting recognition for their fidelity of PBIS implementation.

Action Planning TFI Action Plan exampleBoQ Action Plan example

Resources TFI Resources – TFI Walkthrough Video – TFI Training Slide Deck – TFI Action Plan BoQ Resources – BoQ Scoring form (includes action plan) – BoQ Team Member Rating form – Scoring Guide

Thank you!

Self Assessment Survey (SAS) Purpose: Staff perceptions of current positive behavior support system Status of “in place” Priority for improvement School-wide (19 items) Non-classroom—specific setting (9 items) Classroom (11 items) Individual student (8 items) To Do Task List

Example of PBS SAS Individual Summaries Chart

Analysis of School-wide System Chart Expectations defined (question 1) Expectations taught (question 2) Reward system (question 3) Violations system (question 4-8) Monitoring (question 10-12) Management (question 9, 14-16) District support (question 17-18) Expectations defined (question 1) Expectations taught (question 2) Reward system (question 3) Violations system (question 4-8) Monitoring (question 10-12) Management (question 9, 14-16) District support (question 17-18) Fidelity Score

White = In Place Yellow = Partially In Place Red = Not In Place White = In Place Yellow = Partially In Place Red = Not In Place