TFI = “Teams Find Information” to Action Plan! PBIS Minnesota Summer Institute Roseville, MN June 21, 2016 Survey the audience for PBIS experience? Survey the audience for team level – school/program, charter/district/coop, region? Megan Gruis – Metro Regional Implementation Project Garrett Petrie – Minnesota Department of Education pbisMN.org

Takeaways TFI provides school teams with quick and relevant information to action plan PBIS implementation. The more school teams use the TFI, the more districts, regions and our state can support schools! We love to share MN-made tools that aggregate TFI data to help districts and regions make decisions that support schools pbisMN.org

Contact Us pbisMN.org

Follow Us Too! twitter.com/pbisMN facebook.com/pbisMN pbisMN.org

Learning Objectives Understand the background of the Tiered Fidelity Inventory (TFI) Learn how to administer the TFI and use the reporting features Get tips & tricks for preparing and taking TFI See how to use TFI tools for decision-making Q&A and exploratory time to log-in and look at TFI items pbisMN.org

Highlighting PBIS Implementation at: Saint Paul Public Schools District 625 Saint Paul, MN spps.org pbisMN.org

School-wide PBIS Tiered Fidelity Inventory Version 2.1 pbisMN.org

Understand the background of the Tiered Fidelity Inventory (TFI) Objective 1: Understand the background of the Tiered Fidelity Inventory (TFI) pbisMN.org

Purpose of School-wide PBIS Tiered Fidelity Inventory The purpose of the School-wide PBIS Tiered Fidelity Inventory is to provide an efficient and valid index of the extent to which PBIS core features are in place within a school. Tier I (Universal PBIS) Whole School Universal Prevention Tier II (Targeted PBIS) Secondary, Small Group Prevention Tier III (Intensive PBIS) Tertiary, Individual Support Prevention pbisMN.org

Fit with Existing Assessment Instruments The School-wide PBIS Tiered Fidelity Inventory (TFI) is intended to fulfill the same functions as the: Team Implementation Checklist (TIC) Benchmarks of Quality (BoQ) Benchmarks of Advanced Tiers (BAT) PBIS Self-Assessment Inventory (SAS) Phases of Implementation (POI) The TFI addresses all three tiers, and focuses on those elements of PBIS that are most “core” to achieving student outcomes. There is no problem continuing to use prior measures. The TFI is intended to be more efficient, but other measures may be more comprehensive, and will remain available. pbisMN.org

Tiered Fidelity Inventory Crosswalk Interested in where the TFI questions came from? TFI pulls questions from the other PBIS Assessment Tools Many questions are a combination of questions from the other assessment tools Some questions introduce new language and new “look fors” PBIS Assessment Crosswalk for the TFI pbisMN.org

SWPBIS TFI is a Team Self-Assessment Primary purpose of the instrument is to help school teams improve Primary audience for instrument results is the team, faculty, families and administrators of the school. Effective use of the instrument requires multiple administrations (progress monitoring) pbisMN.org

Uses of the SWPBIS TFI Formative Assessment Determine current PBIS practices in place and needed prior to launching implementation Progress monitoring Self-assess PBIS practices by tier to guide implementation efforts, and assess progress by tier Build action plan to focus implementation efforts Annual Self-Assessment Self-assess annually to facilitate sustained implementation of PBIS State Recognition Determine schools warranting recognition for their fidelity of PBIS implementation. pbisMN.org

Learn how to administer the TFI and use the reporting features Objective 2: Learn how to administer the TFI and use the reporting features pbisMN.org

TFI Manual via PBISApps Or just Google . . . “TFI PBISApps MANUAL” https://www.pbisapps.org/Resources/SWIS%20Publications/SWPBIS%20Tiered%20Fidelity%20Inventory%20(TFI).pdf pbisMN.org

Administration Protocol School-wide PBIS Tiered Fidelity Inventory is completed by a school team with a PBIS coach/facilitator. pbisMN.org

Before TFI Assessment: Define schedule Define personnel Review existing fidelity and outcome data Obtain relevant permanent products Conduct a building walkthrough to identify data related to the school-wide acknowledgement system pbisMN.org

During TFI Assessment: For each item, review purpose, data sources, and standard. All team members vote whether the item is: Not implemented – 0 Partially implemented – 1 Fully implemented – 2 The majority vote is recorded following an opportunity for discussion Data are recorded on PBISAssessment.org pbisMN.org

After TFI Assessment: At least one item is identified for active action planning to improve or sustain implementation. pbisMN.org

Typical Sequence of Administration Schedule date and define expectations—time, people, materials Determine at this point which tiers will be reviewed Administration of Inventory Coach walkthrough- page 27-28 of manual Recommended to have an external coach complete If team is completing more than once per year, internal coach is acceptable 30-60 min per tier reviewed Action Plan Development May be done at same time or at a later meeting 20 min per tier reviewed pbisMN.org

Possible Pre-Administration Documentation Tier I School team organizational chart (if available) School/ District policies on social behavior/support Team meeting minutes (last 3 meetings) Student handbook Professional development plan for past year Prior PBIS fidelity measures (last two years) Student behavioral data summary for past month Major ODR/Day/Month compared to the national median Universal screening measures and process Any prior evaluation reports focused on social behavior Any reports to school administration or board focused on social behavior pbisMN.org

Walkthrough Tool The interview and observation portion of the SET Interview at least 5 staff members and ask them: What are the (school rules)? Have you taught them to students this year? Have you given out any _____ since ______? Interview at least 10 students: What are the school rules? Have you received any _____ since ______? Can be completed two ways: 1. By an External Reviewer for evaluation purposes. 2. By a member of the school team for progress monitoring purposes. pbisMN.org

Walkthrough Tool pbisMN.org

Nuts & Bolts The TFI is located on PBISApps.org Username and log-in required pbisMN.org

PowerPoint to guide your team through TFI Feature Data Sources Scoring Criteria 0 = Not implemented 1 = Partially implemented 2 = Fully implemented Feature Name: Detailed description of the feature. Possible data sources   0 = descriptors of the feature not being implemented 1 = descriptors of the feature being partially implemented 2 = descriptors of the feature being fully implemented Main Idea: the essence of the feature. There is a ppt. to guide administration of the TFI. pbisMN.org

Quick Check: Feature Name Scoring 0 = descriptors of the feature not being implemented 1 = descriptors of the feature being partially implemented 2 = descriptors of the feature being fully implemented Self-Assessment Question Documentation Process Product Data These are sample slides from the TFI ppt. to guide administration of the tool Reflective question to focus the conversation? pbisMN.org

Slide Deck for Administration pbisMN.org

Reviewing Scoring & Action Planning This is a sample question as it appears in pbisapps. pbisMN.org

TIPS & Tricks for preparing and taking the TFI Objective 3: TIPS & Tricks for preparing and taking the TFI pbisMN.org

Top 10 Administration Notes Before Administration 10. Discuss the “Pre-Administration Items for Review” with the coach/admin on the PBIS team and find a time for the walk-through (if administering). 9. Forward all pertinent resources (action planning guides, Tier II, Tier III worksheets, etc.) to the team for review prior to administration of TFI. 8. Reserve a location with an LCD/smartboard or the like to load the “TFI with Teams” slides that display the questions for teams. pbisMN.org

Top 10 Administration Notes During Administration 7. Open survey in PBIS Applications, and have the survey loaded on a second computer. Have the PBIS Coach or other designee entering scores while going through TFI. 6. Make sure to have ample space that is set-up for teams to be able to discuss and interact. 5. Take into consideration team dynamics and keeping the team focused on the task at hand with discussion TFI items. 4. Keep focused on seeing all team members participating. Consider using hand signals to note feedback from all. pbisMN.org

Top 10 Administration Notes After Administration 3. Log-in to pbisapps.org to access the TFI results and put them on the LCD/smartboard. Have the PBIS coach or designee pull up the action planning forms on Google drive or hardcopy. 2. Quickly go through the overall results, concentrating more on item analysis and action planning on the items that were scored a 0 or 1. Leave the team with some hands on action planning that is written down with a timeline. 1. Follow-up with team to check-in on action planning and continued use of the TFI. pbisMN.org

St. Paul Public Schools Implement SPPS started dipping their toes in TFI implementation this spring. Met with all PBIS team leads this spring and trained them on the TFI. Encouraged all schools to try out Tier 1 of the TFI in place of the TIC. Several schools found benefit and did Tier 1, Tier 2, and Tier 3. Did not tackle an inter-district coach exchange or using the walkthrough tool. pbisMN.org

St. Paul Public Schools Implement Feedback from participating schools: Liked the inherent scoring rubric provided with the TFI. Concrete placement at a 0-1-2 based on the questions and examples needed. Shows the ideals that teams can strive for. Liked that it was a bit shorter than the TIC. Questions that SPPS teams found so favorable on the TIC were not on the TFI. pbisMN.org

St. Paul Public Schools Implement Feedback from the District Level: Note to use the scaled scoring if you are only completing 1 or 2 Tiers. Use the Total Score Report if you completed all 3 Tiers. Having the option to take all 3 Tiers at once or just 1 or 2 is a great feature of the tool. pbisMN.org

See how to use TFI tools for decision-making Objective 4: See how to use TFI tools for decision-making pbisMN.org

Summary Data and Reports Total Score Subscale Sub-subscale Individual Items Note: 70% is benchmark for Tier 1 to indicate “implementation at criterion” Criterion for Tiers 2 & 3 have not yet been determined. pbisMN.org

Total Report pbisMN.org

Scale Report pbisMN.org

Subscale Report pbisMN.org This is a an sample report. The sub subscale report pbisMN.org

Items Report Tier I Tier II Tier III Teams Implementation Evaluation Interventions Tier III Resources Assessment Support plan Monitoring and adaptation pbisMN.org

Data-Based Decision Making Action Planning •Choose 1-3 items to take action on •Develop a plan to share with staff to increase their knowledge and willingness to participate •Your External Facilitator will help guide your action planning Never take a pbis assessment without using it for continuous improvement of implementation pbisMN.org

What districts, Regions and States can do with TFI Here’s a collective bonus . . . What districts, Regions and States can do with TFI pbisMN.org

Aggregating TFI Items Across Schools! PBISApps.org Username and log-in required Assessment Schools, districts, regions, and states implementing SWPBIS develop an evaluation plan to: Address assessment questions. Select assessment measures and a schedule for completing them, which meet the needs of local decision makers. Use assessment data for decision making at the school, district, region, and state levels. Typically, schools and districts start with implementation and assessment of Universal (Tier I) systems. When Targeted (Tier II) and Intensive (Tier III) systems are added, assessments of these tiers are integrated into the evaluation. PBIS Assessment provides school, district, region, and state teams with the data to determine: To what extent was SWPBIS implemented with fidelity across all three tiers? For further information on Evaluation, see the Evaluation Blueprint for School-Wide Positive Behavior Support. pbisMN.org

Open Reports in Separate Window SWPBIS TFI 2.1 Download From: Current School-year Assessment Schools, districts, regions, and states implementing SWPBIS develop an evaluation plan to: Address assessment questions. Select assessment measures and a schedule for completing them, which meet the needs of local decision makers. Use assessment data for decision making at the school, district, region, and state levels. Typically, schools and districts start with implementation and assessment of Universal (Tier I) systems. When Targeted (Tier II) and Intensive (Tier III) systems are added, assessments of these tiers are integrated into the evaluation. PBIS Assessment provides school, district, region, and state teams with the data to determine: To what extent was SWPBIS implemented with fidelity across all three tiers? For further information on Evaluation, see the Evaluation Blueprint for School-Wide Positive Behavior Support. pbisMN.org

“Generate” the “Download” Organization School Generate Will download a raw data Excel file Assessment Schools, districts, regions, and states implementing SWPBIS develop an evaluation plan to: Address assessment questions. Select assessment measures and a schedule for completing them, which meet the needs of local decision makers. Use assessment data for decision making at the school, district, region, and state levels. Typically, schools and districts start with implementation and assessment of Universal (Tier I) systems. When Targeted (Tier II) and Intensive (Tier III) systems are added, assessments of these tiers are integrated into the evaluation. PBIS Assessment provides school, district, region, and state teams with the data to determine: To what extent was SWPBIS implemented with fidelity across all three tiers? For further information on Evaluation, see the Evaluation Blueprint for School-Wide Positive Behavior Support. pbisMN.org

Raw Data Sheets Inserted Into Template . . . Lead to: Collective indicators of need District-wide Region-wide Statewide Inform the “Tier 1” professional development of Tier 1 positive behavior supports! i.e., “What do most of our schools need from us?” pbisMN.org

Aggregated & Averaged Charts pbisMN.org

Aggregated & Averaged Charts pbisMN.org

Aggregated & Averaged Charts pbisMN.org

Items Report – Aggregated! School-Wide PBIS (SWPBIS) Tiered Fidelity Inventory All Schools   Metro Region School Year: 2015-16 Date Completed: 8/2015 - 6/2016 Tier I: Universal SWPBIS Features Teams Fall 15 Spring 16 1. Team Composition: Tier I team includes a Tier I systems coordinator, a school administrator, a family member, and individuals able to provide (a) applied behavioral expertise, (b) coaching expertise, (c) knowledge of student academic and behavior patterns, (d) knowledge about the operations of the school across grade levels and programs, and for high schools, (e) student representation. 1.15 1.34 2. Team Operating Procedures: Tier I team meets at least monthly and has (a) regular meeting format/agenda, (b) minutes, (c) defined meeting roles, and (d) a current action plan. 1.03 1.65 Feature Total: 2.18 2.98 out of 4 Implementation 3. Behavioral Expectations: School has five or fewer positively stated behavioral expectations and examples by setting/location for student and staff behaviors (i.e., school teaching matrix) defined and in place. 1.38 1.91 pbisMN.org

TFI Resources bit.ly/TFIResources Pre-Administration & Preparation Supports for Tier II/Tier III and Action Planning TFI Manual Pre-Administration Documentation TFI Crosswalk with PBIS Assessment Tools Administering the TFI with Teams Slide Presentation Targeted Interventions Reference Guide Map Tier III Support Plan Worksheet Action Planning Guide There are additional resources available to help with preparing for the TFI and action planning following the TFI bit.ly/TFIResources pbisMN.org

Takeaways (then “Make-aways”) TFI provides school teams with quick and relevant information to action plan PBIS implementation. The more school teams use the TFI, the more districts, regions and our state can support schools! We love to share MN-made tools that aggregate TFI data to help districts and regions make decisions that support schools pbisMN.org

Q&A and exploratory time to log-in and look at TFI items Objective 5: Q&A and exploratory time to log-in and look at TFI items pbisMN.org

Shameless plug . . . pbisMN.org

Applying for Cohort Training Cohort application guides you through Exploration activities to form a team and get data system in place. Teams get the pre-requisites in place to be ready for PBIS Installation, including commitment to data collection and analysis. http://www.pbismn.org/gsapplication.html This school application requires school-wide team that is representative of that school. This applying school team represents the unit that all teams above need to support so that student outcomes will be positive. This application is reviewed by a state team member as well as a regional team member to determine fit for the school. In addition, there is a requirement in the application to name the members of a district team if more than one school is or will be implementing PBIS Data requirement is spelled out as well as commitment and buy-in. Exploration/formation of District team The lets teams know what will be required of them as well as what the training will provide. pbisMN.org 56 pbisMN.org

MN SW-PBIS Regional Implementation Projects Team-based training 9 training days over two years Distributed, team-based implementation of PBIS Intended to build capacity, skills, competency and beliefs to sustain implementation beyond initial training in a school pbisMN.org

North Regional Contacts North Regional Implementation Project Erin Engness NRIP Coordinator pbis.erin@gmail.com  320-267-7818 Karie Belling NRIP Conference Planner belling@charter.net 320-529-9631 320-309-9735 cell PBIS Management - Regional Contacts Eric Kloos Eric.Kloos@state.mn.us  651-582-8268 Mary Hunt Mary.Hunt@state.mn.us 651-582-8676 Ellen Nacik Ellen.Nacik@state.mn.us 651-582-8665 PBIS Evaluation Contact Wilder Research pbisevalmn@wilder.org 651-280-2960 Find other MN PBIS contacts on our website: www.pbismn.org/contactus.html pbisMN.org

Metro Regional Contacts Metro Regional Implementation Project Ingrid Aasan Regional Implementation Project Coordinator  Ingrid.Aasan@metroecsu.org 612-638-1517 Deborah Saxhaug Regional Implementation Project Coordinator dsaxhaug@macmh.org  Emily Robb Coach Coordinator pbis.emily@gmail.com  Megan Gruis Data & Evaluation Coordinator pbis.megan@gmail.com PBIS Management - Regional Contacts Eric Kloos Eric.Kloos@state.mn.us  651-582-8268 Maci Spica Brianna.Spica@state.mn.us 651-582-8596 Garrett Petrie Garrett.Petrie@state.mn.us 651-582-8396 PBIS Evaluation Contact Wilder Research pbisevalmn@wilder.org 651-280-2960 Find other MN PBIS contacts on our website: www.pbismn.org/contactus.html pbisMN.org

South Regional Contacts South Regional Implementation Project Teresa Hunt SRIP Coordinator Teresa.Hunt@swsc.org 507-537-2245 PBIS Management - Regional Contacts Eric Kloos Eric.Kloos@state.mn.us  651-582-8268 Aaron Barnes Aaron.Barnes@state.mn.us  651-582-8592 PBIS Evaluation Contact Wilder Research pbisevalmn@wilder.org 651-280-2960 Find other MN PBIS contacts on our website: www.pbismn.org/contactus.html pbisMN.org

Contact Us Megan Gruis pbis.megan@gmail.com Kristi Kohn kristi.kohn@spps.org Erin Metz erin.metz@spps.org Garrett Petrie garrett.petrie@state.mn.us pbisMN.org