1. The Importance of Coaching in Implementation of Evidence-based Practices Rob Horner University of Oregon www.pbis.org

2. Goals Current assumptions/research about coaching Define our experience with coaching in PBS implementation Implications for building district capacity

3. Coaching Defined Coaching is the active and iterative delivery of: ◦ (a) prompts that increase successful behavior, and ◦ (b) corrections that decrease unsuccessful behavior. ◦ Coaching is done by someone with credibility and experience with the target skill(s) ◦ Coaching is done on-site, in real time ◦ Coaching is done after initial training ◦ Coaching is done repeatedly (e.g. monthly) ◦ Coaching intensity is adjusted to need

4. Outcomes of Coaching Fluency with trained skills Adaptation of trained concepts/skills to local contexts and challenges  And new challenges that arise Rapid redirection from miss-applications Increased fidelity of overall implementation Improved sustainability  Most often due to ability to increase coaching intensity at critical points in time.

5. Training Outcomes Related to Training Components Training Outcomes Training Components Knowledge of Content Skill Implementation Classroom Application Presentation/ Lecture Plus Demonstration Plus Practice Plus Coaching/ Admin Support Data Feedback 10% 5% 0% 30% 20% 0% 60% 60% 5% 95% 95% 95% Joyce & Showers, 2002

6. Coaching within SWPBS Implementation Context: ◦ 9000 schools implementing SWPBS nationally Defining the Role  Internal vs External Selecting Coaches Training and support for coaches Assessing Impact

7. Leadership Team Funding Visibility Political Support TrainingCoachingEvaluation Local Demonstration Schools Active Coordination Behavioral Expertise

8. Coaching vs. Training Coaching involves active collaboration and participation, but not group instruction. ◦ Small group ◦ Build from local competence ◦ Sustainable

9. Who should be a coach? Internal vs External  Internal coaches are employed in the school where they provide support  External coaches are employed outside the schools where they provide support (e.g. by district, region, state).

10. Who should be a coach? Internal CoachExternal Coach AdvantagesKnowledge of school Staff relationships Regular access Independent Outside perspective Multiple schools experience DisadvantagesConflicting roles Narrow range of experiences Limited knowledge of school Limited relationships Less frequent access

11. Who should be a coach Coaching Competencies NecessaryPreferred Participate in team training Able to attend team meetings at least monthly Effective working with adults Knowledgeable about school operating systems Professional Commitment Knowledge about SWPBS Knowledge about behavior support practices (targeted, individual) Skilled in collection and use of data for decision-making.

12. What Coaches Do Work with team during initial SW-PBS training Meet with new teams monthly on-site Telephone/email contact as needed “Positive” nag  Self-assessment (EBS Survey, Team Checklist)  Action planning  Activity implementation  On-going evaluation  School self-evaluation efforts  State-wide Initiative evaluation efforts (SET) Guide State-wide initiative  Feedback to Taskforce

13. What Coaches Do Dissemination of outcomes and effects SWIS Facilitation ◦ Implement and support use of data-based decision making.

14. Commitment of Coaches Team Support ◦ First Year ( 1-2 teams) (participate in training and planning) ◦ Second Year ( Maintain initial teams, start 3-5 teams) ◦ Future Years ( 10-15 teams total ) FTE commitment ◦ 20-50% Roles/Background ◦ Behavior Specialists, Special Education Teachers ◦ Consultants, Administrators ◦ School Psychologists, Counselors, Social Workers

15. Guiding Principles for Effective Coaching Build local capacity  Become unnecessary…but remain available Maximize current competence  Never change things that are working  Always make the smallest change that will have the biggest impact Focus on valued outcomes  Tie all efforts to the benefits for children Emphasize Accountability  Measure and report; measure and report; measure and report. Build credibility through:  (a) consistency, (b) competence with behavioral principles/practices, (c) relationships, (d) time investment. Precorrect for success

16. Specific Expectations ◦ Attend and participate in team training ◦ Meet with your team(s) at least monthly  Provide technical assistance as needed ◦ Monitor and report on team efforts  Team Checklist  EBS Survey/ SET/ ISSET  Annual Profile/Summary Data ◦ Present on School-wide PBS at district, state, national forums. ◦ Assist district to build capacity for sustained implementation (re-define your role over time) ◦ Meetings with Coordinator and Taskforce for purposes of state-wide planning

17. Assist Teams in Using Data for Decision-making Using Team-Checklist and EBS Survey data for Team Action Planning Using SET/ TIC data for evaluation Using ODR/ Academic (ORF) data for assessment, planning and reporting. Keeping faculty involved through regular data reporting.

18. Examples Illinois North Carolina Michigan

19. PBIS in Illinois July 17, 2008 Developing Local Systems of Care for Children and Adolescents with Mental Health Needs and their Families Training Institutes Nashville, TN Lucille Eber Ed.D. IL PBIS Network

20. PBIS Schools Over Ten Years: Trained & Partially or Fully Implementing

21. # IL PBIS Schools & # External Coaches June 30, 2008

22. The Organization of PBIS in Illinois 900 schools implementing SWPBS ISBE Coordination Chicago Coordinators North Coordinators Central Coordinators South Coordinators 46 Coaches (10) 33 Schools 495 Coaches (84) 525 Schools 193 Coaches (20) 203 Schools 105 Coaches (29) 127 Schools

23. Elementary Middle

24. Capacity Schools per Coach per Region

25. Illinois Suspension Rates per 100 PBS slope = -1.15 Non PBS slope = -.37

26. Illinois Suspension Rates per 100 for Black and Hispanic Students PBS Slope = -1.85 Non PBS Slope = -,34

27. North Carolina Positive Behavior Support Initiative Partners’ Update February 2009 Heather R. Reynolds NC Department of Public Instruction Bob Algozzine Behavior and Reading Improvement Center http://www.dpi.state.nc.us/positivebehavior/

28. State PBS Coordinator Heather R Reynolds North Carolina Positive Behavior Support Initiative

29. Office discipline referral data (majors) from schools implementing PBS in North Carolina [07-08] compare favorably with national averages.

30. North Carolina Positive Behavior Support Initiative Levels of behavior risk in schools implementing PBS were comparable to widely-accepted expectations and better than those in comparison schools not systematically implementing PBS.

31. North Carolina Positive Behavior Support Initiative [A]chievement causes [B]ehavior? [B]ehavior causes [A]chievement? [Context causes [A]chievement and [B]ehavior?.

32. Steve Goodman sgoodman@oaisd.org www.cenmi.org/miblsi

33. Goals 1. Share information about Michigan’s Integrated Behavior and Learning Support Initiative (MiBLSi) 2. Provide examples of improving the quality and quantity of the data collected 3. Provide examples of acting upon project data to improve outcomes

34. Participating Schools 2004 Schools (21) 2005 Schools (31) 2006 Schools (50) 2000 Model Demonstration Schools (5)

35. Project Data: Outcomes, Process and System Development

36. Major Discipline Referrals per 100 Students per Year (Schools implementing > 80% on Team Implementation Checklist)

37. DIBELS Instructional Recommendations and Major Discipline Referral per Cohort per Year DIBELS Benchmark Major Discipline Referrals

38. Participating School Example: Fourth Grade Reading MEAP Results Began MiBLSi Implementation

39. Improving the quality and quantity of project data

40. Percent of Process and System Data Collected by Cohort

41. Improving the accuracy and Consistency of Recording Office Discipline Referrals

42. Developing Fluency with Discipline Referral Categories Example Exercise 2: Match the example situation below to the correct problem behavior on the discipline categories answer sheet. Write the letter in the column for Exercise 2.

43. Acting on the Data to Improve Classroom Management

44. Major Discipline Referrals by Location Began focusing on classroom management support 2005-2006

45. MEAP- 4 th grade Reading Assessment 29 Elementary Schools In Michigan Schoolwide: Over 55% of major discipline referrals from classroom Schoolwide: Under 55% of major discipline referrals from classroom Probability of scoring below 75% proficiency on 4 th grade MEAP (Reading):.78 Probability of scoring above 75% proficiency on 4 th grade MEAP (Reading):.75

46. Improving Targeted Student Intervention Interviews with staff and self assessment indicate a need to develop targeted support systems

47. Checklist for Individual Student Support Systems (CISS) Results from Cohort 4 (n=34 schools)

48. Improving Targeted Student Intervention Strategies Building Leadership Teams: ◦ “Quick Sort” process for identifying students and linking to interventions Focused training for practitioners: ◦ Using Behavior Education Program (check in- checkout)

49. Supporting Coaches Conducting Self-Assessment to identify needs Providing support based on results ◦ Coach training 2 – 4 time per year ◦ Coach manual ◦ Coach website ◦ Coach conference (March 13-14)

50. Coaches Self-Assessment adapted from: Sugai, Todd and Horner, 2006

51. Example of the Impact of Coaching on Student Outcomes: Average Major Discipline Referrals per Day per Month Coach returns from leave

52. Working with School Teams to use data Data Review/Action planning with building leadership teams Pre-training coaches/principals in the data review content Providing worksheets to guide data review process

53. Team Evaluation of Outcome, Process and Systems Data

54. EBS Team Implementation Checklist by Feature

55. Lesson Learned Implementation cannot be faster than your school staff capacity to implement Teams need to be taught how to analyze and use data Emphasis on directing resources to need and removing competing activities

56. Building Capacity Statewide Districts need capacity to: ◦ Deliver regular training on core content  Annual orientation  Staff development ◦ Incorporate expectations in regular staff evaluations ◦ Provide expertise for more intense support need requirements.  Regular meetings with building personnel around “emerging challenges.”

57. Avoid passing the planning buck State asks districts to build a plan Districts ask schools to build a plan Schools ask teachers to build a plan

58. “Even if you’re on the right track, you’ll get run over if you just sit there” - Will Rogers