1. Barbara Sims Dean Fixsen Karen Blase Caryn Ward National SISEP Center National Implementation Research Network FPG Child Development Center University of North Carolina at Chapel Hill Lake Geneva WI October 2014 Building Implementation Capacity Innovation and Implementation Conference II

2. EBPs Students cannot benefit from interventions they do not receive.

3. WHY: Educationally Significant Outcomes WHAT: Effective & Usable Practices and Programs WHO & HOW: Effective Implementation Methods WHERE: Enabling Contexts Formula for Success

4. WHY Educationally Significant Outcomes WHAT Effective Innovations WHERE Enabling Contexts Formula for Success Students cannot benefit from instruction they do not experience

5. Active Implementation Frameworks WHO Teams WHEN Stages HOW Drivers HOW Cycles WHAT Usable Interventions

6. WHY: Educationally Significant Outcomes WHAT: Effective & Usable Practices and Programs WHO & HOW: Effective Implementation Methods WHERE: Enabling Contexts Formula for Success

7. USABLE INTERVENTIONS An intervention needs to be teachable, learnable, doable, and be readily assessed in practice. Usable Interventions

8. Operational Definitions Clear Description Fidelity Assessment Essential Functions

9. Implications for Sustainability and Scalability  We tend to over-estimate how well defined “it” is  We find out when we start to Install “it”  Help Schools and Districts choose wisely based on:  Needs of students  Best evidence  Fit and Resources Required  Readiness and resources for replication Usable Interventions

10. Implications for Sustainability and Scalability  Help Schools and Districts “operationalize” the WHAT  Practice Profiles  Help Schools and Districts “make space” for the new work  Supportive policies and practices Usable Interventions

11. Usable Interventions Tools You Can Use Hexagon Tool Practice Profiles Usable Interventions

13. Try It Now! Usable Interventions  Select 3-5 Indicators  Consider the following factors:  What will it look like if this indicator is being implemented with fidelity?  What is an acceptable variation of this in early stages of implementation?  Identify any red flags that indicate unacceptable variations Supporting New Ways of Work

14. WHY: Educationally Significant Outcomes WHAT: Effective & Usable Practices and Programs WHO & HOW: Effective Implementation Methods WHERE: Enabling Contexts Formula for Success

15. IMPLEMENTATION TEAMS Organized, expert assistance to develop and sustain an accountable and effective structure

16. Implementation Team No Implementation Team 80% 3 Years 80% 3 Years 14% 17 Years 14% 17 Years To “Making it Happen”From “Letting it Happen” Sources: Fixsen, Blase, Timbers, & Wolf, 2001 Balas & Boren, 2000 Green & Seifert, 2005 Saldana & Chamberlain, 2012 Improvement in Intervention Outcomes

17. Implications for Sustainability and Scalability  Teaming Structure  Accountable  Implementation Science informed  Lasting – Key to Sustainability  Linked – Key to Scalability  Why  Individual champions come and go  Structures host functions  Intentional use of data, improvement cycles Implementation Teams

18. WHY: Socially Significant Outcomes WHAT: Effective & Usable Practices and Programs WHO & HOW : Effective Implementation Methods WHERE: Enabling Contexts Formula for Success

19. IMPLEMENTATION STAGES Purposeful matching of critical implementation activities to the stage of the process

20. Implementation Stages ExplorationInstallation Initial Implementation Full Implementation 2-4 Years Assess needs Examine intervention components Consider Implementation Drivers Assess Fit Build sustainability Assess needs Examine intervention components Consider Implementation Drivers Assess Fit Build sustainability Acquire Resources Prepare Organization Prepare Implementation Drivers Prepare Staff Build sustainability Acquire Resources Prepare Organization Prepare Implementation Drivers Prepare Staff Build sustainability Adjust Implementation Drivers Manage Change Deploy Data Systems Initiate Improvement Cycles Build sustainability Adjust Implementation Drivers Manage Change Deploy Data Systems Initiate Improvement Cycles Build sustainability Monitor & Manage Implementation Drivers Achieve Fidelity & Outcome Benchmarks Further Improve Fidelity & Outcomes Sustainability Monitor & Manage Implementation Drivers Achieve Fidelity & Outcome Benchmarks Further Improve Fidelity & Outcomes Sustainability

21. Implementation Stages Tools You Can Use District Initiative Inventory Stages of Implementation Analysis Implementation Action Plan

22. District Initiative Inventory

23. The Hexagon An EBP Exploration Tool NEED FIT RESOURCES EVIDENCE CAPACITY READINESS Fit with current Initiatives School, district, state priorities Organizational structures Community values Need in school, district, state Academic & socially significant Issues Parent & community perceptions of need Data indicating need Resources and supports for: Curricula & Classroom Technology supports (IT dept.) Staffing Training Data Systems Coaching & Supervision Administration & system Evidence Outcomes – Is it worth it? Fidelity data Cost – effectiveness data Number of studies Population similarities Diverse cultural groups Efficacy or Effectiveness Capacity to Implement Staff meet minimum qualifications Able to sustain Imp Drivers Financially Structurally Buy-in process operationalized Practitioners Families Readiness for Replication Qualified purveyor Expert or TA available Mature sites to observe Several replications How well is it operationalized? Are Imp Drivers operationalized? The “Hexagon” can be used as a planning tool to evaluate evidence- based programs and practices during the Exploration Stage of Implementation. Download available at: www.scalingup.org/tools-and-resources EBP: 5 Point Rating Scale: High = 5; Medium = 3; Low = 1. Midpoints can be used and scored as a 2 or 4. HighMedLow Need Fit Resource Availability Evidence Readiness for Replication Capacity to Implement Total Score © 2009 Karen Blase, Laurel Kiser, & Melissa Van Dyke Adapted from work by Laurel J. Kiser, Michelle Zabel, Albert A. Zachik, and Joan Smith at the University of Maryland

25. Try It Now! Implementation Stages  Early Implementers: use the Hexagon Tool to assess potential program under consideration  Ongoing Implementation: Use the Stages of Implementation Analysis tool to identify gaps and next steps in your implementation Supporting New Ways of Work

26. IMPROVEMENT CYCLES Changing on purpose to support the new way of work

27. Rapid Cycle Problem Solving Improvement Cycles Plan DoStudy Act

28. Usability Testing Improvement Cycles Plan DoStudy Act Plan DoStudy ActPlan DoStudy Act

29. Implementation Team District Management Team Teachers Innovations Students Sustainability Practice Informs Policy Policy Enables Practice Practice-Policy Communication Cycle

30. IMPLEMENTATION DRIVERS Common features of successful supports to help make full and effective use of a wide variety of innovations

31. Fidelity Assessment Coaching Training Technical Systems Intervention Facilitative Administration Decision Support Data System Competency Drivers Organization Drivers Implementation Drivers © Fixsen & Blase, 2008 Leadership Selection Adaptive

32. Competency Drivers Develop, improve and sustain competent and confident use of the innovation through  Careful selection of new and lead staff  Design and employ effective training plans  Design and support coaching system  Routine use of fidelity assessment to inform the process Implementation Drivers Competency Drivers

33. WHY: Educationally Significant Outcomes WHAT: Effective & Usable Practices and Programs WHO & HOW: Effective Implementation Methods WHERE: Enabling Contexts Formula for Success

34. Organization Drivers  Change Organizations and Systems  Create and sustain hospitable organizational and system environments for effective services  Develop functional data systems that can be used to inform decision-making Implementation Drivers Organization Drivers

35. Decision Support Data Systems Purposes  Monitor and improve student outcomes through data-based decisions  Provide information to assess effectiveness of intervention and prevention practices  Analyze the relationship of fidelity to outcomes  Guide further program development  Detect discrete issues as well as systemic issues  Engage in continuous quality improvement  Of the Intervention and the Drivers  Celebrate success  Be accountable to parents, Board of Education taxpayers, and other funders Implementation Drivers Organization Drivers

36. Facilitative Administration Purposes  Driving change within your direct sphere of influence  Creates an internally hospitable environment for the new way of work – at the level of the “agency” (e.g. school, District)  Facilitates the installation, implementation, and improvement of the Drivers for each innovation  Looks for ways to make the direct work of practitioners (e.g. teachers, school staff) and administrators more effective and less “burdensome”!! Implementation Drivers Organization Drivers

37. Facilitative Administration Strategies  Schedule changes  Policy revision  Practice revision  Communication protocols  Change responsibilities  Revise priorities Implementation Drivers Organization Drivers

38. Systems Intervention Purposes  Driving change outside your direct sphere of influence  Identify and “lift up” systemic barriers and facilitators to the next level to improve support for the new way of work  Create an externally “hospitable” environment for the new way of work  Embed facilitators and strengths  Contribute to cumulative learning in multi-site projects Implementation Drivers Organization Drivers

39. Systems Intervention Strategies  Communication protocols  Stakeholder groups  Community involvement  Public communication Implementation Drivers Organization Drivers

40. Performance Assessment (Fidelity) Coaching Training Technical Systems Intervention Facilitative Administration Decision Support Data System Competency Drivers Organization Drivers Facilitative Administration Enabling Context © Fixsen & Blase, 2008 Leadership Selection Adaptive Integrated & Compensatory

41. Implementation Drivers Tools You Can Use Strategic Analysis of DriversDrivers Action Plan Implementation Drivers: Implementation Drivers: Team Review & PlanningBest Practices

42. Implementation Drivers: Team Review & Planning

43.  Create a hospitable system with linked communication and problem-solving protocols to support the effective WHAT  Ensure that practice informs policy, and policy enables better practice  Operationalize success  Prevent the institutionalization of errors Enabling Context Implications for Sustainability and Scalability

44. Try It Now! Implementation Drivers Competency Drivers  Consider how the district is attending to these indicators  Consider how your vendors attend to these indicators Organization Drivers  Identify strategies you will use to support building staff in implementation of your program Supporting New Ways of Work

45. WHY: Educationally Significant Outcomes WHAT: Effective & Usable Practices and Programs WHO & HOW: Effective Implementation Methods WHERE: Enabling Contexts Formula for Success

46. AI Hub

47. Get Connected! www.scalingup.org SISEP @SISEPcenter For more on Implementation Science http://nirn.fpg.unc.edu www.implementationconference.org

48. ©Copyright Dean Fixsen and Karen Blase This content is licensed under Creative Commons license CC BY-NC- ND, Attribution-NonCommercial-NoDerivs. You are free to share, copy, distribute and transmit the work under the following conditions: Attribution — You must attribute the work in the manner specified by the author or licensor (but not in any way that suggests that they endorse you or your use of the work); Noncommercial — You may not use this work for commercial purposes; No Derivative Works — You may not alter or transform this work. Any of the above conditions can be waived if you get permission from the copyright holder. http://creativecommons.org/licenses/by-nc-nd/3.0