1. Overview of the State Systemic Improvement Plan (SSIP) Anne Lucas, WRRC/ECTA Ron Dughman, MPRRC Janey Henkel, MPRRC 2013 WRRC Leadership Forum October 2013 Eugene, Oregon

2. Disclaimer WRRC SSIP presentations and supplemental materials were developed prior OSEP’s publication of the final SPP/APR package

3. SSIP Purpose Multi-year, achievable plan that: Increases capacity of EIS programs/LEAs to implement, scale up, and sustain evidence-based practices Improves outcomes for children with disabilities (and their families) 3

4. Getting Started Leverage knowledge/skills of partners – Strengthen existing partnerships – Build new partnerships Form a Leadership Team Involve stakeholders throughout SSIP development, implementation, evaluation 4

5. Year 1 - FFY 2013 Delivered by Feb 2015 Year 2 - FFY 2014 Delivered by Feb 2016 Years 3-6 FFY 2015-18 Feb 2017- Feb 2020 Phase I Analysis Phase II Plan Phase III Evaluation Data Analysis; Identification of the Focus for Improvement; Description of Infrastructure to Support Improvement and Build Capacity; Theory of Action Multi-year plan addressing: Infrastructure Development; Support EIS Program/LEA in Implementing Evidence-Based Practices; Evaluation Plan Reporting on Progress including: Results of Ongoing Evaluation Extent of Progress Revisions to the SPP Proposed SSIP Activities by Phase 5

6. SSIP: The Basics SSIP process includes: Analyzing and Focusing Investigating Planning and Doing Evaluating 6

7. Conduct root cause analysis (including infrastructure) to identify contributing factors For each contributing factor, identify both barriers and leverage points for improvement Conduct root cause analysis (including infrastructure) to identify contributing factors For each contributing factor, identify both barriers and leverage points for improvement Search/evaluate evidence- based solutions (Exploration Phase) Develop action steps (address barriers/use leverage points) Develop Theory of Action and Logic Model Develop Plan for Improvement (Implementation Framework) Search/evaluate evidence- based solutions (Exploration Phase) Develop action steps (address barriers/use leverage points) Develop Theory of Action and Logic Model Develop Plan for Improvement (Implementation Framework) Initiate Data Analysis Conduct broad Infrastructure Analysis Identify problem area (Focus for Improvement) Initiate Data Analysis Conduct broad Infrastructure Analysis Identify problem area (Focus for Improvement) Evaluation of progress annually Adjust plan as needed Evaluation of progress annually Adjust plan as needed How well is the solution working? What is the problem? Why is it happening? What shall we do about it? SSIP 7 SSIP Phase I SSIP Phase I and II SSIP Phase III SSIP Phase I

8. Conduct root cause analysis (including infrastructure) to identify contributing factors For each contributing factor, identify both barriers and leverage points for improvement Conduct root cause analysis (including infrastructure) to identify contributing factors For each contributing factor, identify both barriers and leverage points for improvement Search/evaluate evidence- based solutions (Exploration Phase) Develop action steps (address barriers/use leverage points) Develop Theory of Action and Logic Model Develop Plan for Improvement (Implementation Framework) Search/evaluate evidence- based solutions (Exploration Phase) Develop action steps (address barriers/use leverage points) Develop Theory of Action and Logic Model Develop Plan for Improvement (Implementation Framework) Initiate Data Analysis Conduct broad Infrastructure Analysis Identify problem area (Focus for Improvement) Initiate Data Analysis Conduct broad Infrastructure Analysis Identify problem area (Focus for Improvement) Evaluation of progress annually Adjust plan as needed Evaluation of progress annually Adjust plan as needed How well is the solution working? What is the problem? Why is it happening? What shall we do about it? SSIP 8 SSIP Phase I SSIP Phase I and II SSIP Phase III SSIP Phase I

9. Phase I -Data Analysis Analyze key data (SPP/APR, 618) including: – Review of disaggregated data – Identification of data quality issues – Identification of how data quality issues will be addressed – Identification of compliance issues that are barriers 9

10. Phase I - Infrastructure Analysis Determine current system capacity to: – Support improvement – Build capacity in LEAs/EIS programs and providers to implement, scale up, and sustain evidence- based practices to improve results 10

11. Phase I - Infrastructure Analysis Address State system components including: – Governance – Fiscal – Quality standards – Professional development – Data – Technical assistance, and – Accountability 11

12. Phase I - Infrastructure Analysis Identify: – System strengths – How components are coordinated – Areas for improvement within and across components – Alignment and impact of current state initiatives – How decisions are made – Representatives needed to plan system improvement 12

13. Phase I - Identify Problem Area Select area of focus for improvement “What identified area, which when implemented or resolved, has the potential to generate the highest leverage for improving outcomes/results for children with disabilities?” 13

14. Conduct root cause analysis (including infrastructure) to identify contributing factors For each contributing factor, identify both barriers and leverage points for improvement Conduct root cause analysis (including infrastructure) to identify contributing factors For each contributing factor, identify both barriers and leverage points for improvement Search/evaluate evidence- based solutions (Exploration Phase) Develop action steps (address barriers/use leverage points) Develop Theory of Action and Logic Model Develop Plan for Improvement (Implementation Framework) Search/evaluate evidence- based solutions (Exploration Phase) Develop action steps (address barriers/use leverage points) Develop Theory of Action and Logic Model Develop Plan for Improvement (Implementation Framework) Initiate Data Analysis Conduct broad Infrastructure Analysis Identify problem area (Focus for Improvement) Initiate Data Analysis Conduct broad Infrastructure Analysis Identify problem area (Focus for Improvement) Evaluation of progress annually Adjust plan as needed Evaluation of progress annually Adjust plan as needed How well is the solution working? What is the problem? Why is it happening? What shall we do about it? SSIP 14 SSIP Phase I SSIP Phase I and II SSIP Phase III SSIP Phase I

15. Phase I - Root Cause Analysis Identify contributing factors in focus area (including infrastructure) Contributing factors: – Explain why you have the problem – Point to how the problem can be addressed 15

16. Phase I - Root Cause Analysis Identify barriers for each contributing factor – What is standing in the way of addressing this contributing factor? – Why hasn’t it been addressed to date? 16

17. Phase I - Root Cause Analysis Identify leverage points for each contributing factor – What are the assets or strengths that can be tapped to address the contributing factors? 17

18. Conduct root cause analysis (including infrastructure) to identify contributing factors For each contributing factor, identify both barriers and leverage points for improvement Conduct root cause analysis (including infrastructure) to identify contributing factors For each contributing factor, identify both barriers and leverage points for improvement Search/evaluate evidence- based solutions (Exploration Phase) Develop action steps (address barriers/use leverage points) Develop Theory of Action and Logic Model Develop Plan for Improvement (Implementation Framework) Search/evaluate evidence- based solutions (Exploration Phase) Develop action steps (address barriers/use leverage points) Develop Theory of Action and Logic Model Develop Plan for Improvement (Implementation Framework) Initiate Data Analysis Conduct broad Infrastructure Analysis Identify problem area (Focus for Improvement) Initiate Data Analysis Conduct broad Infrastructure Analysis Identify problem area (Focus for Improvement) Evaluation of progress annually Adjust plan as needed Evaluation of progress annually Adjust plan as needed How well is the solution working? What is the problem? Why is it happening? What shall we do about it? SSIP 18 SSIP Phase I SSIP Phase I and II SSIP Phase III SSIP Phase I

19. Some Ideas to Consider Implementation science can support the selection, development and scale-up of improvement strategies included in the SSIP – Implementation science can bridge the “science to service” and “implementation gaps” Implementation Science Frameworks

20. Some Ideas to Consider “Implementation science is the systematic study of variables and conditions that lead to full and effective use of evidence-based programs and other effective innovations in typical human service settings.” —Blase and Fixsen, 2010 National Implementation Research Network From Building Implementation Capacity. A presentation of The State Implementation and Scaling-up of Evidence-based Practices Center. Chapel Hill North Carolina, October 2012. For more information: http://sisep.fpg.unc.edu/ http://nirn.fpg.unc.edu

21. Phase I – Evidence-base Search for solutions that are evidence-based to address contributing factors Identify general action steps that address contributing factors: – Remove barriers – Use leverage points – Incorporate evidence-based resources 21

22. Phase I - Theory of Action Identify results/outcomes to be accomplished including changes in: – System – Practices Identify general improvement strategies Develop logic model reflecting relationship between activities and outcomes 22

23. Theory of Action What are the issues: State System Level Local System Level Direct Supports Practices/Services Children and Families What are the issues: State System Level Local System Level Direct Supports Practices/Services Children and Families What are our activities: State System Level Local System Level Direct Supports Practices/Services Children and Families What are our activities: State System Level Local System Level Direct Supports Practices/Services Children and Families What are our desired outcomes: State System Level Local System Level Direct Supports Practices/Services Children and Families What are our desired outcomes: State System Level Local System Level Direct Supports Practices/Services Children and Families Back ifthen Theory of Action 23

24. Phase II - Improvement Plan Develop plan focusing on: – Infrastructure development – Support for implementing evidence-based practices – Evaluation of implementation 24

25. Some Ideas to Consider Implementation science can help to successfully implement and sustain evidence-based and evidence-informed interventions: WHAT to do What is the intervention (e.g. effective instruction, effective assessment)? HOW to do it Active and effective implementation and sustainability frameworks (e.g. strategies to change and maintain behavior of adults) WHO will do it Organized, purposeful, & active implementation support from linked implementation teams From Building Implementation Capacity. A presentation of The State Implementation and Scaling-up of Evidence-based Practices Center. Chapel Hill North Carolina, October 2012.

26. The Hexagon An EBP Exploration Tool NEED FIT RESOURCES EVIDENCE CAPACITY READINESS Fit with current Initiatives Local program, state priorities Organizational structures Community values Need in local programs, state Academic & socially significant Issues Parent & community perceptions of need Data indicating need Resources and supports for: Curricula & Classroom Technology supports (IT dept.) Staffing Training Data Systems Coaching & Supervision Administration & system Evidence Outcomes – Is it worth it? Fidelity data Cost – effectiveness data Number of studies Population similarities Diverse cultural groups Efficacy or Effectiveness Capacity to Implement Staff meet minimum qualifications Able to sustain Imp Drivers Financially Structurally Buy-in process operationalized Practitioners Families Readiness for Replication Qualified purveyor Expert or TA available Mature sites to observe Several replications How well is it operationalized? Are Imp Drivers operationalized? The “Hexagon” can be used as a planning tool to evaluate evidence- based programs and practices during the Exploration Stage of Implementation. Download available at: www.scalingup.org/tools-and-resources EBP: 5 Point Rating Scale: High = 5; Medium = 3; Low = 1. Midpoints can be used and scored as a 2 or 4. HighMedLow Need Fit Resource Availability Evidence Readiness for Replication Capacity to Implement Total Score © National Implementation Research Network 2009-2012 Adapted from work by Laurel J. Kiser, Michelle Zabel, Albert A. Zachik, and Joan Smith at the University of Maryland

27. Phase II - Improvement Plan Infrastructure development includes: – Improvement activities that build capacity of EIS programs/LEAs Who will implement Resources How expected outcomes will be measured Timelines – How state will align improvement work with other state initiatives – Leveraging resources from state initiatives 27

28. Phase II - Improvement Plan Support for implementing evidence-based practices includes: – Activities supporting implementation of evidence- based practices Who will implement Resources How expected outcomes will be measured Timelines for completing the activities – How to support scaling up and sustaining evidence- based practices once implemented with fidelity 28

29. Phase II - Improvement Plan Plan to evaluate implementation includes: – Methods to collect and analyze data on activities and outcomes – How State will use evaluation results to: Examine effectiveness of implementation plan Measure progress toward achieving intended outcomes Make modifications to plan 29

30. Conduct root cause analysis (including infrastructure) to identify contributing factors For each contributing factor, identify both barriers and leverage points for improvement Conduct root cause analysis (including infrastructure) to identify contributing factors For each contributing factor, identify both barriers and leverage points for improvement Search/evaluate evidence- based solutions (Exploration Phase) Develop action steps (address barriers/use leverage points) Develop Theory of Action and Logic Model Develop Plan for Improvement (Implementation Framework) Search/evaluate evidence- based solutions (Exploration Phase) Develop action steps (address barriers/use leverage points) Develop Theory of Action and Logic Model Develop Plan for Improvement (Implementation Framework) Initiate Data Analysis Conduct broad Infrastructure Analysis Identify problem area (Focus for Improvement) Initiate Data Analysis Conduct broad Infrastructure Analysis Identify problem area (Focus for Improvement) Evaluation of progress annually Adjust plan as needed Evaluation of progress annually Adjust plan as needed How well is the solution working? What is the problem? Why is it happening? What shall we do about it? SSIP 30 SSIP Phase I SSIP Phase I and II SSIP Phase III SSIP Phase I

31. Phase III – Evaluation Evaluate implementation strategies including: – Extent of implementation – Extent of progress toward goals Use evaluation results to revise plan 31

32. Questions? 32

33. Contact Information Anne Lucas, WRRC/ECTA Anne.Lucas@unc.edu Ron Dughman, MPRRC Ron.Dughman@usu.edu Janey Henkel, MPRRC Janey.Henkel@usu.edu 33