SILC-NET, a project of ILRU – Independent Living Research Utilization 0 SILC-NET Presents… A National Teleconference & Webinar Developing an Outcomes-Focused SPIL September 18, :00 PM – 4:30 PM EDT Presenter: Mike Hendricks, Ph.D. 0

SILC-NET, a project of ILRU – Independent Living Research Utilization 1 SILC-NET Presents… A National Teleconference & Webinar Developing an Outcomes-Focused SPIL September 18, :00 PM – 4:30 PM EDT Presenter: Mike Hendricks, Ph.D. 1

SILC-NET, a project of ILRU – Independent Living Research Utilization Who am I? Consultant in outcomes, evaluation, etc. Have been working closely with NCIL, ILRU for the past 4-5 years Developed training, TA materials (ILRU website) Given several webinars and in-person trainings SILC Congress 2010, 2011; Portland 2011 All materials vetted and approved by RSA 2

SILC-NET, a project of ILRU – Independent Living Research Utilization What does “vetted and approved by RSA” mean? We want to be very clear about this RSA has seen all the materials we’ve ever presented RSA agrees these are good suggestions However, RSA does NOT require you to do what we’re suggesting So, these are ideas for you to consider 3

SILC-NET, a project of ILRU – Independent Living Research Utilization Caveats States are different – in lots of ways There’s no one way to develop a SPIL Do what works for YOUR state However, we’ve given this some thought So please, consider our ideas seriously 4

SILC-NET, a project of ILRU – Independent Living Research Utilization SILC-NET’s Online Resources on This Topic 5

SILC-NET, a project of ILRU – Independent Living Research Utilization Three Key Terms We Need to Use in the Same Way 1. A state’s “IL program” 2. An “outcome” 3. A “logic model” 6

SILC-NET, a project of ILRU – Independent Living Research Utilization A State’s IL program 7

SILC-NET, a project of ILRU – Independent Living Research Utilization ACTIVITIES  What the program does with the inputs to fulfill its mission feeding and sheltering homeless families providing job training educating teachers about signs of child abuse counseling pregnant women OUTPUTS  The volume of work accomplished by the program number of classes taught number of counseling sessions conducted number of educational materials distributed number of hours of service delivered number of participants served OUTCOMES  Benefits or changes for participants (or an organization) during or after program activities new knowledge increased skills changed attitudes or values modified behavior improved condition altered status INPUTS  Resources dedicated to or consumed by the program money staff & staff time volunteers & volunteer time facilities equipment & supplies Essential Components of a Program 8

SILC-NET, a project of ILRU – Independent Living Research Utilization Outputs vs. Outcomes -- There’s a big difference Comprehensive child care GED preparation # child-days of care given Children are school-ready for kindergarten # tutoring sessions heldParticipants obtain their GED certificates Independent Living Services # consumers servedConsumers have skills to support choices 9

SILC-NET, a project of ILRU – Independent Living Research Utilization Why Focus a SPIL on Outcomes? Why not focus on inputs, activities, or outputs? Not good enough anymore What are you trying to achieve? – Desired outcomes Start from where you want to end up, then figure out the steps to get there Like a trip -- your destination determines how you’ll get there 10

SILC-NET, a project of ILRU – Independent Living Research Utilization Partial Logic Model with Activities 11

SILC-NET, a project of ILRU – Independent Living Research Utilization Our 3-Step Approach Step 1: Decide what you want to achieve –Mission, goals, objectives, partial logic model Step 2: Turn generalities into specifics –Measurable indicators, geographic scope, target performance level for 2016, target progress between 2013 and 2016 Step 3: Develop an action strategy to achieve each Objective –Necessary activities, lead organization, key partners, resources needed, funding sources 12

SILC-NET, a project of ILRU – Independent Living Research Utilization Step 1: Decide what you want to achieve A.State your Mission (top row) - But whose mission? Your total IL program’s - “PWDs in our state live independently and participate fully in their community” - Your Mission will be different, but… - Wording is important: –Start with your target group –Follow with a present-tense verb phrase –End however makes sense 13

SILC-NET, a project of ILRU – Independent Living Research Utilization Step 1: Decide what you want to achieve, cont’d. B. Develop your Goals (next row down) - Desired outcomes one level below your Mission - What outcomes do you need to achieve first, in order to achieve your Mission? - Outcome “stepping stones” on the way to your Mission - Put each Goal in a box, right below the Mission 14

SILC-NET, a project of ILRU – Independent Living Research Utilization Partial Logic Model with Goals IF we achieve these three Goals, THEN we can achieve our Mission Your Goals will almost certainly be different You may not even agree with these Goals But this format will be very useful 15

SILC-NET, a project of ILRU – Independent Living Research Utilization Step 1: Decide what you want to achieve, cont’d. 2 C. Define your Objectives (next row down) - Typically can’t achieve Goals in 3 years - Make progress, yes; fully achieve, probably not - Need another level of outcomes below Goals…. Objectives - What outcomes do you need to achieve first, in order to achieve your Goals? - This is the key level of outcomes – Focus your efforts on your Objectives 16

SILC-NET, a project of ILRU – Independent Living Research Utilization Partial Logic Model with Objectives IF we achieve these four Objectives, THEN we can achieve this Goal Your Objectives will almost certainly be different – don’t have too many (37 in one SPIL) 17

SILC-NET, a project of ILRU – Independent Living Research Utilization Objectives From Some Actual SPILs 1.Formerly underserved populations are served 2.Persons with disabilities (PWDs) have increased employment opportunities 3.Policy makers financially support the IL network 4.PWDs register to vote 5.IL network key partners collaborate to provide delivery of services 6.PWDs can access transportation 18

SILC-NET, a project of ILRU – Independent Living Research Utilization What Are Your Questions and Comments about Step 1? 19

SILC-NET, a project of ILRU – Independent Living Research Utilization Step 2: Turn Generalities into Specifics Objectives are the core of your SPIL, but they’re too general “IL providers are well-trained” – What does this mean – exactly? Very helpful to think through a SPIL Planning Table 20

SILC-NET, a project of ILRU – Independent Living Research Utilization SPIL Planning Table – (first section) Specific Objective Measurable Indicator(s) Geographic Scope Target Performance Level for 2016 Target Progress Between 2013 and 2016 IL providers are well-trained Objective… Objective... 21

SILC-NET, a project of ILRU – Independent Living Research Utilization Step 2: Turn Generalities into Specifics, c ont’d. A.Develop measurable indicators for each objective –This is an unbelievably important step –What exactly should change in 3 years? –How exactly will we know if we’re being successful on this Objective? –An indicator defines what we mean by an Objective – (Memorize this!) –“# and % of front-line staff who have an up-to- date Prime Provider Certificate (PPC)” 22

SILC-NET, a project of ILRU – Independent Living Research Utilization Indicators From Some Actual SPILs PWDs have increased employment - % PWDs desiring to work who have at least half- time paid employment Formerly underserved populations are served - % PWDs who are deaf-blind who access services - % Native American tribal communities having a relationship with the IL network IL network key partners collaborate - # agencies providing services to veterans that collaborate with the IL network 23

SILC-NET, a project of ILRU – Independent Living Research Utilization Step 2: Turn Generalities into Specifics, cont’d. 2 B. Specify the geographic scope for each Objective –Statewide? Only rural areas? C. Set 2016 performance targets for each Objective –What an indicator should “read” in 2016, at the end of the 3-year SPIL period –Art & science: your performance right now, your best predictions of progress, other States, national standards, experts, etc. 24

SILC-NET, a project of ILRU – Independent Living Research Utilization Step 2: Turn Generalities into Specifics, cont’d. 3 D. Set targets for interim progress between 2013 and 2016 –Please don’t wait 3 years to see how you’re doing –Measure an indicator as often as makes sense (annually, 6 months, 3 months) –Shoot for a trend that makes sense (steady, gathers steam, levels off) 25

SILC-NET, a project of ILRU – Independent Living Research Utilization 26 SPIL Planning Table – (first section), cont’d. Specific Objective Measurable Indicator(s) Geographic Scope Target Performance Level for 2016 Target Progress Between 2013 and 2016 IL providers are well-trained # and % of front-line staff who have an up-to-date PPC Rural counties 2016 = 80% 2013 = 65% 2014 = 70% 2015 = 75% Objective… Indicator #1… Indicator #2… Objective… Objective…

SILC-NET, a project of ILRU – Independent Living Research Utilization What Are Your Questions and Comments about Step 2? 27

SILC-NET, a project of ILRU – Independent Living Research Utilization Step 3: Develop an action strategy to achieve each Objective Now you know exactly what you want to achieve – very specifically But how are you going to achieve each Objective? Add this information into your SPIL Planning Table 28

SILC-NET, a project of ILRU – Independent Living Research Utilization 29 SPIL Planning Table – (second section) Specific Objective Necessary Activities Lead Organization Key Partner(s) Resources Needed Funding Sources IL providers are well-trained Objective… Objective…

SILC-NET, a project of ILRU – Independent Living Research Utilization Step 3: Develop an action strategy to achieve each Objective, contd. A. Determine the Activities you need to conduct in order to achieve each Objective - What you will do -- “-ing” words such as training, surveying, disseminating, etc. - One or more activities for each Objective - But each Objective will have different activities - Activities depend almost entirely on the decisions you’ve made in Steps 1 and 2 - Put activities right below Objectives on your logic model (IF-THEN) 30

SILC-NET, a project of ILRU – Independent Living Research Utilization Partial Logic Model with Activities, revisited 31

SILC-NET, a project of ILRU – Independent Living Research Utilization B. Agree on one lead organization for achieving each Objective Important for the buck to stop some ONE place SILC, DSU(s), or CILs might usually be the lead But maybe not always? 32

SILC-NET, a project of ILRU – Independent Living Research Utilization Step 3: Develop your action strategy to achieve each Objective, cont’d. 2 C.Agree on key partners for each Objective –Other organizations may need to be involved, too –Important to plan from the beginning D.Document the resources needed to achieve each Objective –Generally in $$ terms –As closely as possible, but may not be perfect 33

SILC-NET, a project of ILRU – Independent Living Research Utilization Step 3: Develop an action strategy to achieve each Objective, cont’d. 3 E. Clarify funding sources –Part B? Part C? Chapter 2 – Older Blind? Other sources of funds? 34

SILC-NET, a project of ILRU – Independent Living Research Utilization 35 SPIL Planning Table – (second section), cont’d. Specific Objective Necessary Activities Lead Organization Key Partner(s) Resources Needed Funding Sources IL providers are well- trained Identifying all front-line staff in rural counties Assessing who has a PPC Motivating staff without a PPC to get one Offering PPC courses Etc. CILs (?) Provider agencies Local community colleges $?????? Objective… Objective…

SILC-NET, a project of ILRU – Independent Living Research Utilization Full SPIL Planning Table Specific Objective Specifics of Each ObjectiveAction Strategy for Achieving Each Objective Measurable Indicator(s) Geographic Scope Target Performance Level for 2016 Target Progress Between 2013 and 2016 Necessary Activities Lead Organization Key Partner(s) Resources Needed Funding Sources IL providers are well- trained # and % of front- line staff who have an up-to- date PPC Rural counties 2016=80%2013=65% 2014=70% 2015=75% Identifying staff Assessing who has a PPC Motivating staff Offering courses CILs (?) Provider agencies Local community colleges $?????? Objective… Objective… … Objective… 36

SILC-NET, a project of ILRU – Independent Living Research Utilization Three Important Points About Your Logic Model and SPIL Planning Table 1.Many people think these tools are very helpful for planning 2.However, at this time, RSA’s online MIS system is not able to accept charts or tables. Hopefully this will change, but for now, you cannot upload your logic model or SPIL planning table to RSA 3.Our advice: These tools are too helpful not to use! Develop them for your own purposes (and for your own audiences), then put the key information into text for RSA’s MIS system. 37

SILC-NET, a project of ILRU – Independent Living Research Utilization What Are Your Questions and Comments About Step 3? What Are Your Questions and Comments About Anything At All? 38

SILC-NET, a project of ILRU – Independent Living Research Utilization Contact Mike Hendricks – 39

SILC-NET, a project of ILRU – Independent Living Research Utilization Wrap Up and Evaluation Click the link below now to complete an evaluation of today’s program found at: 40

SILC-NET, a project of ILRU – Independent Living Research Utilization SILC-NET Attribution Support for development of this Webinar/teleconference was provided by the U.S. Department of Education, Rehabilitation Services Administration under grant number H132B No official endorsement of the Department of Education should be inferred. Permission is granted for duplication of any portion of this PowerPoint presentation, providing that the following credit is given to the project: Developed as part of the SILC-NET, a project of the IL-NET, an ILRU/NCIL/APRIL National Training and Technical Assistance Program. 41