Outcome Measures for CILs Analyzing Outcome Information

Slides:



Advertisements
Similar presentations
We know what we need to do for students what barriers prevent us from doing it? Transition 2011.
Advertisements

CONSOLIDATED PROGRAM REVIEW COMPLIANCE REQUIREMENTS FOR TITLE I, PART C, MIGRANT EDUCATION PROGRAM MEP STATE CONFERENCE AUGUST 2013.
1 CIL-NET, a project of ILRU – Independent Living Research Utilization CIL-NET Presents… 1 Outcome Measures for CILs A National Onsite Training Storing.
SILC-NET, a project of ILRU – Independent Living Research Utilization Developing an Outcomes-Focused SPIL: Three Easy Steps Module 2 A series of online.
CIL-NET, a project of ILRU – Independent Living Research Utilization 0 CIL-NET Presents… A National Teleconference & Webinar Exploring ADRC Partnership.
1 Developing & Evaluating an Outcomes- Focused SPIL PART 1: Goals & Objectives April 21, 2010; 3:00-4:30 PM EST PART 2: Evaluation April 28, 2010; 3:00-4:30.
CIL-NET, a project of ILRU – Independent Living Research Utilization Get to the Core of It: Information & Referral December 11, 2013 Presenters: Darrel.
Expanding CIL Capacity through Youth Transition Services: Collaborating with School Districts and Vocational Rehabilitation Analyzing Costs and Setting.
11 Building an Effective Peer Support Program: A Proven Volunteer Model General Overview of Peer Support and ABIL Program September 23, :00 a.m.
Part C Centers for Independent Living Assurances Standards Indicators (704)
11 Building an Effective Peer Support Program: A Proven Volunteer Model Disability Liberation Theory September 24, :45 p.m. – 3:15 p.m. Presenter:
Georgia Special Needs Scholarship Understanding the Program 2014 – 2015 School Year.
Examining Local Post-School Outcomes A guided dialog for using post- school outcomes for youth with disabilities to improve transition services and outcomes.
CIL-NET, a project of ILRU – Independent Living Research Utilization CIL-NET Presents… A National Teleconference & Webinar Get to the Core of It: Information.
CIL-NET, a project of ILRU – Independent Living Research Utilization CIL-NET Presents… A National Teleconference & Webinar Get to the Core of It: Peer.
SILC-NET, a project of ILRU – Independent Living Research Utilization 00 Gathering Consumer Feedback for SILCs September 27, 2011 SILC-NET Presents…
1 CIL-NET, a project of ILRU – Independent Living Research Utilization CIL-NET Presents… 1 Outcome Measures for CILs A National Onsite Training Measurable.
1 CIL-NET, a project of ILRU – Independent Living Research Utilization CIL-NET Presents… 1 Outcome Measures for CILs A National Onsite Training Using Outcome.
1 CIL-NET, a project of ILRU – Independent Living Research Utilization CIL-NET Presents… 1 Outcome Measures for CILs A National Onsite Training Logic Models.
1 Beyond the Filing Cabinet: Appreciating the Value of Consumer Service Records A National Teleconference & Webcast Thursday, September 3, :00 PM.
Slide 1 Using Consumer Satisfaction Information for Planning Part 1: Gathering Information September 9, :00 – 4:30 PM EDT Presenters: Tonya Fambro.
SILC-NET Presents… Evaluating Your Outcomes-Focused SPIL: Overview, Evaluating Implementation January 10, 2011 Facilitated by: Mike Hendricks, Ph.D.
1 CIL-NET, a project of ILRU – Independent Living Research Utilization CIL-NET Presents… 1 Outcome Measures for CILs A National Onsite Training Sources.
SILC-NET, a project of ILRU – Independent Living Research Utilization Developing an Outcomes-Focused SPIL: Three Easy Steps Module 3 A series of online.
SILC-NET, a project of ILRU – Independent Living Research Utilization SILC Needs Assessment Survey: A Discussion on Current Approaches and Practices in.
SILC-NET Presents… Evaluating Your Outcomes-Focused SPIL: Evaluating Progress on SPIL Objectives January 10, 2011 Facilitated by: Mike Hendricks, Ph.D.
CIL-NET, a project of ILRU – Independent Living Research Utilization CIL-NET Presents… A National Teleconference & Webinar Get to the Core of It: IL Skills.
11 Building an Effective Peer Support Program: A Proven Volunteer Model Far-Reaching Benefits of a Successful Peer Mentor Program September 24, :15.
Expanding CIL Capacity through Youth Transition Services: Collaborating with School Districts and Vocational Rehabilitation The View from VR August 13,
SILC-NET, a project of ILRU – Independent Living Research Utilization Developing an Outcomes-Focused SPIL: Three Easy Steps Module 1 A series of online.
1 CIL-NET, a project of ILRU – Independent Living Research Utilization CIL-NET Presents… 1 Outcome Measures for CILs A National Onsite Training Pulling.
SILC-NET, a project of ILRU – Independent Living Research Utilization Developing an Outcomes-Focused SPIL: Three Easy Steps Module 4 A series of online.
New Community Opportunities Center at ILRU – Independent Living Research Utilization 0 Part 2: CILs Involvement in Managed Care August 30, 2012 Presenters:
SILC-NET, a project of ILRU – Independent Living Research Utilization Independent Living Research Utilization 1.
1 CIL-NET, a project of ILRU – Independent Living Research Utilization CIL-NET Presents… 1 Outcome Measures for CILs A National Onsite Training Challenges,
1 CIL-NET, a project of ILRU – Independent Living Research Utilization CIL-NET Presents… 1 Outcome Measures for CILs A National Onsite Training Voices.
1 CIL-NET, a project of ILRU – Independent Living Research Utilization CIL-NET Presents… 1 Outcome Measures for CILs A National Onsite Training Choosing.
SILC-NET, a project of ILRU – Independent Living Research Utilization Independent Living Research Utilization 1.
What is Title 1? It is a federal formula grant.
Annual Title I Parent Meeting & The Value and Utility of Parents
Brustein & Manasevit, PLLC
Georgia Special Needs Scholarship
Engaging Families and Creating Trusting Partnerships to Improve Child and Family Outcomes More on Infusing Partnership Principles and Practices into Family.
Independent Living Research Utilization
Independent Living Research Utilization
The value of work for persons with mental health conditions
A 30 Second Training for Persons in Mental Health Recovery
Independent Living Research Utilization
Annual Parent Meeting Klein Road Elementary
The development of this training was supported by: The National Institute of Disability, Independent Living and Rehabilitation Research (NIDILRR), Administration.
A 30 Second Training for Persons in Mental Health Recovery
Brustein & Manasevit, PLLC
4 Ways to help build readiness for work for persons with mental health conditions 30 second training for service providers.
Independent Living Research Utilization
Brustein & Manasevit, PLLC
Implementing and Enforcing Olmstead A National Onsite Training
New Community Opportunities Center at ILRU Presents…
Partnering with Providers To achieve
Oakland Terrace Elementary School
Annual Title I Meeting and Benefits of Parent and Family Engagement
New Community Opportunities Center at ILRU Presents…
Brustein & Manasevit, PLLC
Brustein & Manasevit, PLLC
A SILC Fiscal Guide to Spending Part II – Administrative Regulations
Brustein & Manasevit, PLLC
Building an Effective Peer Support Program: A Proven Volunteer Model Welcome & Participant Introductions September 23, :00 a.m. – 10:00 a.m. Presenters:
Brustein & Manasevit, PLLC
Independent Living Research Utilization
Independent Living Research Utilization
Presentation transcript:

Outcome Measures for CILs Analyzing Outcome Information CIL-NET Presents… Outcome Measures for CILs A National Onsite Training Analyzing Outcome Information September 13-15, 2011 Portland, OR Presenters: Mike Hendricks, Ph.D. Bob Michaels 1

The Yellow Brick Road – Step 8 Sources and Methods Gathering Outcome Information Measurable Indicators Choosing Outcomes to Measure Storing Outcome Information Using Outcome Information Analyzing Outcome Information Logic Models Outcomes & Outcomes Mgmt.

Three Simple Steps “Clean” the raw information “Run the numbers” Analyze open-ended questions

Step 1: “Clean” the Raw Information Look at the answers question-by-question -- Were answers to any questions “wacky”? -- Do any questions need to be thrown out? Look at the answers client-by-client -- How many gave inconsistent answers? -- Do any clients need to be thrown out? -- Or a specific question for a specific client?

Step 2: “Run the Numbers” A lot easier than you probably think For each indicator: -- First, describe your overall performance on each outcome -- Then, see what affects the outcomes (gender, ethnicity, disability, CIL size, etc.) Graphics are especially useful Let’s walk through an example….

At-Risk Teen Mentoring Program At-risk teens graduate from high school. At-risk teens achieve passing grades. At-risk teens meet district attendance requirements. At-risk teens earn better grades. At-risk teens attend school regularly. At-risk teens complete homework regularly. Mentors meet with at-risk teens for an hour each week. Mentors stress the importance of education, encourage school attendance, occasionally help with homework.

At-Risk Teen Mentoring Program, cont’d. At-risk teens graduate from high school. # and % of teens who receive a diploma on time At-risk teens achieve passing grades. # and % of teens who earn a C or better overall At-risk teens meet district attendance requirements # and % of teens who avoid attendance problems with the district At-risk teens earn better grades. # and % of teens who earn better grades in the semester after the intervention than before At-risk teens attend school regularly. # and % of teens who attend school at least 80% of the time At-risk teens complete homework regularly. # and % of teens who finish their homework at least three days out of the week Mentors meet with at-risk teens for an hour each week. Mentors stress the importance of education, encourage school attendance, occasionally help with homework.

Outcomes for all teens 55% 60% 80% Too early Too early Too early At-risk teens graduate from high school. Too early At-risk teens achieve passing grades. At-risk teens meet district attendance requirements. 55% Too early At-risk teens earn better grades. 60% At-risk teens attend school regularly. 80% At-risk teens complete homework regularly. Mentors meet with at-risk teens for an hour each week. Mentors stress the importance of education, encourage school attendance, occasionally help with homework.

Outcomes for girls vs. boys At-risk teens graduate from high school. At-risk teens achieve passing grades. At-risk teens meet district attendance requirements. G: 45% B: 70% At-risk teens earn better grades. At-risk teens attend school regularly. B: 80% G: 80% At-risk teens complete homework regularly. Mentors meet with at-risk teens for an hour each week. Mentors stress the importance of education, encourage school attendance, occasionally help with homework.

Outcomes for juvenile justice system teens vs. other teens At-risk teens graduate from high school. At-risk teens achieve passing grades. At-risk teens meet district attendance requirements. At-risk teens earn better grades. Other: 75% Other: 95% At-risk teens attend school regularly. At-risk teens complete homework regularly. JJS: 30% JJS: 35% Mentors meet with at-risk teens for one hour each week. Mentors stress the importance of education, encourage school attendance, occasionally help with homework.

Outcomes for women vs. men mentors At-risk teens graduate from high school. At-risk teens achieve passing grades. At-risk teens meet district attendance requirements. W: 35% M: 80% At-risk teens earn better grades. At-risk teens attend school regularly. M: 70% W: 90% At-risk teens complete homework regularly. Mentors meet with at-risk teens for an hour each week. Mentors stress the importance of education, encourage school attendance, occasionally help with homework.

Outcomes if parents attend teacher conferences vs. not At-risk teens graduate from high school. Yes 75% No 45% At-risk teens achieve passing grades. At-risk teens meet district attendance requirements. At-risk teens earn better grades. At-risk teens attend school regularly. At-risk teens complete homework regularly. Mentors meet with at-risk teens for one hour each week. Mentors stress the importance of education, encourage school attendance, occasionally help with homework.

Step 3: Analyze open-ended questions A way to summarize words (not numbers) Often called “content analysis” Can be done manually or by computer Adds a deeper understanding to the numbers you’ve already analyzed

NCIL Outcome Measures Project Analyzing Outcome Information

Consumers Averaged 46-50 Years Old

Most Consumers Were White

Consumers Had Various Disabilities

Outcome Findings for Indicator #1 # and % of consumers served by the CIL within the last nine (9) months of the past federal fiscal year who can list at least one (1) specific skill, type of knowledge, or resource they have now that they didn’t have before approaching the CIL

Outcome Findings for Indicator #2 # and % of consumers served by the CIL within the last nine (9) months of the past federal fiscal year who can list at least one (1) specific way in which they are more independent than when they approached the CIL

Outcome Findings for Indicator #3 # and % of PWD contacting the CIL during the last nine (9) months of the past federal fiscal year who report they have the information they requested from the CIL

Outcome Findings for Indicator #4 # and % of PWD contacting the CIL during the last nine (9) months of the past federal fiscal year who report they used a new resource they learned about from the CIL’s I&R efforts

Outcome Findings for Indicator #5 # and % of consumers served by the CIL within the last nine (9) months of the past federal fiscal year who can list at least one (1) specific personal advocacy activity they engaged in

Outcome Findings for Indicator #6 # and % of consumers served by the CIL within the last nine (9) months of the past federal fiscal year who can list at least one (1) specific systems advocacy activity they engaged in

Outcome Findings for Indicator #7 # of activities conducted (such as surveys, public meetings, focus groups, polls) during the past calendar year to identify or confirm the primary barriers/problems in the community that prevent PWD from leading more independent lives

Outcome Findings for Indicator #8 Presence within the CIL’s annual plan of a separate section containing an explicit systems advocacy workplan

Outcome Findings for Indicator #9 # positive changes achieved or negative changes prevented during the past calendar year in legislation, policies, practices, or services at the local, state, or federal level that address the barriers/problems identified by the Center’s consumers

Outcome Findings for Indicator #10 # and % of consumers served by the CIL within the past calendar year who moved out of an institution and into a self-directed, community-based setting Responses from 27 CILs # in Institution 1527 # who moved 460 % who moved 30% % who did not move out 70%

Outcome Findings for Indicator #11 # and % of consumers served by the CIL within the past calendar year who remained in a self-directed, community-based setting on December 31 despite having been at risk of moving into an institution Responses from 19 CILs Total # at risk 4409 Total # in Self-Directed 3743 % in Self-Directed 85% % in Institution 15%

We also gave each CIL its own, confidential report showing how that CIL’s outcomes compared to the outcomes of all the CILs combined.

Sample Confidential Outcomes Report to a CIL Outcome Indicator # and Brief Definition All 28 CILs CIL #XXX 1. % consumers who have gained new skills, knowledge, or resources 70% Yes 54% Yes 2. % consumers who have become more independent 51% Yes 3. # goals achieved by consumers Not Measured This Year 4. % I&R callers who got the information they wanted 72% Yes 96% Yes 5. % I&R callers who used a new resource they learned from us 52% Yes 88% Yes 6. % consumers who advocated on their own behalf 58% Yes 63% Yes 7. % consumers who advocated for changes in the community 28% Yes 33% Yes 8. # activities the CIL conducted to confirm or identify the primary barriers in the community See page 8 of full report 25 9. CIL has an explicit systems advocacy workplan 43% Yes No 10. # positive changes achieved or negative changes prevented by systems advocacy See page 10 of full report 14 11. % institutionalized consumers who moved out of their institution and into the community See page 11 of full report 43% 12. % at-risk consumers who remained in a community-based setting See page 12 of full report 86% Number of CIL Consumers used to calculate these statistics 24 Number of CIL I&R Callers used to calculate these statistics 26 Sample Confidential Outcomes Report to a CIL

A Good Reference Analyzing Outcome Information, by H.P. Hatry, J. Cowan & M. Hendricks, the Urban Institute, 2004. http://www.urban.org/UploadedPDF/310973_OutcomeInformation.pdf

For more information Contact: Mike Hendricks – MikeHendri@aol.com Bob Michaels – bobmichaels@cox.net

CIL-NET Attribution Support for development of this training was provided by the U.S. Department of Education, Rehabilitation Services Administration under grant number H132B070002-10. No official endorsement of the Department of Education should be inferred. Permission is granted for duplication of any portion of this PowerPoint presentation, providing that the following credit is given to the project: Developed as part of the CIL-NET, a project of the IL NET, an ILRU/NCIL/APRIL National Training and Technical Assistance Program.