EVALUATING CUSTOMER SATISFACTION: A Guided Tour of Wisconsin’s Comprehensive ADRC Customer Service Evaluation Amy Flowers, Analytic Insight.

Slides:



Advertisements
Similar presentations
User Satisfaction Why? User Satisfaction Surveys are conducted to ensure we receive feedback from our customers in order to gauge.
Advertisements

QPSC Overall KDA Based on Q38 – Intention to Leave.
How your NIH grant application is evaluated and scored Larry Gerace, Ph.D. June 1, 2011.
Parvaneh Rabiee, Kate Baxter, Gillian Parker and Sylvia Bernard RNIB Research Day 2014: Rehabilitation and social care RNIB, 105 Judd Street, London 20.
Summary of Results from Spring 2014 Presented: 11/5/14.
QPSC Overall KDA Job Engagement. Contents  Introduction  What is Key Driver Analysis?  Methodology  Factor Analysis Solution  Results.
Graduate Program Assessment Report. University of Central Florida Mission Communication M.A. Program is dedicated to serving its students, faculty, the.
ORC International Proprietary & Confidential Stress Awareness Month Survey Report April 7, 2015 EMBARGOED UNTIL 8:00 AM, April 13, 2015.
SE 450 Software Processes & Product Metrics Survey Use & Design.
By Sanjay Kumar, Ph.D National Programme Officer (M&E), UNFPA – India
Sheltered Housing – Fit for the future? Eileen Patterson, FOLD HA Fiona Boyle, Research consultant.
School Psychological Services in High Schools: Responding to Teachers’ Needs Presented by Kari Sears, Ed.S., NCSP, Patricia Warner, Ph.D., NCSP, Tammy.
Info-Tech Research Group1 Improving Business Satisfaction Moving from Measurement to Action.
UHCL Support Staff Association (SSA) and Professional and Administrative Staff Association (PASA) In consultation with Dr. Lisa M. Penney RAs: Lisa Sublett,
Federal Consulting Group August 2004 Department of Labor Civil Rights Center 2004 Satisfaction Study - Recipients.
In Focus-I & R Excellence Quality, Training, & Coaching-Best Practices for I & R Contact Centers Amy Latzer Chief Operations Officer Alliance of Information.
TEAM MORALE Team Assignment 12 SOFTWARE MEASUREMENT & ANALYSIS K15T2-Team 21.
Version 1 | Internal Use Only© Ipsos MORI 1 Version 1| Internal Use Only Sheffield CCG CCG 360 o stakeholder survey 2014 Summary report.
The Art of Options Counseling: Person-Centered, Decision Support Thea Griffin, LMSW 1.
1 Example Bank Customer Survey Results Net Promoter Score.
State of Maine: Quality Management and National Core Indicators.
Quality of working life – what, how and why
Customer Satisfaction Research Produced for: Raven Housing Trust – November 2012 Presented by Emma Hopkins Customer Satisfaction Research Produced for:
McLean & Company1 Improving Business Satisfaction Moving from Measurement to Action.
Recovery Oriented System Indicators (ROSI) Survey FY 2011 ROSI Survey Results Virginia Department of Behavioral Health and Developmental Services September,
QPSC Overall KDA Agency Engagement. Contents  Introduction  What is Key Driver Analysis?  Methodology  Factor Analysis Solution  Results.
Select and Develop Top Performing Sales Professionals Introducing SalesMax Revised 10/2005.
1 ACSI American Customer Satisfaction Index TM Citizen Satisfaction with the U.S. Federal Government: A Review of 2011 Results from ACSI Forrest V. Morgeson.
Staff Survey Executive Team Presentation (Annex B) Prepared by: GfK NOP September, Agenda item: 17 Paper no: CM/03/12/14B.
Viking Survey Results Report Team Assignment 11 Team 2-1.
Life satisfaction across cultures: a case of recent refugee arrivals in Australia Val Colic-Peisker Senior Research Fellow AHURI, School of Global Studies,
This Outcome Report is based on data from patients who completed a Functional Restoration Programme (FRP) at the RealHealth Treatment Centre in Coventry.
Engagement at The Health Trust Presented by Quantum Workplace 2014 Executive Report - The Health Trust.
Version 1 | Internal Use Only© Ipsos MORI 1 Version 1| Internal Use Only Islington CCG CCG 360 o stakeholder survey 2015 Main report.
Prepared For: definition, IFSA Conference 2005 By: Linda McAvenna Dissecting the investor psyche: what motivates our clients.
C ULTURE & C LIMATE S URVEY. Sample Employee Survey Report Findings ACME Widgets.
Version 1 | Internal Use Only© Ipsos MORI 1 Version 1| Internal Use Only North Derbyshire CCG CCG 360 o stakeholder survey 2015 Main report.
Version 1 | Internal Use Only© Ipsos MORI 1 Version 1| Internal Use Only Greenwich CCG CCG 360 o stakeholder survey 2015 Main report.
Respect as a Value-Proposition ™. The Campbell-Ewald Vision 2 To understand consumer values, lifestyles, belief systems and decision processes better.
A. P. Moller - Maersk Employee Engagement Survey 2011 MDSI Corporate IT-Admin; RVA018 - Roberto - Valenciano Report.
STAFF SURVEY Wednesday, December 12, Agenda  Purpose of staff survey  Findings  Discussion  Next Steps/Action Plan 2.
The Satisfied Student October 4 th, Today’s Presentation  Present data from Case’s Senior Survey and the National Survey of Student Engagement.
Self-Directed Support. Personalisation ‘It enables the individual alone or in groups to find the right solutions for them and to participate in the delivery.
© 2012 Forrester Research, Inc. Reproduction Prohibited 1 © 2009 Forrester Research, Inc. Reproduction Prohibited January 25, Call in at 12:55 p.m.
Competency based learning & performance Ola Badersten.
Documenting Family Outcomes: Decisions, Alternatives, Next Steps Don Bailey, Ph.D. Mary Beth Bruder, Ph.D. Contact information: Mary Beth Bruder, Ph.D.
© 2007 Arkenford Ltd Hastings and 1066 Country Visitor Study Rye Destination Profile.
Assessment Procedures for Counselors and Helping Professionals, 7e © 2010 Pearson Education, Inc. All rights reserved. Chapter 16 Communicating Assessment.
Research and Evaluation Center Assessment of the YouthBuild Mentoring Initiative Kathleen Tomberg, Research Analyst Research and Evaluation Center John.
Continuing Education Provincial Survey Winter 2012 Connie Phelps Manager, Institutional Research & Planning.
CAPE ROAD SURGERY Patient Questionnaire 2013 / 2014.
Oregon Department of Human Services Senior and People with Disabilities State Unit on Aging-ADRC In partnership with  Portland State University School.
D. Randall Brandt, Ph.D. Vice President Customer Experience & Loyalty The Customer Experience Trust Factor Do You Know How Well Your Employees Are Delivering.
ACF Office of Community Services (OCS) Community Services Block Grant (CSBG) Survey of Grantees Satisfaction with OCS Survey of Eligible Entities Satisfaction.
Creating a Consumer Direction Program for an Area Agency on Aging Creating a Consumer Direction Program for an Area Agency on Aging The National Association.
Person Centred Services from an RSL perspective (integrated services to support independence) Tim Edwards & Sue Hailstones.
Development Management Customer Satisfaction Survey 2015/16 Economy, Planning and Employability Services Reported Prepared May 2016.
Section 14.1 Product Presentation Chapter 14 presenting the product Section 14.2 Objections.
Impact of School Culture: Part-Time MBA Programs
Items in red require your input
Empower Managers to Take Ownership of Employee Engagement
Summary.
Items in red require your input
Employee Engagement Survey
Items in red require your input
Customer Satisfaction Research 2018 Q3 Results October 22, 2018
The Early Help Assessment Journey. How to Assure a Quality Journey.
McPherson College, Fall 2017
The Early Help Assessment Journey. How to Assure a Quality Journey.
Enter Your Work Unit Here Enter Date Here
Presentation transcript:

EVALUATING CUSTOMER SATISFACTION: A Guided Tour of Wisconsin’s Comprehensive ADRC Customer Service Evaluation Amy Flowers, Analytic Insight

Agenda 1. Methodology and domain development 2. Results and Implications of the Literature Review 3. Profile of ADRC customers 4. Customer perceptions of quality customer service and how they differ from ADRCs’ and others’ perceptions 5. Subgroups and their influence on satisfaction 6. Impact of Key Drivers on customer satisfaction 7. Questions

1. Methodology  Literature Review  Interviews  Focus Groups  Survey  Feedback  Ongoing Quality Improvement cycle

Domains Means Poor Fair Good Excellent n=1360

Items Comprising Informed Decision Making

Items Comprising Accessibility Statewide total n= 1619

Items Comprising Guidance

Items Comprising Range of Knowledge

Items Comprising Customization

Profile of ADRC Customers

Initial Contact

Customer Profile

Main Reasons for Contact

information that they were getting so that they made an educated choice about what to do next.” ADRC Director 3. Perceptions of Customer Service “A lot of times the services for people with disabilities just aren’t there, so its hard it can be hard for them to help. But if you just feel like they tried, like they said okay, here’s all the options that you can do, here’s the pros and cons of each one then you feel like at least someone is trying to help.” ADRC Customer “…[when] the consumer got the information they needed and understood what they need to consider in making their choices. That we provided not just information but the education to help them process the

Wordle of ADRC’s Customer Satisfaction Definitions

Variance in Definitions  Provided information, resources  Met needs  Listened, understood, feelings  Satisfactory outcome  Customization of Services  Guidance  Accessibility  Decision Making  Information Range ADRC Customer

Outcome Measures

n=1619

Satisfaction and service type 60 or older Physical Mental Alzheimer's Alcohol Developmental disability illness /Dementia or Drugs Disability

Satisfaction and Referral Outcomes

Satisfaction and outcomes

Follow up and Usefulness Usefulness N=344

Follow up after referrals N=344

Domains and Customer Satisfaction Q63 Overall, how would you rate your experience with the Resource Center? mean = * Beta scores in multiple regression analysis indicate the relative impact of each variable on the program’s overall effectiveness score. R2=.520 Significance of the model=.000 INFORMATION RANGE INFORMED DECISION MAKING CUSTOMIZATION OF SERVICES ACCESSIBILITY GUIDANCE Program Strength (Above average, Preponderance Excellent) Moderate Asset (Above average, Preponderance Good) Opportunity for Improvement (Average or below)

Domains and Effectiveness Q64 How would you rate the Center’s ability to help you resolve your situation? Mean = * Beta scores in multiple regression analysis indicate the relative impact of each variable on the program’s overall effectiveness score. R2=.449 Significance of the model=.000 INFORMATION RANGE INFORMED DECISION MAKING CUSTOMIZATION OF SERVICES ACCESSIBILITY GUIDANCE Program Strength (Above average, Preponderance Excellent) Moderate Asset (Above average, Preponderance Good) Opportunity for Improvement (Average or below)

Domains and Usefulness Q65 How useful was the help you received? Mean = * Beta scores in multiple regression analysis indicate the relative impact of each variable on the program’s overall effectiveness score. R2=.398 Significance of the model=.000 INFORMATION RANGE INFORMED DECISION MAKING ACCESSIBILITY GUIDANCE.099 Key: Program Strength (Top 20%) Moderate Asset (Above average) Opportunity for Improvement (Average or below)

Recommendation of ADRC Services

What have we learned about customers? Profile  Wide range of issues bring them to ADRCs  Most common information comes from referral  Almost half are on behalf of others  Almost one in five come in- person  Most have multiple conditions/eligibilities Satisfaction  High levels of overall satisfaction  Focus on customization and guidance  Vast majority willing to recommend

What have we learned about satisfaction?  Few differences in satisfaction between services, self/other  Physical and developmental disabilities, mental health services less satisfied  Referrals most satisfactory in the abstract  May indicate need to follow up, widen range of referrals, customize to additional restrictions  Non-productive referrals have negative effect on willingness to recommend  Among those who rate specific domains as fair or poor, many are still willing to recommend services  59% of those who rate Customization of Services as poor are willing to recommend  Less than one in three (27%) of those who rate Range of Knowledge as poor are so willing

What have we learned about improving satisfaction? OPPORTUNITIES  Widen range of information to improve usefulness and ability to resolve customers’ situations  Make it “easier” to get the right information  Customize services to improve willingness to recommend, overall experience  Follow up on referrals offers an opportunity to turn around result, yet only half report follow-up  Increase customization and guidance STRENGTHS  More than 9 out of 10, 93% would recommend services!  The opportunities offer a move from high good toward excellence  Informed decision making, accessibility have a strong influence on both overall experience and usefulness of the service and are clear strengths  Customers over 65 make up majority of clientele, and tend to be most satisfied

Questions? Amy Flowers, Ph.D. Analytic Insight 250 Center St. #409 Auburn. ME (207)