Visualizing Data Using Counting Opinions to Assess User Experiences

Slides:



Advertisements
Similar presentations
1 Prolix Innovation: Learning Environment Assessment for Performance Improvement Bernd Simon With Contributions from: Barbara Huber Claudia Röthlin Clemens.
Advertisements

The problem: Impact Assessment of Journals Impact Factor is widely used (& often abused) to assess impact of journals (& individuals) No single metric.
APT & Classified Council.  Survey objectives and conception:  Solicit employee feedback to generate agendas  Use data to inform the governance process.
Satisfacts Customer/Employee Evaluation Program Do you want to learn about what your clients, customers, members and employees are really thinking?
Use of the ACRLMetrics Service 9th Northumbria International Conference University of York, England Joe Matthews August 2011.
Student Opinion Survey It’s required…how do we make meaning out of it? How can results be the start of action?
Creating a User-Centered Culture of Assessment Stella Bentley and Bill Myers University of Kansas EDUCAUSE Southwest Regional Conference 2005.
© 2004 Keynote Systems Customer Experience Management (CEM) Bonny Brown, Ph.D. Director, Research & Public Services.
Voice of the Scout General Information Overview January-April 2012.
The Library Balanced Scorecard: The Results Please! Joe Matthews American Library Association June 2007.
User Centered Design April 1-3, 2009 Joshua Ganderson Laura Baalman Jay Trimble.
© CoreNet Global. All rights reserved. Calling All Members Summary Report September 2010.
University of Southern California Center for Systems and Software Engineering GQM, GQM+ Supannika Koolmanojwong CSCI577 Spring 2013 (C) USC-CSSE1.
1 Enhanced Commonwealth Performance Framework: A Programme Manager’s Perspective Government Programmes Community of Practice Forum – 23 March 2015 Suzanne.
Collaborative Assessment: Using Balanced Scorecard to Measure Performance and Show Value Liz Mengel, Johns Hopkins University Vivian Lewis, McMaster University.
ASSESSMENT. Assessment is the systematic and on-going process of collecting and reviewing evidence about the College's academic and administrative programs.
1 Mystery Shop Change Overview and Guide Effective January 2009 A focus on QSC Excellence leads to more satisfied customers The “Moment of Truth” is our.
Example City 1 Citizen Satisfaction. 2 Measuring Citizen Satisfaction Q: How do you measure citizen satisfaction? A: Ask the “Ultimate Question”
November 13, 2003 CMT Day 1 Kate Johnston Corporate Projects Consultant Halton Region CMT: The Halton Experience.
Presenters: Pauline Mingram & KG Ouye July 25, 2011 California State Library Public Access Technology Benchmarks Webinar.
An Open Access Bibliometrics Toolkit Ellen Breen, Library, Dublin City University Open University Library, March 2013.
Forging Forward: Using Evaluation as a Stepping Stone Joe Matthews SLA – San Diego Fall Seminar October 30, 2015.
To obtain feedback on member satisfaction with our meetings:  Meeting organization  Meeting content  Venue.
Customer Satisfaction Surveys at Your Fingertips.
Methods to improve scb.se with a user perspective Cecilia Westström Statistics Sweden June
Using LibQUAL+ to Rethink Public Services June 2003.
Thepul Ginige Lecture-7 Evaluation Approaches of Information System Thepul Ginige.
ACRL Academic Library Trends and Statistics Editorial Board June 27, 2015.
Rosie Drinkwater & Professor Lawrence Young Group Finance Director, Pro Vice-Chancellor (Academic Planning & Resources) League Tables Where are we, why.
Comprehensive Impact Assessment (CIA) David Read Policy Specialist Strategy, Localism and Communications.
LibQUAL+ TM Library Survey LIBQUAL+ “ Only customers judge quality – all other measures are irrelevant”
Planning and Executing Library Assessment: Basic Methods and Tools
Chapter 12 Review How can you measure the impact of ServicePrusOne over time?
Interview questions and answers – free download/ pdf and ppt file sales internship KPIs In this ppt file, you can ref KPI materials for sales internship.
Assessment Practices: Creating a Comprehensive Assessment Plan Danielle Champagne Assistant Director, Student Money Management Center University of North.
Chapter 4 Assessment.
2017 Winter Employee Engagement Survey
Organisational perspectives from a higher education institute and challenges of assessing UN activities at the community level Dzulkifli.
Library Assessment Tools & Technology
OPTN/UNOS Strategic Plan
Work System Snaphots- an introductory exercise
National Benchmarking
Texas A&M University, Colleen Cook Dean
Tell a Vision: 3 Vignettes
TransformIT Data. Driven
Tapping into the User Experience
Culture Matters: How Engagement Boosts Attendance February 2012.
VeNí Service-focused Approach
University of West Florida Libraries
Markku Laitinen, Planning Officer, National Library, Finland
Top 50 reporting.
Sales Baseline Assessment
Survey Design & Use.
Project Title 2018 UCSF Health Improvement Symposium Name
Learning by using CAF several times
National Student Survey 2019
ISO 9001 Auditing Practices Group
ISO 9001 Auditing Practices Group
Recreational Interests Survey (RIS)
Lean Profit HuntSM Accelerated Transformation
Using Data Summary.
Using Survey Results in Assessment
What is Planning? Start at 9:15—10 minutes to do this. Finish at 9:25.
Harvard ManageMentor®
Strategic Enhancement
Teacher/Superintendent Council
ISO 9001 Auditing Practices Group
Addressing the Issue — Information Gaps — “WIWIK”
WEST Program Assessments Past and Present
Satisfaction Survey Report
Presentation transcript:

Visualizing Data Using Counting Opinions to Assess User Experiences June 24, 2012 Using Counting Opinions to Assess User Experiences Bob Dugan Dean, UWF University Libraries, Pensacola FL

Counting Opinions comprehensive suite of library assessment tools for the capture and reporting of both qualitative user feedback and quantitative performance metrics from the user’s perspective continuous customer satisfaction survey instrument (LibSat) that provides us with up to the minute user feedback for management assessment and review

Why We Use Visual Data? Present information to the Provost and members of the Deans Council it conveys information about a measure it conveys comparative longevity information for chosen points in time

A Quadrant, and How We Use It To visualize services which users value as important and satisfied; as unimportant; and, when satisfaction lags behind importance. As a visual benchmark which can then be analyzed in time period comparisons. “A quadrant is worth a 1,000 words”

Opportunity Index (OI) Anthony Ulwick suggested in a 2002 Harvard Business Review of using customer importance and satisfaction data to produce a rank order list of services needing improvement. Formula for Ulwick’s Opportunity Index = Importance + [Importance – Satisfaction] Library advocate is Joseph R. (Joe) Matthews

Opportunity Index (OI) Counting Opinions LibSat includes an Opportunity Index. Visually identifies what the user has identified as the most important services needing improvement.

Opportunity Index (OI) Increasing the level of resources applied to each service area at the top of the list is likely to have more impact on the user’s perception than by altering resource levels for services at the bottom of the list. Please note, though, in some cases there is nothing the library can do about addressing an identified need that is externally driven. Can also produce the list at specific points of time for analysis.

Contact Information Counting Opinions info@countingopinions.com Bob Dugan rdugan@uwf.edu