Coding Open-Ended Comments LibQUAL+® Survey Results Best Practices: Stories from the Field January 14, 2009.

Slides:

Advertisements

Similar presentations

1 Getting Started: Applying ATLAS.ti and NESSTAR WebView to the LibQUAL+® Results at UBC Library by Margaret Friesen, Assessment Librarian, University.

Advertisements

Corporate Card Helpdesk Customer Satisfaction Survey 2005 Feedback Results.

Robin L. Donaldson May 5, 2010 Prospectus Defense Florida State University College of Communication and Information.

Business Communication: Process and Product, Third Canadian Edition, Guffey/Rhodes/Rogin, Nelson Thomson Learning.

Patient Questionnaire. Overview 675 questionnaires distributed 304 responses received Age range from 13 – 94 Gender –Females 185 –Males 118 –No answer.

1 Research Questions & Hypotheses. 2 Research questions/hypotheses Viewed within the context of logical structure and objectives.

Queen’s Libraries User Surveys Selected information from the Faculty and Student surveys June 2002.

Bound for Disappointment Faculty and Journals at Research Institutions Jim Self University of Virginia Library USA 7 th Northumbria Conference Spier, South.

March 25, The Blundellsands Surgery Patient Reference Group Questionnaire Results Monday, March 25 th 2013.

NWACC Library Instruction Program Teaching information literacy skills for academic success and lifelong learning.

LibQUAL+ at The University of Alabama: The Rest of the Story Lou Pitschmann, Dean University Libraries, UA January 17, 2007.

Genre Shift: Instructor Presence and its Impact on Student Satisfaction in Online Learning.

Enhancing Motivation. By the end of this session, you will be able to: Define motivation. Explain the five methods we can use to motivate staff. Identify.

What Makes Access Services Staff Happy? A Job Satisfaction Survey Bethany Sewell Access Services and Reference Librarian The College of New Jersey 2000.

Implementing Undergraduate-Faculty Teaching Partnerships in Your Classroom Anna L. Ball Neil A. Knobloch University of Illinois, Urbana-Champaign.

1. What is your affiliation with Babson? Ugrad 34% Grad 17% Faculty 18% Administration 22% None 5% Initial On-Line/In-Class Survey 400 Respondents 2.

Principles of Marketing

Customer Service In the Social Media Age. What is This Presentation About? The impacts of social media and internet review sites on business today The.

Manuscript Writing and the Peer-Review Process

Getting Started. Decide which type of assessment –Input assessment –Process assessment –Outcomes assessment –Impact assessment.

Julia Bauder, Grinnell College & Jenny Emanuel, University of Illinois Be Where our Faculty Are: Emerging Technology Use and Faculty Information Seeking.

© 2001 Dr. Laura Snodgrass, Ph.D.1 Non-experimental Methods Observation and Survey Research.

Research Papers. Critical Thinking Observations: From a series of observations we can establish facts. You have all experienced some sort of interactive.

Santa, I want books, a computer, … and the ability to travel through time and space. Easy! Here is your SJSU library card.

An Analytical survey for improving the front desk Service of FHS Library: The Customer Relationship Environment Customers’ Feeling at the Counter 60 Upto.

Exploring the use of QSR Software for understanding quality - from a research funder’s perspective Janice Fong Research Officer Strategies in Qualitative.

NorthSky Nonprofit Network Creating Customer Satisfaction Surveys Presented by Christine A. Ameen, Ed.D. Ameen Consulting & Associates

Getting Staff Involved in Assessment at the University of Connecticut Libraries Brinley Franklin 17 August 2009.

Data Summary July 27, Dealing with Perceptions! Used to quantifiable quality (collection size, # of journals, etc.) Survey of opinions or perceptions.

LibQual 2013 Concordia University Montréal, Québec.

L643: Evaluation of Information Systems

Agenda Communication Is key Create a strong foundation Provide training and support Evaluate, evaluate, evaluate Working with unions Q&A Page 2.

Ethics, Technology, and Qualitative Research: Thinking through the Implications of New Technology Sandra Spickard Prettyman Kristi Jackson.

The Reference Interview Ione Hooper LIS 503 Fall 2003.

January 22, 2007 ALA Midwinter, Seattle Emmanuel d’Alzon Library Assumption College LibQUAL+ Results: What Now? Dr. Dawn Thistle Director of Library Services.

Department Library and Information Science RESEARCH PROPOSAL 1.

The Process of Conducting Research

Makerere University Outreach Workshop.  Setting goals  Survey design  Key stakeholders  Implementation  Online survey tools  Survey results.

SPSS Example Demonstrate Descriptives and Explore menu.

Usability, the User Experience & Interface Design: The Role of Reference July 30, 2013.

Learning from Pharmacy Distance Learners by By Rae Jesano, MSLS, AHIP, Linda Butson, MLn, MPH, AHIP, Mary Edwards, MSLIS, Health Science Center Libraries,

Virtual Reference Assessment: Gathering User Input Kathleen M. Dreyer August 19, 2009.

1 This CCFSSE Drop-In Overview Presentation Template can be customized using your college’s CCFSSE/CCSSE results. Please review the “Notes” section accompanying.

Planning an Applied Research Project Chapter 3 – Conducting a Literature Review © 2014 by John Wiley & Sons, Inc. All rights reserved.

Ratio of reviews written by respondents to every 100 companies they have done business with Most respondents had written between 5 and 10 reviews out of.

Customer Surveys Tiger1 Card Services Clemson University.

Preliminary Report NANPA 2009 Performance Numbering Oversight Working Group (NOWG) May 05, 2010 Co-Chairs: Laura Dalton, Verizon Communications Natalie.

Charting Library Service Quality Sheri Downer Auburn University Libraries.

Library Satisfaction Survey Results Spring 2008 LibQUAL Survey Analysis User Focus Team (Sharon, Mickey, Joyce, Joan C., Paula, Edith, Mark) Sidney Silverman.

A Usability Assessment of EBSCO Discovery Service David Comeaux – Web Development Librarian Emily Frank – Instructional Technologies Librarian Mike Waugh.

The Liaison Librarian Program – Meeting Faculty Needs? Daphne Flanagan, AUS University Librarian, Alanna Ross, AUS Associate University.

OBSERVATIONAL METHODS © 2009 The McGraw-Hill Companies, Inc.

Motivating Accessibility Adoption on Campus Cyndi Rowland, Director WebAIM; National Center on Disability and Access to Education Center for Persons with.

LibQUAL+ ® Survey Administration LibQUAL+® Exchange Northumbria Florence, Italy August 17, 2009 Presented by: Martha Kyrillidou Senior Director, Statistics.

2015 SAA Board Survey. Raw Board Survey ResultsStrongly Agree AgreeDisagreeStrongly Disagree Don't Know Total Points Responses minus DKs Average Score.

ILL User Surveys at Old Dominion University Stuart Frazer Interlibrary Loan Librarian Perry Library, Old Dominion University

Welcome to the Freedom Park School Volunteer Training Workshop.

ALISE Philadelphia 9 January 2008 Users and Librarians Engaging in Virtual Spaces: Using Critical Incidents to Inform Practice and Education in Chat Reference.

Chat Widgets John Meier, Science Librarian. Customer Service.

1. G.R.E.A.T. TM Consistent, Connected, System-wide Communication 2.

Center for Faculty Excellence Workshops First impressions and the reference encounter (handout.

1 June 2013 Engaging users: initiatives and challenges in VNU-HCM Central Library.

Using LibQUAL+ to Rethink Public Services June 2003.

Learning Communities and Their Effect on Deep and Surface Approaches to Learning By Patti Dyjur.

Assessing Student Critical Thinking Skills in Single Library Instruction Class Gayla Byerly Phoenix Staff Development May 27, 2011.

Comment Sifting: A Practical Approach to LibQUAL+ Comment Analysis Michael Luther, Assessment Librarian, Kennesaw State University ABSTRACT The qualitative.

Queen’s University Library 2004 LibQUAL+™ Comments Easy Access & Analysis with.

Individualized research consultations in academic libraries: Useful or useless? Let the evidence speak for itself Karine Fournier Lindsey Sikora Health.

Lesson Design Study Leading Lesson Study.

Impact on customers and library staff of going fully self-service: the experience at Nottingham Trent University Mike Berrington, Deputy University Librarian.

Presentation transcript:

Coding Open-Ended Comments LibQUAL+® Survey Results Best Practices: Stories from the Field January 14, 2009

The search for coding information began Feb. 24, 2008 General Query sent to “Can anyone share information about how they coded the open-ended comments from the LibQUAL+® survey?”

LibQUAL+® Listserv Query - Results Software utilized Influence of theories Coding to Themes/Topics LibQUAL+ dimensions Value/Emotional Content Question Numbers Named departments/persons LibQUAL+ questions Demographics

Software- Local Decision Influences Campus Users Review (Journal of Mixed Methods Research) Support, company and local Cost

Assistance/Consultations for Coding Process LibQUAL+® listserv software; categories; resources OSU Qualitative Research Faculty importance of data immersion; resources QSR Website and Customer Assistance tutorial; questions; tips; importing data Faculty member using NVivo demonstration; questions Systems / IT software; importing data

DATA REDUCTION At OSU, 1,067 Comments (38.8% of respondents) Reduced to 853, by eliminating small, specific data sets “other library” “no comments” very general comments that didn’t say anything of use survey population (faculty, staff) comments about the survey itself

Of the demographics provided by LibQUAL+® We considered: What Fields Mattered to Us? What would most impact our services? Our decision: Classification Discipline Library Used Most Often

Sample Tree Nodes, dictated by the data Books Building Online Resources Journals Study Technology Hours Instruction Library Services Resources Parking

Values, defined locally Praise- commend; “express favorable judgment”; approval; satisfaction (positive comment) Words such as: like, love, enjoy, happy, good, important, glad, pleased, satisfied, positive, helpful Strong Praise- effusively positive; detailed exclamatory positive statement; explanatory or descriptive reason for praise Words such as: great, excellent, amazing, fabulous, best, outstanding, always, thanks, grateful Merriam-Webster’s collegiate dictionary (11 th ed.). (2004). Springfield, MA: Merriam-Webster.

More Values, defined locally Complaint- expresses discontent; mildly negative; unfavorable (a negative comment) Words such as: more, cannot, never, hardly, often, sometimes, isn’t, lacks, lack of Strong Criticism- severely unfavorable; hostile; pessimistic; fault-finding; points out flaws; clearly negative incident or encounter (explains or describes reason for criticism) Words such as: hate, frustrating, embarrassing, irritating, nightmare, unacceptable, never, impossible

More Values, defined locally Suggestion- “mentions or implies a possibility”; “offer for consideration”; “propose as fitting”; (concrete suggestion) Words: more, should, would like, would be, would appreciate, wish, could, could have, could be, needs, add, improve Neutral Observation- “not engaged on either side”; indifferent; not positive or negative, just an observation Merriam-Webster’s collegiate dictionary (11 th ed.). (2004). Springfield, MA: Merriam-Webster.

Number of Comments by Value

Coding Open-Ended Comments Challenges Timeframe Importing data into software Inter-rater reliability Benefits/Uses of Data Software Strategic Planning Library Development Innovative Ideas Emergence of strongest themes

Karen Neurohr, Assessment Librarian Oklahoma State University