Using LibQUAL+ to Rethink Public Services June 2003.

Slides:



Advertisements
Similar presentations
R LibQUAL+: A Measurement Tool for Special Libraries? Susan Scheiberg Assistant Director, Library RAND Corporation David Shumaker Manager, Information.
Advertisements

Outcomes Assessment- Full Implementation Meeting Fall 2009.
Using LibQUAL+ to Develop Accountability with Key Stakeholders Raynna Bowlby Based upon presentation made w/co-presenter Dan O’Mahony (Brown U. Library)
The LibQual+ CUL Assessment Working Group Jeff Carroll Joanna DiPasquale Joel Fine Andy Moore Nick Patterson Jennifer Rutner Chengzhi Wang January.
Copyright © 2002 by The McGraw-Hill Companies, Inc. All rights reserved Chapter The Future of Training and Development.
Measuring the Perceived Value of your IT Service Marin Stanek Director of Communications & Support A brief overview of TechQual+ Project
LibQUAL+ in the UK & Ireland: five years experience J. Stephen Town and Selena Lock, Cranfield University.
Bound for Disappointment Faculty and Journals at Research Institutions Jim Self University of Virginia Library USA 7 th Northumbria Conference Spier, South.
Listening To Our Users Queen’s 2010
LibQUAL+ The Arizona State University Libraries’ Experience.
Using Assessment Data to Improve Library Services Christopher Stewart Dean of Libraries, Illinois Institute of Technology Charles Uth, Head of Collection.
Designing a library support infrastructure for the use of digital content for teaching Danuta A. Nitecki & Karen Reardon Yale University Library Digital.
LibQUAL+ Data for Learning Commons Focus Groups University Libraries Assessment Committee.
How Assessment Will Inform Our Future 1. Administration of on-going user surveys and focus groups to enhance reference services 2. Analysis of LibStats.
Two Decades of User Surveys The Experience of Two Research Libraries from 1992 to 2011 Jim Self, University of Virginia Steve Hiller, University of Washington.
The Academic Assessment Process
TM Project web site Quantitative Background for LibQUAL+ for LibQUAL+  A Total Market Survey Colleen Cook Bruce Thompson January.
Strategy/Initiative/Program Evaluation Tool. The Evaluation Tool has 5 Sections and a Set of Conclusions 1. What is the READINESS for implementing the.
Assessment of Staff Needs and Satisfaction in an Evergreen Environment David Green NC Cardinal Consultant State Library of North Carolina.
LibQUAL + ™ Data Summary An overview of the results of the LibQUAL+™ 2003 survey with comparisons to the 2001 survey.
LibQUAL Tales from Past Participants Vanderbilt University Library Flo Wilson, Deputy University Librarian
Helping Your Department Advance and Implement Effective Assessment Plans Presented by: Karen Froslid Jones Director, Institutional Research.
of Research Libraries Assessing Library Performance: New Measures, Methods, and Models 24 th IATUL Conference 2-5 June 2003 Ankara,
WVU Libraries LibQual Surveys 2003, 2005, 2007 “ The WVU library system is outstanding. I honestly cannot think of anything that needs improvement within.
 Large-scale, web-based, user-centered assessment of library service effectiveness across multiple universities.  Co-developed by ARL and Texas A&M University,
Evaluation Basics Principles of Evaluation Keeping in mind the basic principles for program and evaluation success, leaders of youth programs can begin.
New Ways of Listening To Our Users: LibQUAL+ Queen’s.
Charting Library Service Quality Sheri Downer Auburn University Libraries.
Getting Staff Involved in Assessment at the University of Connecticut Libraries Brinley Franklin 17 August 2009.
How to participate in LibQUAL+ and effectively utilise the data.
Data Summary July 27, Dealing with Perceptions! Used to quantifiable quality (collection size, # of journals, etc.) Survey of opinions or perceptions.
LibQual 2013 Concordia University Montréal, Québec.
Assessing Program-Level SLOs November 2010 Mary Pape Antonio Ramirez 1.
Frank Haulgren Collection Services Manager & Assessment Coordinator Western Libraries Lite 2010 Survey Results.
LibQUAL+ ® Survey Results American Library Association (ALA) Midwinter Meeting Philadelphia, PA January 14, 2008 Martha Kyrillidou, Director Statistics.
Testing the LibQUAL+ Survey Instrument James Shedlock, AMLS, Dir. Linda Walton, MLS, Assoc. Dir. Galter Health Sciences Library Northwestern University.
August 7, Market Participant Survey Action Plan Dale Goodman Director, Market Services.
Using LibQUAL+™ Results Observations from ARL Program “Making Library Assessment Work” Steve Hiller University of Washington Libraries ARL Visiting Program.
User Surveys Frances M. Brillantine Catholic University Law Library AALL, July 2008.
LibQUAL+™ Process Management: Using the Web as a Management Tool Amy Hoseth Massachusetts LSTA Orientation Meeting Boston, MA October 21, 2005 old.libqual.org.
After the Academy Selena Lock LibQUAL+ Results Meeting 22nd August 2005.
AN INTRODUCTION Managing Change in Healthcare IT Implementations Sherrilynne Fuller, Center for Public Health Informatics School of Public Health, University.
June 25, 2007 ALA Washington, DC Emmanuel d’Alzon Library Assumption College Using Your LibQUAL+ Results Dr. Dawn Thistle Director of Library Services.
How to participate in LibQUAL+ and effectively utilise the data.
1 Project web site Evaluating Library Service Quality: Use of LibQUAL+  IATUL Kansas City, MO June 2002 Julia Blixrud Association.
Charting Library Service Quality Sheri Downer Auburn University Libraries.
Project web site: old.libqual.org LibQUAL+™ Process Management: Using the Web as a Management Tool ALA Midwinter Conference San Diego, California January.
LibQUAL Survey Results Customer Satisfaction Survey Spring 2005 Sidney Silverman Library Bergen Community College Analysis and Presentation by Mark Thompson,
LibQUAL+® Lite in Hebrew By Dr. Lynne Porat University of Haifa Library LibQUAL+® Exchange, 8th Northumbria International Conference on Performance Measurement.
ClimateQUAL™: Organizational Climate and Diversity Assessment Sue Baughman Texas Library Association April 2009.
LibQual+ Spring 2008 results and recommendations Library Assessment Working Group 11/19/2008 Library Faculty Meeting.
TM Project web site New Ways of Listening to Users: Colleen Cook Bruce Thompson Consuella Askew Waller April 10-13, 2003 ACRL 11 th.
Focus on SCONUL Institutions: Cranfield University – DCMT Campus Stephen Town.
Your LibQUAL+ ® Community: A Results Meeting American Library Association (ALA) Annual Conference Washington, DC June 25, 2007 Martha Kyrillidou, Director.
LibQUAL+ ® Survey Results Presented by: Martha Kyrillidou Senior Director, Statistics and Service Quality Programs Association of Research.
ARL New Measures —a View from Cornell Anne R. Kenney ARL Survey Coordinators and SPEC Liaisons Meeting ALA June 2007.
The Assessment of Blended Courses: Gathering and Using Faculty and Student Feedback to Maximize Program Effectiveness Orly Calderon, PsyD, Long Island.
Improving Instruction for Students with Severe Disabilities William Sharpton Richard Hall University of New Orleans.
Our 2005 Survey Results. “….only customers judge quality; all other judgments are essentially irrelevant” Delivering Quality Service : Balancing Customer.
LibQUAL+ TM Library Survey LIBQUAL+ “ Only customers judge quality – all other measures are irrelevant”
A half decade of partnership and the love affair continues….. LibQual+: A Total Market Survey with 22 Items and a Box ALA Midwinter Meeting January 17,
Individualized research consultations in academic libraries: Useful or useless? Let the evidence speak for itself Karine Fournier Lindsey Sikora Health.
Library Assessment Tools & Technology
WOREP: What we learned at CSUF?
BY DR. M. MASOOM RAZA  AND ABDUS SAMIM
Assessing Library Performance:
Dr. Manoj Kumar Verma Assistant Professor
What Do Users Think of Us? Mining Three Rounds of Cornell LibQUAL Data
Using the LibQUAL+ Survey to Inform Strategic Planning
LibQual+ Survey Results 2002
Presentation transcript:

Using LibQUAL+ to Rethink Public Services June 2003

Amy Knapp University of Pittsburgh

Agenda What we learned about/via the process of our involvement What we learned about/via the process of our involvement Specifically, how our library has used the data (qualitative and quantitative) to enhance library services based on your users' perspectives. Specifically, how our library has used the data (qualitative and quantitative) to enhance library services based on your users' perspectives. Additionally, because of our position as a LibQUAL+ repeater, I ’ ll share what our users' responses to those changes have been - as reflected by: Additionally, because of our position as a LibQUAL+ repeater, I ’ ll share what our users' responses to those changes have been - as reflected by: subsequent LibQUAL+ data subsequent LibQUAL+ data by experiences by experiences

Before you begin You have to be committed to change You have to be committed to change You have to be committed to listening You have to be committed to listening Not defensively Not defensively Using LibQUAL+ as tool for communication Using LibQUAL+ as tool for communication You have to be prepared to use LibQUAL+ as an assessment tool not as tool for comparison to others You have to be prepared to use LibQUAL+ as an assessment tool not as tool for comparison to others

Before you get started … Establish who will be doing what. Establish who will be doing what. Establish timeline that works best for your institution. Establish timeline that works best for your institution. Establish process for handling user questions, requests. Establish process for handling user questions, requests. Publicity and staff awareness Publicity and staff awareness

Launching the survey Writing the perfect invitational memo Writing the perfect invitational memo Working with IT on set-up. Working with IT on set-up. Expect some glitches. Be flexible! Expect some glitches. Be flexible! Addressing comments/responses. Addressing comments/responses.

Dealing with the data You ’ ve asked them, now listen! You ’ ve asked them, now listen! Resist the temptation to be defensive! Resist the temptation to be defensive! Interpreting the data. Interpreting the data. Where to begin … Where to begin … As many places, we first addressed the worst As many places, we first addressed the worst Subsequent years try to close the gaps between (what I call) good and great Subsequent years try to close the gaps between (what I call) good and great

Dealing with the data Thinking creatively about how to address major issues and concerns: Thinking creatively about how to address major issues and concerns: Complete runs of journal titles Complete runs of journal titles Library as Place Library as Place Communication Communication Resist the temptation to use it as a comparison with others. Resist the temptation to use it as a comparison with others. It ’ s really about your users and their needs. It ’ s really about your users and their needs.

Using the data over time to assess change As a repeat participant we were able to use our data to measure the impact of changes we made based on user input. As a repeat participant we were able to use our data to measure the impact of changes we made based on user input. Library as Place Library as Place Document Delivery — waiting to see! Document Delivery — waiting to see! Communicate to users (and staff!) your commitment to continuous improvement. Communicate to users (and staff!) your commitment to continuous improvement.

The rethinking process Largest LibQUAL+ implementation. Largest LibQUAL+ implementation. Charged with determining what our users need and implementing services to meet those needs. Charged with determining what our users need and implementing services to meet those needs. Worked with Julia Blixrud of ARL to develop a process. Worked with Julia Blixrud of ARL to develop a process. Analyzed LibQUAL+ data over time. Analyzed LibQUAL+ data over time. Used this data to inform focus groups. Used this data to inform focus groups.

Focus group process Twelve groups of faculty, undergrads, graduate students for all disciplines. Twelve groups of faculty, undergrads, graduate students for all disciplines. Asked ten questions regarding nature and frequency of use, and satisfaction with library resources and services. Asked ten questions regarding nature and frequency of use, and satisfaction with library resources and services. Questions based on LibQUAL+ data. Questions based on LibQUAL+ data.

What we found  Value competent, knowledgeable in-person assistance  Lack awareness of library resources and services. Although users are generally pleased with resources available, they expressed concern regarding keeping up with pace of information resources added to the collections  Appreciate electronic resources and the convenience of desktop access  Many faculty and students, especially in the humanities, continue to rely on print resources.

Recommendations Libraries to Go! Libraries to Go! Digital reference service Digital reference service Increase library instruction Increase library instruction Renewed emphasis on public service training Renewed emphasis on public service training Undergraduate initiatives: Undergraduate initiatives: Peer-to-peer library consultants Peer-to-peer library consultants Undergraduate Information Commons Undergraduate Information Commons Wireless laptop project Wireless laptop project

Conclusions Obvious--we took the findings and redesigned services to meet our user needs. Obvious--we took the findings and redesigned services to meet our user needs. Less obvious--communicated too our staff and users our commitment to solicit user input and use it to design library resources and services. Less obvious--communicated too our staff and users our commitment to solicit user input and use it to design library resources and services. Where do we go from here? Where do we go from here?

LibQUAL+ “ LibQUAL measures dimensions of perceived library quality; that is, each survey question is part of a broader category and scores within those categories are analyzed in order to derive more general information about library users ’ perceptions of service ”

“It would be great if you could provide as a repeat participant, the UPitt experience. Specifically, how your library has used your data (qualitative and quantitative) to enhance your library services based on your uers' perspectives. Additionally, because of your unique position as a repeater, if you could share what your users' responses to those changes have been - either as reflected by subsequent LibQUAL+ data or by anecdotal stories or both. I think this audience would really benefit from your experience. Attached is a preliminary agenda to give you an idea about the workshop content and activity.”

LibQual 2002 Additionally refined to reflect information gathered from 2000 and 2001 surveys and input from libraries Additionally refined to reflect information gathered from 2000 and 2001 surveys and input from libraries 25 Questions 25 Questions Measured 4 separate dimensions including: Measured 4 separate dimensions including: Service Affect Service Affect Library as Place Library as Place Personal Control Personal Control Information Access Information Access