QUANTITATIVE EVIDENCE

Slides:

Advertisements

Similar presentations

The LibQual+ CUL Assessment Working Group Jeff Carroll Joanna DiPasquale Joel Fine Andy Moore Nick Patterson Jennifer Rutner Chengzhi Wang January.

Advertisements

Listening To Our Users Queen’s 2010

Dr. Fred Heath, Vice Provost of General Libraries

Assessment with LibQUAL+ ™ at the University of Vermont Vermont Library Association College and Special Libraries Section Conference April 7, 2006 Selene.

TM Project web site Invited Address October, 2004 South Africa.

Glasgow, Scottland May 24, 2010 ITEM SAMPLING IN SERVICE QUALITY ASSESSMENT SURVEYS TO IMPROVE RESPONSE RATES AND REDUCE RESPONDENT BURDEN: THE “LibQUAL+®

LibQUAL + Surveying the Library’s Users Supervisor’s Meeting March 17, 2004.

Asia Pacific Conference on Library & Information Education and Practice (A-LIEP) Nanyang Technological University, Singapore April 4, 2006 Bruce Thompson.

Project URL – TM LibQUAL+ ™ : An Overview CASLIN The Czech Republic June, 2006 Presented by: Bruce Thompson

TM Project web site Quantitative Background for LibQUAL+ for LibQUAL+  A Total Market Survey Colleen Cook Bruce Thompson January.

Project web site – TM Ottawa, Canada June 14, 2006 Presented by: Dr. Colleen Cook, Dean Texas A&M University Quantitative and Qualitative.

Assessment of Staff Needs and Satisfaction in an Evergreen Environment David Green NC Cardinal Consultant State Library of North Carolina.

LibQUAL+ ® in South Africa Sherrie Schmidt, Arizona State and ARL President Martha Kyrillidou, ARL Stellenbosch, South Africa August 13, 2007 old.libqual.org.

Project web site: old.libqual.org LibQUAL+™ from a Technological Perspective: A Scalable Web-Survey Protocol across Libraries Spring 2003 CNI Task Force.

Outcome Assessment Tools for the Library of the Future ACRL Conference 2005 April 7, 2005 Minneapolis, MN Martha Kyrillidou Director, ARL Statistics.

Reliability and Validity of 2004 LibQUAL+™ Scores for Different Language Translations Martha Kyrillidou Colleen Cook Bruce Thompson ALA Annual Conference.

LibQUAL+ TM at the University of Lethbridge 2005 January 26 L. Jacobs.

New Ways of Listening To Our Users: LibQUAL+ Queen’s.

LibQual 2013 Concordia University Montréal, Québec.

Library Quality Assessment through LibQUAL+ ® IATUL 2009 Leuven, Belgium June 2, 2009 Presented by Martha Kyrillidou Director, Statistics and Service Quality.

Project URL – TM LibQUAL+ ™ Introduction Seattle / London January, 2007 Presented by: Colleen Cook Bruce Thompson.

LibQUAL+ ® 2007: An Introduction American Library Association (ALA) Annual Conference Washington, DC June 25, 2007 MaShana Davis and Martha Kyrillidou.

Library Quality Assessment NCES Summer Data Conference July 25, 2002 Martha Kyrillidou, Julia Blixrud, Consuella Askew Waller Project web site

Project URL – TM QUANTITATIVE EVIDENCE Philadelphia January, 2008 Presented by: Bruce Thompson.

LibQUAL+™ Origins, Design, Interpretation La Calidad en las Bibliotecas Conferencia Palma de Mallorca January 2005 Fred Heath Vice Provost and Director,

LibQUAL+ ® : An Introduction Bern, Switzerland July 9, 2007 PRESENTED BY: Martha Kyrillidou Association of Research Libraries old.libqual.org.

Old.libqual.org LibQUAL+ ® and Beyond: Using Results Effectively University of York Heslington, York, UK June 23, 2008 Martha Kyrillidou Director, Statistics.

Project URL – TM Score Norms 17 th Greek Academic Libraries Conference 24 September, 2008 Presented by: Bruce Thompson, M. Kyrillidou.

LibQUAL+™ Process Overview Using the Web as a Management Tool Martha Kyrillidou LibQUAL+™ Canada Meeting Ottawa, Canada June 14, 2006 old.libqual.org.

TM Project web site Report Meeting Colleen Cook Bruce Thompson Martha Kyrillidou July 28, 2003 Durham United Kingdom.

LibQUAL+™ Introduction

LibQUAL 2005 at London South Bank. Peter Godwin London South Bank University 2 February 2006.

Online Northwest Twentieth Annual Conference Corvallis, Oregon February 28, 2003 Julia Blixrud, ARL Director of Information Services LibQUAL+ TM: An Innovative,

LibQUAL+ ® Survey Introduction Presented by: Martha Kyrillidou Association of Research Libraries American Library Association Midwinter.

Measuring Library Services Initiative to Recruit a Diverse Workforce Leadership Symposium San Antonio, TX January 21, 2006 Martha Kyrillidou.

LibQUAL+ ® 2007: An Introduction LibQUAL+® Canada Ottawa October, 2007 Presented by: Bruce Thompson old.libqual.org.

Old.libqual.org A fairytale about “ 22 items and a box ” presented by Martha Kyrillidou May 24, 2004 Medical Library Association Washington, DC.

Project web site old.libqual.org TM November 12, 2002 San Francisco, CA Colleen Cook Bruce Thompson AAHSL Spring 2002 Results Results.

Re-Visioning the Future of University Libraries and Archives through LIBQUAL+ Cynthia Akers Associate Professor and Assessment Coordinator ESU Libraries.

Fairytale A fairytale about “ 22 items and a box ” LibQUAL+™ Meeting San Antonio, TX and London, UK Jan 23 and Feb Martha Kyrillidou Director,

1 Project web site Evaluating Library Service Quality: Use of LibQUAL+  IATUL Kansas City, MO June 2002 Julia Blixrud Association.

LibQUAL+ ® Survey Introduction Philadelphia, PA January 14, 2008 Presented by: Martha Kyrillidou Director, Statistics and Service Quality Programs Association.

Le New Measures Initiative de l’American Library Association (ARL) A CREPUQ 1 février 2005 Montreal, Canada Martha Kyrillidou Director, ARL.

TM Project web site: Bruce Thompson Colleen Cook Martha Kyrillidou Glasgow January 19-20, 2004 Quantitative Grounding “22 Items.

TM Project web site: Colleen Cook Bruce Thompson Seattle / London January, 2007 “ 22 Items and a Box ” Qualitative Grounding :

TM Project web site: Colleen Cook Bruce Thompson Auckland, NZ April 5, 2005 “ 22 Items and a Box ” Qualitative Grounding :

Project URL – TM QUANTITATIVE EVIDENCE Washington, DC June, 2007 Presented by: Colleen Cook.

TM Project web site Report Meeting Colleen Cook Bruce Thompson Martha Kyrillidou Jonathan Sousa June 21, 2003 ALA Toronto CANADA.

Project URL – TM QUANTITATIVE EVIDENCE Auckland, NZ April 5, 2005 Presented by: Colleen Cook Bruce Thompson.

TM Project web site New Ways of Listening to Users: Colleen Cook Bruce Thompson Consuella Askew Waller April 10-13, 2003 ACRL 11 th.

Old.libqual.org fairytale A fairytale about “ 22 items and a box ” Martha Kyrillidou Shrivenham, UK.

“22 items and a box” Martha Kyrillidou Association of Research Libraries NELA Boston, MA September 28, 2004 old.libqual.org.

Your LibQUAL+ ® Community: A Results Meeting American Library Association (ALA) Annual Conference Washington, DC June 25, 2007 Martha Kyrillidou, Director.

Benchmarking in North American Libraries: An Evolving Art International Conference on Performance Measurement and Benchmarking in Libraries Bratislava,

LibQUAL+ ® Survey Results Presented by: Martha Kyrillidou Senior Director, Statistics and Service Quality Programs Association of Research.

Our 2005 Survey Results. “….only customers judge quality; all other judgments are essentially irrelevant” Delivering Quality Service : Balancing Customer.

Project URL – TM ® LibQUAL+ ® : An Overview The Third Lodz [Poland] Library Conference Technical University of Lodz June,

Project URL – TM LibQUAL+ ™ Introduction Martha Kyrillidou Bruce Thompson National Library for Health London, UK August 26, 2005.

QUANTITATIVE EVIDENCE

Library Assessment Tools & Technology

Score Norms 17th Greek Academic Libraries Conference

Assessment with LibQUAL+ ™ at the University of Vermont

Service Quality Assessment in a Digital Library Environment

Qualitative Grounding

LibQUAL+TM : A Total Market Survey

QUANTITATIVE EVIDENCE

QUANTITATIVE EVIDENCE

QUANTITATIVE EVIDENCE

2004 Overview LibQUAL+™ Results Meetings

LibQUAL+™: Brief Overview

Presentation transcript:

QUANTITATIVE EVIDENCE Denver January, 2009 Presented by: Bruce Thompson

“The LibQUAL+® Background” “The Birth/Origins of LibQUAL+®” http://www.coe.tamu.edu/~bthompson/libbirth.htm

LibQUAL® “Top Ten Resources” http://www.coe.tamu.edu/~bthompson/top_ten.htm

Three Seminal Quotations Premises Three Seminal Quotations

LibQUAL+™ Premise #1 “….only customers judge quality; PERCEPTIONS SERVICE “….only customers judge quality; all other judgments are essentially irrelevant” Note. Zeithaml, Parasuraman, Berry. (1999). Delivering quality service. NY: The Free Press.

LibQUAL+™ Premise #2 “Il est plus nécessaire d'étudier les hommes que les livres” —FRANÇOIS DE LA ROCHEFOUCAULD

LibQUAL+™ Premise #3 “We only care about the things we measure.” --Bruce Thompson, CASLIN, 2006

“22 Items and The Box….” Why the Box is so Important About 40% of participants provide open-ended comments, and these are linked to demographics and quantitative data. Users elaborate the details of their concerns. Users feel the need to be constructive in their criticisms, and offer specific suggestions for action.

“…and Five Ancillary Items” Either Zero or Five Ancillary items are selected to address local or consortial concerns Items from the initial LibQUAL+TM item pool. Items written by previous consortial groups.

Some Measurement Integrity Evidence Empathy Information Control Responsiveness Symbol Utilitarian space Assurance Scope of Content Ease of Navigation Self - Reliance Library as Place Library Service Quality Model 3 Refuge Affect of Service Reliability Convenience Timeliness Equipment

alpha By Language By Language Service Info. Lib as Group n Affect Control Place TOTAL American (all) 59,318 .95 .91 .88 .96 British (all) 6,773 .93 .87 .81 .94 French (all) 172 .95 .90 .89 .95

alpha by University Type Service Info. Lib as Group n Affect Control Place TOTAL Comm Colleges 4,189 .96 .92 .89 .97 4 yr Not ARL 36,430 .95 .91 .88 .96 4 yr, ARL 14,080 .95 .90 .87 .96 Acad Health 3,263 .95 .92 .90 .96

“How You Can… Integrity… Service Quality…” alphas for 2006 Scores A Key Resource: “How You Can… Integrity… Service Quality…” --Virginia 2006 Assessment Conference and Performance Measurement and Metrics

Service Affect Service Affect (n = 71,170 English) SA20APER .80541 .22199 .27521 SA07APER .80338 .27236 .20993 SA17APER .79655 .20844 .22793 SA04APER .77062 .29258 .17694 SA15APER .73437 .34646 .24299 SA23APER .73391 .34359 .27896 SA01APER .71589 .29773 .16972 SA12APER .71541 .32229 .25528 SA10APER .68825 .35941 .28090

Library as Place Library as Place (n = 71,170 English) LP13APER .26213 .25710 .80013 LP05APER .20412 .15920 .73601 LP09APER .27765 .24869 .72631 LP24APER .26672 .34873 .72148 LP19APER .19630 .28102 .70295

Information Control Information Control (n = 71,170 English) IA18APER .29824 .73480 .28164 PC11APER .29045 .71111 .19999 IA03APER .24482 .70341 .18989 PC25APER .21770 .68760 .22736 PC21APER .41572 .65615 .30096 PC02APER .37847 .63860 .16559 PC16APER .33439 .61598 .36448 IA14APER .28759 .58521 .39295

Validity Correlations Serv_Aff Info_Con LibPlace TOTALper Serv_Aff 1.0000 .7113 .5913 .9061 Info_Con .7113 1.0000 .6495 .9029 LibPlace .5913 .6495 1.0000 .8053 TOTALper .9061 .9029 .8053 1.0000 ESAT_TOT .7286 .6761 .5521 .7587 EOUT_TOT .5315 .6155 .4917 .6250

Interpretation: Mean Perceived Scores (n=34)

Score Norms Norm Conversion Tables facilitate the interpretation of observed scores using norms created for a large and representative sample. LibQUAL+® norms have been created at both the individual and institutional level

Institutional Norms for Perceived Means on 25 Core Questions Note: Thompson, B. LibQUAL+ Spring 2002 Selected Norms, (2002).

2006 Singapore Norms Stability Study r's for LibQUAL+™ Total Percentile Scores Across Two Language Versions and Five Years ('01 to '05) _____________________________________________________ Sample/ Variable Variable AmEng_01 AmEng_02 AmEng03a BrEng_03 AmEng03b n 16,918 63,285 93,550 6,853 93,550 v 25 25 25 25 22 AmEng_01 1.0000 AmEng_02 .9823 1.0000 AmEng03a .9996 .9819 1.0000 BrEng_03 .9998 .9827 .9994 1.0000 AmEng03b .9995 .9818 1.0000 .9993 1.0000 AmEng_04 .9998 .9825 .9996 .9998 .9995 BrEng_04 .9993 .9822 .9983 .9995 .9982 AmEng_05 .9996 .9819 .9999 .9994 .9998 BrEng_05 .9989 .9825 .9980 .9994 .9978 __________________________________ ________

Singapore (cont.) r's for LibQUAL+™ Service Affect Percentile Scores Across Years for American English ______________________________ ____________ Sample/ Year______________ Variable 2001 2003 2004 2005 ____________________________________________ n 16,918 93,413 24,980 61,991 v 9 9 9 9 2001 1.0000 2003 .9988 1.0000 2004 .9989 .9991 1.0000 2005 .9989 .9994 .9993 1.0000

Stunning Stability of User Desires 2008 article in Library Quarterly

LibQUAL® Resources LibQUAL+® Website: http://old.libqual.org Publications: http://old.libqual.org/publications Events and Training: http://old.libqual.org/events LibQUAL® Bibliography: http://www.coe.tamu.edu/~bthompson/servqbib LibQUAL+® Procedures Manual: http://old.libqual.org/Information/Manual/index.cfm