TM Project web site: Bruce Thompson Colleen Cook Martha Kyrillidou Glasgow January 19-20, 2004 Quantitative Grounding “22 Items.

Slides:



Advertisements
Similar presentations
R LibQUAL+: A Measurement Tool for Special Libraries? Susan Scheiberg Assistant Director, Library RAND Corporation David Shumaker Manager, Information.
Advertisements

Jacqui Dowd Introduction to LibQUAL+ University of Westminster 5 th February 2010 LibQUAL+ v LibQUAL Lite at the University of Glasgow.
Reading LibQUAL+ Results The University of Chicago Library LibQUAL+™ Survey Supervisors’ Meeting June 16, 2004.
Listening To Our Users Queen’s 2010
Library Assessment Conference: Building Effective, Sustainable, Practical Assessment August 5, 2008 LibQUAL+ Lite: A New Model for Conducting Service Quality.
Comparisons of Library Users Expectations and Perceptions Across North American, European, African, Asian and Australian Libraries Presented by: Martha.
Assessment with LibQUAL+ ™ at the University of Vermont Vermont Library Association College and Special Libraries Section Conference April 7, 2006 Selene.
Old.libqual.org LibQUAL Canada Results Highlights Martha Kyrillidou Gary Roebuck Association of Research Libraries October, 2007 Ottawa, Canada.
TM Project web site Invited Address October, 2004 South Africa.
Glasgow, Scottland May 24, 2010 ITEM SAMPLING IN SERVICE QUALITY ASSESSMENT SURVEYS TO IMPROVE RESPONSE RATES AND REDUCE RESPONDENT BURDEN: THE “LibQUAL+®
Asia Pacific Conference on Library & Information Education and Practice (A-LIEP) Nanyang Technological University, Singapore April 4, 2006 Bruce Thompson.
Project URL – TM LibQUAL+ ™ : An Overview CASLIN The Czech Republic June, 2006 Presented by: Bruce Thompson
LibQUAL+ ® Survey Introduction Presented by: Martha Kyrillidou Association of Research Libraries LibQUAL+® and Beyond The University of.
TM Project web site Quantitative Background for LibQUAL+ for LibQUAL+  A Total Market Survey Colleen Cook Bruce Thompson January.
Project web site – TM Ottawa, Canada June 14, 2006 Presented by: Dr. Colleen Cook, Dean Texas A&M University Quantitative and Qualitative.
LibQUAL+ ® Survey Results Presented by: Selena Killick ARL/SCONUL LibQUAL+ Administrator Cranfield University Introduction to LibQUAL+
The votes are in! What next? Introduction to LibQUAL+ Workshop University of Westminster, London 21st January 2008 Selena Killick Association of Research.
Reliability and Validity of 2004 LibQUAL+™ Scores for Different Language Translations Martha Kyrillidou Colleen Cook Bruce Thompson ALA Annual Conference.
TEXAS A&M UNIVERSITY LibQUAL+ ® Training Practical Lessons Drawn From Ten Years of Library Service Quality in a Research Library ALA Boston Midwinter 2010.
New Ways of Listening To Our Users: LibQUAL+ Queen’s.
Project URL – TM LibQUAL+ ™ Introduction Seattle / London January, 2007 Presented by: Colleen Cook Bruce Thompson.
Frank Haulgren Collection Services Manager & Assessment Coordinator Western Libraries Lite 2010 Survey Results.
LibQUAL+ ® Survey Results American Library Association (ALA) Midwinter Meeting Philadelphia, PA January 14, 2008 Martha Kyrillidou, Director Statistics.
Testing the LibQUAL+ Survey Instrument James Shedlock, AMLS, Dir. Linda Walton, MLS, Assoc. Dir. Galter Health Sciences Library Northwestern University.
Project URL – TM QUANTITATIVE EVIDENCE Philadelphia January, 2008 Presented by: Bruce Thompson.
LibQUAL+™ Origins, Design, Interpretation La Calidad en las Bibliotecas Conferencia Palma de Mallorca January 2005 Fred Heath Vice Provost and Director,
Old.libqual.org LibQUAL+ ® and Beyond: Using Results Effectively University of York Heslington, York, UK June 23, 2008 Martha Kyrillidou Director, Statistics.
Project URL – TM Score Norms 17 th Greek Academic Libraries Conference 24 September, 2008 Presented by: Bruce Thompson, M. Kyrillidou.
LibQUAL+™ Process Overview Using the Web as a Management Tool Martha Kyrillidou LibQUAL+™ Canada Meeting Ottawa, Canada June 14, 2006 old.libqual.org.
TM Project web site Report Meeting Colleen Cook Bruce Thompson Martha Kyrillidou July 28, 2003 Durham United Kingdom.
LibQUAL+™ Introduction
TM Project web site: Presented by: Colleen Cook Bruce Thompson ALA Mid-Winter January, 2006 “ 22 Items and a Box ” Qualitative.
LibQUAL+™ Process Management: Using the Web as a Management Tool Amy Hoseth Massachusetts LSTA Orientation Meeting Boston, MA October 21, 2005 old.libqual.org.
LibQUAL+ ® Survey Introduction Presented by: Martha Kyrillidou Association of Research Libraries American Library Association Midwinter.
Old.libqual.org A fairytale about “ 22 items and a box ” presented by Martha Kyrillidou May 24, 2004 Medical Library Association Washington, DC.
Project web site old.libqual.org TM November 12, 2002 San Francisco, CA Colleen Cook Bruce Thompson AAHSL Spring 2002 Results Results.
LibQUAL+™ Around and About Library Assessment Thessaloniki, Greece June 13-15, 2005 Martha Kyrillidou Director, Statistics and Measurement Program Association.
TEXAS A&M UNIVERSITY LibQUAL+ ® Training Practical Lessons Drawn From Ten Years of Library Service Quality in a Research Library ALA Denver Midwinter 2009.
1 Project web site Evaluating Library Service Quality: Use of LibQUAL+  IATUL Kansas City, MO June 2002 Julia Blixrud Association.
LibQUAL+ ® Survey Introduction Philadelphia, PA January 14, 2008 Presented by: Martha Kyrillidou Director, Statistics and Service Quality Programs Association.
LibQUAL Survey Results Customer Satisfaction Survey Spring 2005 Sidney Silverman Library Bergen Community College Analysis and Presentation by Mark Thompson,
Jacqui Dowd LibQUAL+ and Beyond: Using Results Effectively University of Glasgow 24 th May 2010 LibQUAL+ & LibQUAL Lite at the University of Glasgow.
TM Project web site: Colleen Cook Bruce Thompson Seattle / London January, 2007 “ 22 Items and a Box ” Qualitative Grounding :
Project URL – TM QUANTITATIVE EVIDENCE Washington, DC June, 2007 Presented by: Colleen Cook.
TM Project web site Report Meeting Colleen Cook Bruce Thompson Martha Kyrillidou Jonathan Sousa June 21, 2003 ALA Toronto CANADA.
Project URL – TM QUANTITATIVE EVIDENCE Auckland, NZ April 5, 2005 Presented by: Colleen Cook Bruce Thompson.
Old.libqual.org LibQUAL+ TM : A Total Market Survey Duane Webster ARL Executive Director January 2004 San Diego, CA.
TM Project web site New Ways of Listening to Users: Colleen Cook Bruce Thompson Consuella Askew Waller April 10-13, 2003 ACRL 11 th.
Considering the Integration of Qualitative and Quantitative A Test of AAHSL Stats and LibQUAL+ Data Doug Joubert, Lyn Dennison and Tamera Lee Medical College.
“22 items and a box” Martha Kyrillidou Association of Research Libraries NELA Boston, MA September 28, 2004 old.libqual.org.
Your LibQUAL+ ® Community: A Results Meeting American Library Association (ALA) Annual Conference Washington, DC June 25, 2007 Martha Kyrillidou, Director.
LibQUAL+ ® Survey Results Presented by: Martha Kyrillidou Senior Director, Statistics and Service Quality Programs Association of Research.
Project URL – TM ® LibQUAL+ ® : An Overview The Third Lodz [Poland] Library Conference Technical University of Lodz June,
Project URL – TM LibQUAL+ ™ Introduction Martha Kyrillidou Bruce Thompson National Library for Health London, UK August 26, 2005.
How to participate in LibQUAL+ and effectively utilise the data.
QUANTITATIVE EVIDENCE
How to participate LibQUAL+
Martha Kyrillidou, Director, ARL Bruce Thompson, Texas A&M
Score Norms 17th Greek Academic Libraries Conference
Reading Radar Charts.
November 12, 2002 San Francisco, CA
Assessment with LibQUAL+ ™ at the University of Vermont
QUANTITATIVE EVIDENCE
LibQUAL+TM : A Total Market Survey
LibQUAL+® Survey Results
QUANTITATIVE EVIDENCE
QUANTITATIVE EVIDENCE
QUANTITATIVE EVIDENCE
2004 Overview LibQUAL+™ Results Meetings
LibQUAL+™: Brief Overview
Presentation transcript:

TM Project web site: Bruce Thompson Colleen Cook Martha Kyrillidou Glasgow January 19-20, 2004 Quantitative Grounding “22 Items and a Box” Quantitative Grounding “22 Items and a Box” :

Score Integrity uReliability uValidity

By Language ServiceInfo.Lib as Group n AffectControlPlaceTOTAL American (all)59, British (all) 6, French (all) alpha By Language

By University Type ServiceInfo.Lib as Group n AffectControlPlaceTOTAL Comm Colleges 4, yr Not ARL36, yr, ARL14, Acad Health 3, alpha by University Type

By Consortium ServiceInfo.Lib as Group n AffectControlPlaceTOTAL AAHSL 3, OhioLINK 7, Oberlin 2, Merlin NY3R Coll/Uni13, SCONUL 6, Alabama 1, alpha by Consortium

n = 59,318; α =.9593 "Corrected" Item ‑ alpha Totalif Item ItemCorrelationDeleted SA01APER SA04APER SA07APER SA10APER SA12APER SA15APER SA17APER SA20APER SA23APER

n = 59,318; α =.9593 "Corrected" Item ‑ alpha Totalif Item ItemCorrelationDeleted PC02APER PC11APER PC16APER PC21APER PC25APER IA03APER IA14APER IA18APER

n = 59,318; α =.9593 "Corrected" Item ‑ alpha Totalif Item ItemCorrelationDeleted LP05APER LP09APER LP13APER LP19APER LP24APER

Service Affect (n = 71,170 English) SA20APER SA07APER SA17APER SA04APER SA15APER SA23APER SA01APER SA12APER SA10APER Service Affect

Library as Place Library as Place (n = 71,170 English) LP13APER LP05APER LP09APER LP24APER LP19APER

Information Control Information Control (n = 71,170 English) IA18APER PC11APER IA03APER PC25APER PC21APER PC02APER PC16APER IA14APER

2. Validity Correlations Validity Correlations Serv_AffInfo_ConLibPlaceTOTALper Serv_Aff Info_Con LibPlace TOTALper ESAT_TOT EOUT_TOT

Mean Perceived Scores 2001/2002 Trend (n=34)

The Challenge of Score Use u Securing information that contributes meaningfully to planning and improvement efforts at a local level u Providing analytical frameworks that institutional staff can apply without extensive training or assistance u Helping decision-makers understand success of investments u Finding useful inter-institutional comparisons

Two Interpretation Frameworks uZone of Tolerance uScore Norms

1. Zone of Tolerance uThe distance between minimally acceptable and desired service quality ratings uPerception ratings ideally fall within the Zone of Tolerance

Faculty Dimension Summary Note: LibQUAL+  Spring 2002 Survey Results - TAMU. (2002). Vol. 2, p. 42 Average Rating Access to Information Affect of Service Library as Place Personal Control Perceived Range of Minimum to Desired Range of Minimum to Perceived (“Gap”)

7 Institution Types 1.Community Colleges 2.Health Sciences 3.Military 4.Colleges/Universities 5.State/Publics 6.United Kingdom 7.French Canadian

LibQUAL+™ 2003 Summary Colleges or Universities

LibQUAL+™ 2003 Colleges or Universities – Dimension Means

LibQUAL+™ 2003 Colleges or Universities – Library Use

LibQUAL+™ 2003 Colleges or Universities – Core Questions

LibQUAL+™ 2003 Summary Community Colleges

LibQUAL+™ 2003 Community Colleges – Dimension Means

LibQUAL+™ 2003 Community Colleges – Library Use

LibQUAL+™ 2003 Summary Academic Health Sciences

LibQUAL+™ 2003 Health Sciences – Dimension Means

LibQUAL+™ 2003 Health Sciences – Library Use

LibQUAL+™ 2003 Summary Military Institutions

LibQUAL+™ 2003 Military Institutions – Dimension Means

LibQUAL+™ 2003 Military Institutions – Library Use

LibQUAL+™ 2003 Summary State and Public Institutions

LibQUAL+™ 2003 State and Public – Dimension Means

LibQUAL+™ 2003 State and Public – Library Use

LibQUAL+™ 2003 Summary United Kingdom

LibQUAL+™ 2003 United Kingdom – Dimension Means

LibQUAL+™ 2003 United Kingdom – Library Use

LibQUAL+™ 2003 Summary French Canadian

LibQUAL+™ 2003 French Canadian – Dimension Means

LibQUAL+™ 2003 French Canadian – Library Use

2. Score Norms uNorm Conversion Tables facilitate the interpretation of observed scores using norms created for a large and representative sample. uLibQUAL+  norms have been created at both the individual and institutional level

Institutional Norms for Perceived Means on 25 Core Questions Note: Thompson, B. LibQUAL+  Spring 2002 Selected Norms, (2002).

Response Rates 1. It’s representativesness that counts more than the response rate!

Response Rates 2. We only know the lower bound (or minimum) estimate of the response rate, because we don’t know the correct denominator.

Response Rate Contexts 1. Response rates are higher for action-oriented surveys, which are not relevant or practical for total market surveys.

Response Rate Contexts 2. Survey saturation is tending to lower typical response rates over time.

2005 and Beyond 1.Matrix Sampling / Short Forms 2.Software Used for Local/Consortial Assessments 3.“Action Snapshots”

LibQUAL+  Related Documents LibQUAL+  LibQUAL+  Web Site LibQUAL+  LibQUAL+  Bibliography Survey Participants Procedures Manual