TM Project web site www.arl.org/libqual/ 2002 Results Colleen Cook Fred Heath April 2, 2003 Texas Library Association Houston :

Slides:



Advertisements
Similar presentations
The LibQual+ CUL Assessment Working Group Jeff Carroll Joanna DiPasquale Joel Fine Andy Moore Nick Patterson Jennifer Rutner Chengzhi Wang January.
Advertisements

Bound for Disappointment Faculty and Journals at Research Institutions Jim Self University of Virginia Library USA 7 th Northumbria Conference Spier, South.
Listening To Our Users Queen’s 2010
Dr. Fred Heath, Vice Provost of General Libraries
1 Wymagania informacyjne uzytkownikow bibliotek akademickich 21 wieku Maria Anna Jankowska University of Idaho Library Biblioteki XXI wieku. Czy przetrwamy?
TM Project web site Invited Address October, 2004 South Africa.
Glasgow, Scottland May 24, 2010 ITEM SAMPLING IN SERVICE QUALITY ASSESSMENT SURVEYS TO IMPROVE RESPONSE RATES AND REDUCE RESPONDENT BURDEN: THE “LibQUAL+®
Asia Pacific Conference on Library & Information Education and Practice (A-LIEP) Nanyang Technological University, Singapore April 4, 2006 Bruce Thompson.
Project URL – TM LibQUAL+ ™ : An Overview CASLIN The Czech Republic June, 2006 Presented by: Bruce Thompson
TM Project web site Quantitative Background for LibQUAL+ for LibQUAL+  A Total Market Survey Colleen Cook Bruce Thompson January.
Project web site – TM Ottawa, Canada June 14, 2006 Presented by: Dr. Colleen Cook, Dean Texas A&M University Quantitative and Qualitative.
An Introduction to LibQUAL+™ New Ways of Listening to Users Washington, DC November 5, 2005 Martha Kyrillidou Amy Hoseth Jonathan Sousa old.libqual.org.
LibQUAL + ™ Data Summary An overview of the results of the LibQUAL+™ 2003 survey with comparisons to the 2001 survey.
Project web site: old.libqual.org LibQUAL+™ from a Technological Perspective: A Scalable Web-Survey Protocol across Libraries Spring 2003 CNI Task Force.
Project URL – TM An Introduction to LibQUAL+™ Amy Hoseth Massachusetts LSTA Orientation Meeting Boston, MA October 21, 2005.
Reliability and Validity of 2004 LibQUAL+™ Scores for Different Language Translations Martha Kyrillidou Colleen Cook Bruce Thompson ALA Annual Conference.
 Large-scale, web-based, user-centered assessment of library service effectiveness across multiple universities.  Co-developed by ARL and Texas A&M University,
Old.libqual.org fairytale A fairytale about “ 22 items and a box ” presented by Martha Kyrillidou January 2004 Glasgow, UK.
New Ways of Listening To Our Users: LibQUAL+ Queen’s.
Charting Library Service Quality Sheri Downer Auburn University Libraries.
How to participate in LibQUAL+ and effectively utilise the data.
Data Summary July 27, Dealing with Perceptions! Used to quantifiable quality (collection size, # of journals, etc.) Survey of opinions or perceptions.
LibQual 2013 Concordia University Montréal, Québec.
Project URL – TM LibQUAL+ ™ Introduction Seattle / London January, 2007 Presented by: Colleen Cook Bruce Thompson.
ARL Statistics and Measurement Library Assessment Thessaloniki, Greece June 13-15, 2005 Brinley Franklin, University of Connecticut Martha.
Frank Haulgren Collection Services Manager & Assessment Coordinator Western Libraries Lite 2010 Survey Results.
Library Quality Assessment NCES Summer Data Conference July 25, 2002 Martha Kyrillidou, Julia Blixrud, Consuella Askew Waller Project web site
Testing the LibQUAL+ Survey Instrument James Shedlock, AMLS, Dir. Linda Walton, MLS, Assoc. Dir. Galter Health Sciences Library Northwestern University.
LibQUAL+™ Origins, Design, Interpretation La Calidad en las Bibliotecas Conferencia Palma de Mallorca January 2005 Fred Heath Vice Provost and Director,
January 17, 2005 Brinley Franklin Vice Provost, University Libraries University of Connecticut Libraries LibQual+™ Management Information.
LibQUAL+ ® : An Introduction Bern, Switzerland July 9, 2007 PRESENTED BY: Martha Kyrillidou Association of Research Libraries old.libqual.org.
TM Project web site: Colleen Cook Bruce Thompson Boston, U.S. Shrivenham, U.K. January, 2005 “ 22 Items and a Box ” Qualitative.
Project URL – TM Score Norms 17 th Greek Academic Libraries Conference 24 September, 2008 Presented by: Bruce Thompson, M. Kyrillidou.
Service priority alignment in Association of Research Libraries (ARL) member libraries Damon Jaggars & Shanna Smith University of Texas at Austin Jocelyn.
The Library Summit: the University of Texas Libraries Experience Jocelyn Duffy ALA Midwinter 2005 Boston, Massachusetts January.
TM Project web site Report Meeting Colleen Cook Bruce Thompson Martha Kyrillidou July 28, 2003 Durham United Kingdom.
EDUCAUSE 2002 Service Quality Assessment in a Digital Library Environment Service Quality Assessment in a Digital Library Environment Atlanta, Georgia.
LibQUAL+™, Libraries, and Google™ CNI Spring 2005 Task Force Meeting Washington, DC 4/4/2005 Martha Kyrillidou Fred Heath Jonathan D. Sousa old.libqual.org.
TM Project web site: Colleen Cook Bruce Thompson Martha Kyrillidou Glasgow January 19-20, 2004 “ 22 Items and a Box ” Qualitative.
LibQUAL+™ Introduction
TM Project web site: Presented by: Colleen Cook Bruce Thompson ALA Mid-Winter January, 2006 “ 22 Items and a Box ” Qualitative.
Online Northwest Twentieth Annual Conference Corvallis, Oregon February 28, 2003 Julia Blixrud, ARL Director of Information Services LibQUAL+ TM: An Innovative,
Measuring Library Services Initiative to Recruit a Diverse Workforce Leadership Symposium San Antonio, TX January 21, 2006 Martha Kyrillidou.
Old.libqual.org A fairytale about “ 22 items and a box ” presented by Martha Kyrillidou May 24, 2004 Medical Library Association Washington, DC.
Project web site old.libqual.org TM November 12, 2002 San Francisco, CA Colleen Cook Bruce Thompson AAHSL Spring 2002 Results Results.
Re-Visioning the Future of University Libraries and Archives through LIBQUAL+ Cynthia Akers Associate Professor and Assessment Coordinator ESU Libraries.
How to participate in LibQUAL+ and effectively utilise the data.
1 Project web site Evaluating Library Service Quality: Use of LibQUAL+  IATUL Kansas City, MO June 2002 Julia Blixrud Association.
Charting Library Service Quality Sheri Downer Auburn University Libraries.
LibQUAL Survey Results Customer Satisfaction Survey Spring 2005 Sidney Silverman Library Bergen Community College Analysis and Presentation by Mark Thompson,
TM Project web site: Colleen Cook Bruce Thompson Seattle / London January, 2007 “ 22 Items and a Box ” Qualitative Grounding :
TM Project web site: Colleen Cook Bruce Thompson Auckland, NZ April 5, 2005 “ 22 Items and a Box ” Qualitative Grounding :
LibQual+ Spring 2008 results and recommendations Library Assessment Working Group 11/19/2008 Library Faculty Meeting.
Project URL – TM QUANTITATIVE EVIDENCE Auckland, NZ April 5, 2005 Presented by: Colleen Cook Bruce Thompson.
Old.libqual.org LibQUAL+ TM : A Total Market Survey Duane Webster ARL Executive Director January 2004 San Diego, CA.
TM Project web site New Ways of Listening to Users: Colleen Cook Bruce Thompson Consuella Askew Waller April 10-13, 2003 ACRL 11 th.
“22 items and a box” Martha Kyrillidou Association of Research Libraries NELA Boston, MA September 28, 2004 old.libqual.org.
Our 2005 Survey Results. “….only customers judge quality; all other judgments are essentially irrelevant” Delivering Quality Service : Balancing Customer.
Listening to the Customer: Using Assessment Results to Make a Difference.
Project URL – TM ® LibQUAL+ ® : An Overview The Third Lodz [Poland] Library Conference Technical University of Lodz June,
Project URL – TM LibQUAL+ ™ Introduction Martha Kyrillidou Bruce Thompson National Library for Health London, UK August 26, 2005.
BY DR. M. MASOOM RAZA  AND ABDUS SAMIM
Results and Comparisons for SCONUL
International Results Meeting LibQUAL+TM
What Do Users Think of Us? Mining Three Rounds of Cornell LibQUAL Data
Score Norms 17th Greek Academic Libraries Conference
Service Quality Assessment in a Digital Library Environment
Qualitative Grounding
LibQUAL+TM : A Total Market Survey
QUANTITATIVE EVIDENCE
Presentation transcript:

TM Project web site Results Colleen Cook Fred Heath April 2, 2003 Texas Library Association Houston :

 98% agree with statement, “My … library contains information from credible and known sources” Note. Digital Library Federation and Council on Library and Information Resources. (2002). Dimensions and Use of the Scholarly Information Environment. Library Remains a Credible Resource

 15.7% agreed with the statement “The Internet has not changed the way I use the library” Note. Digital Library Federation and Council on Library and Information Resources. (2002). Dimensions and Use of the Scholarly Information Environment. Information Seeking Behaviors are Changing

 92.7% find out about e-journals on-line  21.7% report using print resources to find  16.5% would ask a person for assistance  Only 2.5% would prefer to ask a librarian Note. Digital Library Federation and Council on Library and Information Resources. (2002). Dimensions and Use of the Scholarly Information Environment. Finding Electronic Journals for Research

 Only 13.9% ask a librarian  Only 3.2% consider consulting a librarian a preferred way of identifying information Note. Digital Library Federation and Council on Library and Information Resources. (2002). Dimensions and Use of the Scholarly Information Environment. Finding Print Journals for Research

Total Circulation Note. M. Kyrillidou and M. Young. (2002). ARL Statistics Washington, D.C.: ARL, p.8.

In House Use of Materials Note. M. Kyrillidou and M. Young. (2002). ARL Statistics Washington, D.C.: ARL, p.8.

Reference Transactions Note. M. Kyrillidou and M. Young. (2002). ARL Statistics Washington, D.C.: ARL, p.8.

The Imperative for our Research In an age of accountability, there is a pressing need for an effective and practical process to evaluate and compare research libraries. In the aggregate, among the 124 Association of Research Libraries (ARL) alone, over $2.8 billion dollars were expended in 1999/2000 to satisfy the library and information needs of the research constituencies in North America (Kyrillidou & Young, 2001, p. 5).

LibQUAL+  Description LibQUAL+  is a research and development project undertaken to define and measure library service quality across institutions and to create useful quality- assessment tools for local planning.

u SERVQUAL dimensions served as a priori theoretical starting point LibQUAL+  Process

Relationships: Perceptions, Service Quality and Satisfaction ….only customers judge quality; all other judgments are essentially irrelevant” Zeithaml, Parasuraman, Berry. (1999). Delivering quality service. NY: The Free Press.

LibQUAL+  Resources uAn ARL/Texas A&M University joint developmental effort based on SERVQUAL uLibQUAL+  initially supported by a 3-year grant from the U.S. Department of Education’s Fund for the Improvement of Post-Secondary Education (FIPSE) uInitial project established an expert team, regrounded concepts, and designed survey methodology uSurvey conducted at over 200 libraries resulting in a data base of over 78,000 user responses

LibQUAL+  Project Goals uEstablishment of a library service quality assessment program at ARL uDevelopment of web-based tools for assessing library service quality uDevelopment of mechanisms and protocols for evaluating libraries uIdentification of best practices in providing library service

LibQUAL+  Participants Spring 2000 Year 1 12 Participants For More Information about Participants: Visit the LibQUAL+  web site. Year 2 43 Participants Year Participants 316 Participants Year 4 Spring 2001 Spring 2002 Spring 2003

LibQUAL+  Fundamental Contributions to the Measurement of Effective Delivery of Library Services uShift the focus of assessment from mechanical expenditure-driven metrics to user-centered measures of quality uRe-ground gap theory for the library sector, especially academic libraries uGrounded questions yield data of sufficient granularity to be of value at the local level uDetermine the degree to which information derived from local data can be generalized, providing much needed “best practices” information uDemonstrate the efficacy of large-scale administration of user-centered assessment transparently across the web uMakes little demand of local resources and expertise

Multiple Methods of Listening to Customers  Transactional surveys*  Mystery shopping  New, declining, and lost-customer surveys  Focus group interviews  Customer advisory panels  Service reviews  Customer complaint, comment, and inquiry capture  Total market surveys*  Employee field reporting  Employee surveys  Service operating data capture *A SERVQUAL-type instrument is most suitable for these methods Note. A. Parasuraman. The SERVQUAL Model: Its Evolution And Current Status. (2000). Paper presented at ARL Symposium on Measuring Service Quality, Washington, D.C.

76 Interviews Conducted  York University  University of Arizona  Arizona State  University of Connecticut  University of Houston  University of Kansas  University of Minnesota  University of Pennsylvania  University of Washington  Smithsonian  Northwestern Medical

LoadedPT:P1:01xxxxxxxxxxxxxx.txt,S:\Admin\Colleen\ServQual Interviews\TEXT Only\01xxxxxxxxx.txt (redirected: c:\zz\atlasti\fred

Dimensions of Library Service Quality

Affect of Service uAbsorbed several of the original SERVQUAL questions measuring Responsiveness, Assurance and Empathy uIn the current analysis also includes Reliability uAll in all: the Human Dimension of Service Quality

Affect of Service “I want to be treated with respect. I want you to be courteous, to look like you know what you are doing and enjoy what you are doing. … Don’t get into personal conversations when I am at the desk.” Faculty member

Reliability “You put a search on a book and it’s just gone; it’s not reacquired. … There’s more of a problem of lost books, of books that are gone and nobody knows why and nobody’s doing anything about it.” Faculty member

Service as Performance “…as users have metamorphosed from penitents to self-reliant information surfers, the rules of engagement have changed. Service is not something dispensed; rather, it is enacted as an elaborate cultural ritual, the texture and fabric of which is changing in front of us. Service may now embody multiple overlays of meaning, many too dense for anything but an anthropological fieldwork study to uncover” (Lincoln, p. 15).

Access to Information uCovers scope, timeliness, and convenience of access uAdequacy of collections uComprehensiveness, quality, and depth of information resources uAll in all: required information delivered in the format, location, and time of choice

Comprehensive Collections “I think one of the things I love about academic life in the United States is that as a culture…, we tend to appreciate the extraordinary importance of libraries in the life of the mind.” Faculty member

Ubiquity of Access “Over time my own library use has become increasingly electronic. So that the amount of time I actually spend in the library is getting smaller and the amount of time I spend at my desk on the web … is increasing.” Faculty member

Cultural Perspective - Collections “In the physical [vs. virtual] reality, ‘texture’ has become important. Density of collections becomes important, and, if collections are not complete, users want to know where they can find missing volumes, journal articles, and/or how swiftly interlibrary loan will work for them” (Lincoln, p. 11).

Personal Control uCovers ease of navigation, convenience, and support services uPersonal control of the information universe in general and web navigation in particular uAll in all: How users want to interact with the modern library

Personal Control “By habit, I usually try to be self-sufficient. And I’ve found that I am actually fairly proficient. I usually find what I’m looking for eventually. So I personally tend to ask a librarian only as a last resort.” Graduate student

Personal Control “…first of all, I would turn to the best search engines that are out there. That’s not a person so much as an entity. In this sense, librarians are search engines [ just ] with a different interface.” Faculty member

Cultural Perspective – Self-reliance “If Foucault is correct that we in the West live in surveilled societies, then what function does self- reliance serve? …the library user who wishes to navigate resources with as little help as possible – seeks a kind of privacy from the surveillance of librarian help …Having found the relative anonymity of cyberspace and a virtual world, this self-reliant user now seeks the same independence and lack of surveillance in the text-based and digitized universe of information resources known as the library” (Lincoln, p. 12).

Library as Place uCovers usefulness of space, symbolic value, and refuge for work and study uTranscends the SERVQUAL dimension of Tangibles to include the idea of the library as the campus center of intellectual activity uAll in all: As long as physical facilities are adequate, library as place may not be an issue

Library as Place “I guess you’d call them satisfiers. As long as they are not negatives, they won’t be much of a factor. If they are negatives, they are a big factor.” Faculty member

Library as Place “One of the cherished rituals is going up the steps and through the gorgeous doors of the library and heading up to the fifth floor to my study. … I have my books and I have six million volumes downstairs that are readily available to me in an open stack library.” Faculty member

Library as Place “The poorer your situation, the more you need the public spaces to work in. When I was an undergraduate, I spent most of my time in the library, just using it as a study space.” Faculty member

Cultural Perspective – Library as Place  “…It’s beyond the ease [with] which you can find information, just because the library experience is something like Greece or Athens…” (Undergraduate)  “…the library needs to welcome them in. It needs to make them feel like this is a place where they can be in almost a haven, a refuge” (Business professor)  “writing an undergraduate thesis with this big dome over his head…he felt really like a scholar” (Linguistics professor)  Writing a dissertation in a particular library for another scholar “was an emotional experience”

Survey Design Considerations uThree scales exploring optimal, minimal, and actual service levels uTwenty-five questions clustered around four dimensions uSurvey covers a sample of targeted user population uData illuminates gap between desired level of service and perception of experience

LibQUAL+  Core Questions Y1 _____________________________________________________________________________ Factor_______ _ No. I II III IVItem Core _____________________________________________________________________________ Willingness to help users Giving users individual attention Employees deal with users caring fashion Employees who are consistently courteous Employees have knowledge answer questions Employees understand needs of users Readiness to respond to users' questions Employees who instill confidence in users Dependability handling service problems A haven for quiet and solitude A meditative place A contemplative environment Space that facilitates quiet study A place for reflection and creativity * website enabling me locate info on my own * elec resources accessible home or office * access tools allow me find on my own Modern equip me easily access info I need * info easily accessible for independent use Convenient access to library collections Comprehensive print collections Complete runs of journal titles Interdisciplinary library needs addressed Timely document delivery/interlibrary loan Convenient business hours ________________________________________________________________

Sample Survey Spring 2002

Sample Survey… continued

LibQUAL+  2002 Iteration u42 — ARL Libraries u35 — Health Sciences Libraries u36 — State Colleges & Universities (excluding ARL) u34 — Private Colleges & Universities (excluding ARL) u15 — Community Colleges u 2 — Special & Public Libraries (Smithsonian & NYPL)

Respondents by Age (Excludes NYPL) Note: LibQUAL+  Spring 2002 Aggregate Survey Results. (2002). vol. 1, p. 19

Respondents by Sex Note: LibQUAL+  Spring 2002 Aggregate Survey Results. (2002). vol. 1, p. 20

4-Year Institution Respondent by Discipline (n=54,073) Note: LibQUAL+  Spring 2002 Aggregate Survey Results. (2002). Vol. 1, p. 38

Aggregate Dimension Means (n=70,445) DimensionMinimumDesiredPerceivedSA Gap Access to Information Affect of Service Library as Place Personal Control Note: LibQUAL+  Spring 2002 Aggregate Survey Results. (2002). vol. 1, p. 24

Mean Perceived Scores 2001/2002 Trend (n=34)

TAMU Faculty Item Summary Note: LibQUAL+  Spring 2002 Survey Results. (2002). vol. 2, p. 40

ARL Faculty Item Summary Note: LibQUAL+  Spring 2002 Survey Results - ARL. (2002). Vol. 5, p. 46

Institutional Norms for Perceived Means on 25 Core Questions Note: Thompson, B. LibQUAL+  Spring 2002 Selected Norms, (2002).

ARL Top (.46) ARL Other 6.74 (.27) Private Colleges 6.90 (.49) State Colleges & Universities 6.38 (.30) Community Colleges 7.26 (.55) Overall Mean Scores and Service Adequacy Gap Scores By Cohort Group 2002 LibQUAL+  Iteration (n=162) AAHSL 7.07 (.56)

LibQUAL+ TM Related Documents LibQUAL+ TM Web Site LibQUAL+ TM Bibliography woof