Library Assessment Conference 2008 1 Evaluation Metrics for Libraries: Expanding the Conceptual Context Panel Discussion Neal Kaske Joe Matthews Peter.

Slides:



Advertisements
Similar presentations
Fall 2003, Keith Curry Lance Conducts Study of School Libraries in Illinois. 657 Schools of all grade levels, enrollment ranges, and regions participated.
Advertisements

E-Metrics: Which Ones?. Outline comparison of international e-metrics projects survey results from NZ and Australia on e-metrics practice suggestions.
McGraw-Hill/Irwin Copyright © 2012 by The McGraw-Hill Companies, Inc. All rights reserved. Chapter 34 Education.
1 Mateja Bizilj PEMPAL BCOP KEY CONCEPTS AND APPROACHES TO PROGRAMS AND PERFORMANCE Tbilisi, June 28, 2007.
Using statistics to enhance library performance, an example Anja Smit.
Welcome The Phoenix Course Development Programme Aviation Management Andrew Turner Learning and Development.
Dr. Roswitha Poll Münster Benchmarking with performance indicators and Balanced Scorecard.
Critical Evaluation (Multimedia) Peter Chalk FoC Away Day
Unit Name Goes Here Data This, Data That Using ISO to Develop Performance Indicators for Library Wide Planning & Data Comparison Presentation for.
Assessment is about Quality AMICAL CONFERENCE – MAY 2008 Ann Ferren, Provost, American University in Bulgaria.
Reading Rodski: User Surveys Revisited The 25 th IATUL Annual Conference Krakow 2004 Dr. Grace Saw University of Queensland Cybrary Brisbane, Australia.
UA Metrics University of Alaska Board of Regents Meeting December 6-7,
Leading the Way : Access. Success. Impact. Board of Governors Summit August 9, 2013.
Universiteit Maastricht Standards and Distance Education Peter A.J. Bouhuijs Professor in Health Science Education.
Combining Circulation And Reference Desks Into a Single Service Point
BIX - The Library Index Roswitha Poll Chair of ISO TC 46 SC 8: Quality – Statistics and performance evaluation Roswitha Poll Chair of ISO TC 46 SC 8: Quality.
CONTEXT Evaluation of Information Services. Topics of Day Mission Vision Goals and Objectives Standards Types of Metrics  Input  Output  Performance.
California State University Northridge Oviatt Library Service Assessment, Spring 2007 Summary Results Kathy Dabbour September 27, 2007.
Presenting the Socioeconomic Benefits of Suffolk County Community College.
Library Statistics: what’s needed and what’s new Lynn Copeland Simon Fraser University Library Thurs. March 15, 2007 Vancouver Ass’n of Law Libraries.
Presented by Beverly Choltco-Devlin Reference and Electronic Resources Consultant Mid-York Library System September 25, 2009 REVVED UP FOR REFERENCE CONFERENCE.
Evaluation of Information Sources and Reference Services Dr. Dania Bilal IS 530 Fall 2006.
Performance Indicators Business Management AOS 1: LSOs in Context.
Helping Non-Profit Organizations Understand The Value of Their Work Copyright Postrain Consulting Services 2009.
Guide to Evidence for WASC Accreditation Dr. Robert Gabriner City College of San Francisco Student Learning Outcomes Workshop Strand 3.
Measures that matter: Designing and developing your own Balanced Scorecard Karin de Jager & Jim Self 7th Northumbria International Conference on Performance.
Jacqui Dowd SCONUL Workshop University of Westminster 17 th November 2009 Performance Measures & Metrics at University of Glasgow Library.
Sub-theme Three The Self-Assessment Process and Embedding QA into the Life of an Institution by Terry Miosi, Ph.D. UAE Qualification Framework Project.
STUDENT-CENTERED VALUE RESEARCH Assessment activities of the UNT Libraries Sian Brannon, Ph.D. Kathleen Murray, Ph.D. UNT Libraries May 2, 2013.
Center for Information and Communication Studies The Link Among Faculty Purposes of Reading, Information Seeking Patterns, Aspects of Use, Value and the.
of Research Libraries Assessing Library Performance: New Measures, Methods, and Models 24 th IATUL Conference 2-5 June 2003 Ankara,
Library Assessment in North America Stephanie Wright, University of Washington Lynda S. White, University of Virginia American Library Association Mid-Winter.
TEMPUS UM_JEP Development of Quality Assurance System in Higher Education - QUASYS Promotion of Quality Assurance System at the University of.
Data Summary July 27, Dealing with Perceptions! Used to quantifiable quality (collection size, # of journals, etc.) Survey of opinions or perceptions.
EVALUATION RESEARCH. Evaluation Research  How do we begin?  What are the different types of evaluation research?  How do these different types fit.
Student Learning Outcome Assessment: A Program’s Perspective Ling Hwey Jeng, Director School of Library and Information Studies June 27,
Evaluation Research and Engineering Education Lesley Jolly For AaeE ERM wiki at
1. 2 The aim of research project to examine ways in which Indonesian academic libraries can be developed in order to assist the higher education sector.
 How do we begin?  What are the different types of evaluation research?  How do these different types fit together?  What purpose do they serve?
Educational Effectiveness Fall Faculty Retreat 2006 Leanne Neilson Halyna Kornuta.
1 Evaluating the Quality of the e-Learning Experience in Higher Education Anne Jelfs and Keir Thorpe, Institute of Educational Technology (IET), The Open.
The Major Steps of a Public Health Evaluation 1. Engage Stakeholders 2. Describe the program 3. Focus on the evaluation design 4. Gather credible evidence.
SU Counting what matters To measure what counts Karin de Jager University of Cape Town October 2004.
ACADEMIC AUDITS Robert L. Moskowitz, Ed. D. Program Evaluation at Community College of Philadelphia Office of Curriculum Development Services.
Forging Forward: Using Evaluation as a Stepping Stone Joe Matthews SLA – San Diego Fall Seminar October 30, 2015.
Anmai University Library Reconstruction Project Team Three
Guide to Evidence for WASC Accreditation Dr. Robert Gabriner City College of San Francisco Student Learning Outcomes.
LibQual+ Spring 2008 results and recommendations Library Assessment Working Group 11/19/2008 Library Faculty Meeting.
Expanding quality distance provision in an integrated post- schooling system Kethamonie Naidoo NADEOSA Conference - 24 June 2014 University of Pretoria.
Assessment and Three Questions: What? Why? How? Peter Hernon.
Chapter 14 Measurement and Evaluation. Chapter Objectives 1.Explain the importance of continuous measurement and evaluation of facility and event organizations.
Educational Effectiveness Assessing WIC Student Learning Outcomes October 2006 Halyna Kornuta.
1 Strategic Management All libraries must look into the future to be able to develop long-term strategies to meet user needs.
Designing Effective Evaluation Strategies for Outreach Programs
Achievement of KAI Targets in Brief (January - March 2014)
Indirect and Direct Evidence
Programme Review Directorate of Quality Promotion QP_DN.
Quantifying the value of our libraries. Are our systems ready?
Assessing Library Performance:
Using Performance Evidence
Programme Review Dhaya Naidoo Director: Quality Promotion
بسم الله الرحمن الرحيم.
مدل زنجیره ای در برنامه های سلامت
Organization of modern academic libraries activities
Evaluation of Library Procedures and Services
Using LibQUAL+® as a Foundation for the Library’s Support of
What is Planning? Start at 9:15—10 minutes to do this. Finish at 9:25.
Library Services and Special Collections - Key Performance Indicators
NEASC Self –Study Appraisal.
Presentation transcript:

Library Assessment Conference Evaluation Metrics for Libraries: Expanding the Conceptual Context Panel Discussion Neal Kaske Joe Matthews Peter Hernon

Library Assessment Conference Types of Metrics Input Output – including economic efficiency Outcome Impact

Library Assessment Conference Typical ViewLibrary Centric Inputs – Example Percentage of total acquisitions expenditure spent on acquisition of electronic library services Outputs – Example Percentage of the population reached by electronic library services Source: EQUINOX, orts/pilist.html orts/pilist.html

Library Assessment Conference Where Does LibQUAL+ Fit in? Service quality Satisfaction Output or Outcome?

Library Assessment Conference Examples of Different Assessment Perspectives LibraryLibrarys Parent Organization Library Customers Accrediting Bodies And so on including government, taxpayers or parents Inputs Outputs Outcomes

Library Assessment Conference Librarys Parent Organization Higher Education Collection and Staff (inputs) Student outcomes (outputs) – Aggregate statistics on groups of students (e.g., graduation rates, retention rates, transfer rates, course and program completion rates, and job placement: employment rates for a graduating class) Student learning outcomes (Development of students over time) What should students learn? How well are they learning it? What evidence do we gather to answer these questions? How do we use that evidence to improve learning Convergence/collaboration (outputs) Other – Affordability

Library Assessment Conference Customers Types – Internal – External External – Present ones low use high use – Never-gained – Lost – No interest

Library Assessment Conference Parent Organization Qualitative indicators – Contributing to retention rate – Successful passage of licensing examinations Getting Your Tuition Moneys Worth from the Library – Sawyer Library, How Can I Get My Tuition Moneys Worth from the Library? (Boston: Suffolk University, 2008), – b/faq.htm#anchor b/faq.htm#anchor13268

Library Assessment Conference Customers Areas to Develop Metrics Use of physical library Remote use Facilities/technology/ equipment Collections Services ILL Circulation Reference Other Staff Wait time Accuracy Courtesy And so on Collections Services Service quality Satisfaction

Library Assessment Conference We Can Then Develop Metrics (ratios with percentage) for Such Areas as Lost customers Shelve books within __ hours of use Wait time at reference desk Amount spent – Café (associated with library) – At vending machines (in library) Facilities used – Frequency of use of Group study room Academic support services available the physical space in the library (e.g., writing tutors and IT support) Seating Computers

Library Assessment Conference Accreditation Bodies Student learning outcomes Student outcomes Affordability Assorted inputs and outputs

Library Assessment Conference Conclusion