Dr. Roswitha Poll Münster Benchmarking with performance indicators and Balanced Scorecard.

Slides:



Advertisements
Similar presentations
Long-term effects Short-term effects problems solved information gained time saved Cognitive impacts (knowledge acquisition) Cognitive impacts (knowledge.
Advertisements

Key Performance Indicators KPI’s
Towards Science, Technology and Innovation2/10/2014 Sustainable Development Education, Research and Innovation Vision for Knowledge Economy Professor Maged.
Process Evaluation Susan Kasprzak, March 13, 2009.
1 Measuring ICT4D: ITUs Focus on Household and Individual Market, Economics & Finance Unit Telecommunication Development Bureau.
Working together in difficult times: Challenges for academic libraries Sally Curry Research Information Network JIBS Conference York, 2 December 2010.
Using statistics to enhance library performance, an example Anja Smit.
Statens senter for arkiv, bibliotek og museum Indicators for Public Libraries Libraries in Knowledge Society – Strategies for.
Library Assessment Conference Evaluation Metrics for Libraries: Expanding the Conceptual Context Panel Discussion Neal Kaske Joe Matthews Peter.
UNESCO INSTITUTE for STATISTICS Initial results of the UIS/IFLA/ISO pilot survey on library statistics in Latin America and the Caribbean countries Montreal,
Developing an Effective Tracking and Improvement System for Learning and Teaching Achievements and Future Challenges in Maintaining Academic Standards.
Unit Name Goes Here Data This, Data That Using ISO to Develop Performance Indicators for Library Wide Planning & Data Comparison Presentation for.
CAIM Start up Workshop Knowledge Management Ankita Handoo, IFAD India.
Measuring the impact of new library services Dr. Roswitha Poll Münster.
Impact measures for libraries and information services Roswitha Poll Münster Bielefeld 2006 Bielefeld 2006.
Chapter 3 – Evaluation of Performance
BIX - The Library Index Roswitha Poll Chair of ISO TC 46 SC 8: Quality – Statistics and performance evaluation Roswitha Poll Chair of ISO TC 46 SC 8: Quality.
William Paterson University Five Strategic Areas of Focus at the Cheng Library Fairleigh Dickinson University June 18, 2009 Anne Ciliberti
CONTEXT Evaluation of Information Services. Topics of Day Mission Vision Goals and Objectives Standards Types of Metrics  Input  Output  Performance.
1 GETTING STARTED WITH ASSESSMENT Barbara Pennipede Associate Director of Assessment Office of Planning, Assessment and Research Office of Planning, Assessment.
What is Strategy? (Part Two). Key Concepts Managerial Cognition Business Model Stakeholders The Balanced Scorecard.
Library Statistics: what’s needed and what’s new Lynn Copeland Simon Fraser University Library Thurs. March 15, 2007 Vancouver Ass’n of Law Libraries.
The Balanced Scorecard. Developed by Robert Kaplan and David Norton. Introduced in the early 1990s. Motivated in part by Wall Street’s focus on quarterly.
Can we quantify the library’s influence? Creating an ISO standard for impact assessment Roswitha Poll Chair of ISO TC 46 SC 8: Quality – statistics and.
The Balanced Scorecard and Collection Management Jim Self University of Virginia Library June 17, 2002.
Standardisation of library statistics Standardisation of library statistics Roswitha Poll Chair of ISO TC 46 SC 8: Quality – Statistics and performance.
Measures that matter: Designing and developing your own Balanced Scorecard Karin de Jager & Jim Self 7th Northumbria International Conference on Performance.
© OECD A joint initiative of the OECD and the European Union, principally financed by the EU 1 Linking Quality to Strategy: Benefits of Balanced Scorecards.
Attracting appropriate user funding in the context of declining public funding.
of Research Libraries Assessing Library Performance: New Measures, Methods, and Models 24 th IATUL Conference 2-5 June 2003 Ankara,
Slide 1 D2.TCS.CL5.04. Subject Elements This unit comprises five Elements: 1.Define the need for tourism product research 2.Develop the research to be.
WHELF’s HELP Project Higher Education Libraries in Partnership Elizabeth Kensler HELP Project Officer UC&R Wales 11 th February 2005.
December 13, 2007 Session: “Performance Measurements for Transportation Libraries” Hank Zaletel, MTKN/Iowa DOT Library/CTRE Maggie Sacco, Transportation.
Collaborative Assessment: Using Balanced Scorecard to Measure Performance and Show Value Liz Mengel, Johns Hopkins University Vivian Lewis, McMaster University.
1 CONCERT 2004 Power to the Librarian Delivering Transparency in the Serials Market Doug McMillan Managing Director Bowker UK Ltd.
Roswitha Poll Münster, Germany Ten years after: „Measuring Quality“ revised.
Ministry of State for Administrative Development Towards Meaningful ICT Indicators for Developing Countries Dr. Ahmed M. Darwish EGYPT Government and Education.
…and how to give it to them What CEOs Want Patti Phillips, Ph.D.
Balanced Scorecard Introduction. What is the Balanced Scorecard? The balanced scorecard is a management system (not only a measurement system) that enables.
Building on sand? Using statistical measures to assess the impact of electronic services Dr Angela Conyers evidence base research & evaluation UCE Library.
AFM The Balanced Scorecard By Isuru Manawadu B.Sc in Accounting Sp. (USJP), ACA.
New measures for new services Indicators for quality, cost, and impact of electronic library services Roswitha Poll Münster LIDA 2007 LIDA 2007.
College Library Statistics: Under Review Teresa A. Fishel Macalester College Iowa Private Academic Libraries March 22, 2007 Mount Mercy College, Iowa.
Evaluation of Reference Services Dr. Dania Bilal IS 530 Spring 2006.
The Balanced Score Card
CASE STUDY : HASANUDDIN UNIVERSITY-INDONESIA INDRIANTY SUDIRMAN, PRASTAWA BUDI, DWIA A TINA The APPLICATION of BALANCED SCORECARD in MANAGING HIGHER EDUCATION.
SU Counting what matters To measure what counts Karin de Jager University of Cape Town October 2004.
The Balanced Scorecard
Information, Analysis, and Knowledge Management in the Baldrige Criteria Examines how an organization selects, gathers, analyzes, manages, and improves.
MEASURING THE COMPETITIVENESS OF A FIRM Prof. Dr. Dilek Çetindamar Sabancı School of Management Sabancı University & Hakan Kilitçioğlu Arge Consulting.
An analysis of the performance of research libraries in Poland – project description Elżbieta Górska The Polish Librarians’ Association Leistungsmessung.
Internal Auditing Effectiveness
IT Leading the Way to Institutional Effectiveness Presenter: Kendell Rice, Ph.D. July 11, 2007.
1 Commercial Value of International Benchmarking by Patrick Xavier School of Business Swinburne University of Technology Melbourne ITUWorkshop(4)
Dubai Statistics Center practices in Human Resources Management - What is DSC? - Planning - Performing - Measuring and Evaluating - Supporting Factors.
Assessing the impact of libraries Roswitha Poll Chair of ISO TC 46 SC 8: Quality – statistics and performance evaluation Roswitha Poll Chair of ISO TC.
From statistics to quality measures: evaluation of libraries Roswitha Poll Chair of ISO TC 46 SC 8: Quality – statistics and performance evaluation Roswitha.
Balanced Scorecard The University of Texas at El Paso Division of the Vice President for Business Affairs.
1 Balanced Scorecard Philosophy, Basics, Fundamentals, and Functions.
1 Strategic Management All libraries must look into the future to be able to develop long-term strategies to meet user needs.
Human Resource Management 1 Performance Management Process.
Balanced Scorecard “Puyallup Public Library, as an innovative information center, provides excellent service to all in their pursuit of information, knowledge,
Quantifying the value of our libraries. Are our systems ready?
Indicators for Public Libraries
Assessing Library Performance:
Contents A GENERIC IT BALANCED SCORECARD
Strategy and Human Resources Planning
Global Libraries Impact Assessment
Global library statistics – a new approach
Presentation transcript:

Dr. Roswitha Poll Münster Benchmarking with performance indicators and Balanced Scorecard

Quality in libraries User-orientation Accessibility (building, collection, services) Accuracy and reliability Speed and currency Competence and helpfulness of staff Effectiveness and efficieny of processes

Quality in libraries: stakeholders Users (actual and potential) Funding institutions (university, community) Policy makers General public Library staff Library managers

Quality assessment in libraries Performance indicators measure the effectiveness and cost-efficiency of library services: quantitative, objective User satisfaction surveys measure the perceived quality, the users‘ impression of library services: qualitative, subjective Outcome assessment tries to show the benefits, the value for individual users and society

Collections of performance indicators for libraries ISO 11620, 2nd ed. (2008), Information and documentation – Library performance indicators (45 indicators) ISO TR (2008), Information and documentation – Performance indicators for national libraries (30 indicators) Poll, R. and te Boekhorst, P., 2nd ed. (2007), Measuring quality, performance measurement in libraries, Saur, München (IFLA Publications 127) (40 indicators)

Criteria for performance indicators informative = helpful for identifying problems and possible actions to be taken reliable = producing the same results when used under the same circumstances valid = measuring what they are intended to measure appropriate = compatible with the library's procedures and working environment practical = easy to use and understand, applicable with a reasonable amount of effort comparable = allowing comparison of results between libraries of similar mission, structure and clientele

What indicators measure Usage of library services - Library visits per capita - Number of content units downloaded per capita The quality of the collection - Document use rate (collection use rate) - Availability of required titles The quality of processes - Shelving accuracy - Speed of interlibrary lending Cost-efficieny - Cost per database session - Cost per loan

How to get the data? Institutional statistics Library statistics Automated library system Manual data collection Number of visits Number of user places Number of students Number of academic staff Number of active users ILL requests Number of working-places used User satisfaction survey Use rate of working-places User satisfaction Market penetration

Indicators for joint projects The set of indicators should… Cover all traditional and new services Consider each individual library Allow comparison Show the importance and benefit of libraries Include only a very few indicators Involve no additional workload (data taken from the normal library statistics) ???

Projects that only recommend indicators ) all types of libraries 3-years project Swedish Quality Handbook (2005) all types of libraries 3-years project The Norwegian indicators, 4th revision (2007) academic and public libraries bibliotek/indikatorer-for-fag-og-folkebibliotek

Projects that make a set of indicators compulsory BIX –Library Index German public and academic libraries public libraries 1999 ff., academic libraries 2002 ff. over 260 libraries (not all continuously) The Benchmarking system of the Netherlands University Libraries all university libraries and the national library 1999 ff. HELMS (UK Higher Education Library Management Statistics) academic libraries 1997/98 ff.

Balanced Scorecard Kaplan, R.S./Norton, D.P.: Kaplan, R.S./Norton, D.P.: The Balanced Scorecard: Translating Strategy into Action. Boston 1996

Balanced Scorecard: 4 perspectives Original 1. Finances 2. Customers 3. Internal processes 4. Learning and growth Libraries 1. Resources, infrastructure 2. Use 3. Efficiency 4. Potentials and development (Learning and growth)

Balanced Scorecard: How to proceed 1. Starting with the vision (mission), the strategy is developed: What are the main tasks and goals? 2. The goals are structured in the perspectives 3. Within the four perspectives, “critical success factors” are defined: What is most important for reaching the goals? 4. Based on the critical success factors, “key performance indicators” are selected.

Balanced Scorecard: Example Vision: The library is the main meeting and communication centre in the community or university Perspective: Customers (users) Goal: To attract the population to the library premises Critical success factors: opening times, adequate space and equipment for working in the library Key performance indicators: - m 2 of user area per 1,000 capita - number of workplaces per 1,000 capita - opening times compared to user demand

Balanced Scorecard: The 4th perspective Potentials and development, Learning and growth intangible assets of an organisation internal skills and capabilities effective information management overall climate in an organisation

Balanced Scorecard: Why? All important perspectives for quality are considered. Each perspective with its goals is evaluated by adequate performance indicators. There is a limited number of performance indicators (up to 20). The indicators are related in a systematic way and influence each other. The BSC is an instrument for an integrated view of the institution’s quality and for continuous assessment of how far targets have been reached.

Global statistics project: Performance indicators Global statistics: Only a limited number of data Socio-demographic data from UIS to be added - size of population - number of students - literacy in a country 76 indicators were calculated in the project Of these, 23 were defined as core indicators Can the Balanced Scorecard be used for the “global statistics”?

Balanced Scorecard Resources and infrastructure Public libraries 1. Average number of public libraries per 1,000 inhabitants 2. Weighted average opening hours 3. Percentage of libraries offering an internet access for users 4. Percentage of libraries offering websites 5. Average number of volumes in public libraries per 1,000 inhabitants 6. Average number of volumes per 1,000 literate inhabitants 7. Average number of employees in public libraries Academic libraries 1. Weighted average opening hours 2. Average number of volumes in libraries per student 3. Average number of workplaces per 1,000 students 4.Average number of electronic serials (subscriptions) 5. Average number of employees in libraries

Balanced Scorecard Usage Public libraries 1. Number of registered users per 1,000 inhabitants 2. Number of registered users per 1,000 literate inhabitants 3. Average number of loans per 1000 inhabitants 4. Average number of loans per 1,000 literate inhabitants 5. Number of visits per 1,000 inhabitants 6. Number of visits per 1,000 literate inhabitants Academic libraries 1. Number of registered users as a percentage of number of students 2. Average number of loans per student 3. Number of visits per student 4. Number of attendances at training sessions per student 5. Average number of content units downloaded per registered user

Balanced Scorecard Efficiency/Finances Public libraries 1. Expenditure on literature and information per capita 2. Ratio of expenditure on literature and information to staff costs 3. Cost per visit 4. Cost per registered user Academic libraries 1. Expenditure on literature and information per capita 2. Ratio of expenditure on literature and information to staff costs 3. Cost per visit 4. Cost per registered user

Balanced Scorecard Potentials and development (Learning and growth) Indicators that have been used E-services expenditure for the E-collection staff in E-services Staff development and motivation time and money spent on staff training ! availability and fluctuation rate of staff Raising resources library means received by special grants or income generated percentage of institutional means allocated to the library No indicators in “global statistics”

New perspective „Impact on population“? Average number of volumes per 1,000 literate inhabitants Number of registered users per 1,000 literate inhabitants Average number of loans per 1,000 literate inhabitants Number of visits per 1,000 literate inhabitants High numbers of public libraries, collections and services, and high library use may have influenced the percentage of literate inhabitants in a country High numbers of public libraries, collections and services, and high library use may have influenced the percentage of literate inhabitants in a country

Keepyourbalance