Benchmarking information skills training courses FOLIO InfoSkills Course.

Slides:



Advertisements
Similar presentations
Intelligence Step 5 - Capacity Analysis Capacity Analysis Without capacity, the most innovative and brilliant interventions will not be implemented, wont.
Advertisements

OECD/INFE High-level Principles for the evaluation of financial education programmes Adele Atkinson, PhD OECD With the support of the Russian/World Bank/OECD.
Training Needs Analysis UNDP c/o Romania Law Enforcement Best Practice Manual For Fighting Against Trafficking of Human Beings.
Social Accounting and Audit (SAA) and the Social Audit Network An introduction…
B121 Chapter 7 Investigative Methods. Quantitative data & Qualitative data Quantitative data It describes measurable or countable features of whatever.
BIX - The Library Index Roswitha Poll Chair of ISO TC 46 SC 8: Quality – Statistics and performance evaluation Roswitha Poll Chair of ISO TC 46 SC 8: Quality.
Evaluating Socio-Economic Development - the ever-evolving EVALSED Guide Elliot Stern Presentation to Conference: Evaluating Public Interventions.
INTEGRATING BENEFICIARY FEEDBACK INTO EVALUATION- A STRUCTURED APPROACH Presentation to UKES Conference May 2015 Theme: Theory and practice of inclusion.
EURIDICE project Evaluation of image database use in online learning environment 11/
Benchmarking as a management tool for continuous improvement in public services u Presentation to Ministry of Culture of the Russian Federation u Peter.
Royal Agricultural College How do we compare? the experience of benchmarking a smaller University College Library in the UK Higher Education sector Theano.
Being Proactive: An Organisational Approach to Managing Workplace Stress I/O Net Presentation by Dr Hillary Bennett Director, PsychAssessments.
How to Develop the Right Research Questions for Program Evaluation
“”Capacity and services to road users” Task descriptions Paul van der Kroon, Paris November 2005.
Impact assessment framework
1 What Students Need to Know from The National Student Survey 17 June 2010 Sami Benyahia, Director.
Bridging the Impact Gap: Systems and Serendipity 13 September 2013 ARMS Conference, Adelaide 2013 Natalie Thompson Acting Research Support Services Manager.
Promoting the uptake of e-books in UK further and higher education Linda Bennett.
+ NEEDS ANALYSIS AND RESEARCH REPORT LLP-2012-LV-KA4-KA4MP.
EQARF Applying EQARF Framework and Guidelines to the Development and Testing of Eduplan.
The role of the research practitioner Dr Graham Walton, Head of Planning and Resources, Library and Honorary Research Fellow, Department of Information.
Vaal University of Technology (formerly Vaal Triangle Technikon ) Ms A.J. GOZO Senior Director: Library and Information Services.
Developing Indicators
OECD/INFE Tools for evaluating financial education programmes Adele Atkinson, PhD Policy Analyst OECD With the support of the Russian/World Bank/OECD Trust.
UK Wide Core Skills & Training Framework Findings of 2 nd Stage Consultation and Implications for Development of the Framework.
1 WERT: WP 5 RG EVANS ASSOCIATES November 2010 Aim To pilot and evaluate the content and context of the course material with target groups To help women.
Important Information Have you got a username and password for the school SRF account? If your school has not registered before then you can do this if.
Workshop 6 - How do you measure Outcomes?
1 Women Entrepreneurs in Rural Tourism Evaluation Indicators Bristol, November 2010 RG EVANS ASSOCIATES November 2010.
Benchmarking information skills training courses FOLIOz InfoSkills Course.
BENCHMARKING For Best Practices. What is Benchmarking A method for identifying and importing best practices in order to improve performance A method for.
REAL WORLD RESEARCH THIRD EDITION Chapter 8: Designs for Particular Purposes: Evaluation, Action and Change 1©2011 John Wiley & Sons Ltd.
VAMP – laying the foundations Claire Creaser Angela Conyers Suzanne Lockyer.
W HAT IS M&E  Day-to-day follow up of activities during implementation to measure progress and identify deviations  Monitoring is the routine and systematic.
On-line briefing for Program Directors and Staff 1.
Monitoring public satisfaction through user satisfaction surveys Committee for the Coordination of Statistical Activities Helsinki 6-7 May 2010 Steve.
EDPQS in 10 minutes: Overview of European Drug Prevention Quality Standards (EDPQS) With financial support from the Drug Prevention and Information Programme.
Results The final report was presented to NICE and published by NICE and WHO. See
After the Academy Selena Lock LibQUAL+ Results Meeting 22nd August 2005.
Unpacking and Implementing Training Packages Linda Hopkins.
1 Evaluating the Quality of the e-Learning Experience in Higher Education Anne Jelfs and Keir Thorpe, Institute of Educational Technology (IET), The Open.
School Improvement Partnership Programme: Summary of interim findings March 2014.
CITIZEN SATISFACTION SURVEY OVERVIEW REPORT PRESENTATION TO PARLIAMENTARY PORTFOLIO COMMITTEE ON PUBLIC SERVICE AND ADMINISTRATION 09 APRIL 2003.
Quality Assuring Deliverers of Education and Training for the Nuclear Sector Jo Tipa Operations Director National Skills Academy for Nuclear.
Evaluating customer service delivery1 Summary Slide Evaluating Customer Service Delivery What is quality of service Benchmarking Using external quality.
Privatisation: 10 years on Jeremy Colman, UK National Audit Office.
Improving BSO Services and SME Performance Through Cleaner Production [DATE][SPEAKERS NAMES]
United Nations Oslo City Group on Energy Statistics OG7, Helsinki, Finland October 2012 ESCM Chapter 8: Data Quality and Meta Data 1.
Quality Frameworks: Implementation and Impact Notes by Michael Colledge.
King Fahd University of Petroleum & Minerals Construction Engineering & Management Dept. Prepared For: Dr. Abdulaziz A. Bubshait Prepared By: Abdullah.

Marketing information and research. Importance of effective marketing information and research Effective penetration of markets requires specialised and.
Benchmarking. Contents: A brief definition of benchmarking Its application in the commercial world How the technique can be applied to the public sector.
A centre of expertise in digital information managementwww.ukoln.ac.uk UKOLN is supported by: Effective Web Site Training Workshop: Benchmarking Web Sites.
Focus on SCONUL Institutions: Cranfield University – DCMT Campus Stephen Town.
CHANGE READINESS ASSESSMENT Measuring stakeholder engagement and attitude to change.
Social Accounting and Audit (SAA) - Ten Simple Stages An introduction…
QUALITY ASSURANCE AND CONTROL
5 steps to align your talent strategy to the organisational strategy
Training Trainers and Educators Unit 8 – How to Evaluate
Mrs. Molnár-Stadler, Katalin
Programme Review Dhaya Naidoo Director: Quality Promotion
“CareerGuide for Schools”
Training Trainers and Educators Unit 8 – How to Evaluate
Governance and leadership roles for equality and diversity in Colleges
How to Design and Implement Research Outputs Repositories
Quality in administration of higher education
ICCE WORKSHOPS.
How to conduct Effective Stage-1 Audit
VERITE – Dissemination plan
Presentation transcript:

Benchmarking information skills training courses FOLIO InfoSkills Course

What is benchmarking? Some basic definitions: Benchmark: a reference standard against which other things can be compared. Benchmarking: the continuous process of identifying, understanding and adapting practices from other organisations to improve the performance of your own organisation. The process involves continuously assessing the quality of goods or services against standards of best-practice

The SCONUL benchmarking process (1) SCONUL (Society of College, National and University Libraries – UK & Ireland) has identified 7 benchmarking processes for library and information services (1): 1. Defining: (for e.g.) Which staff will be involved in the benchmarking process? How are measures defined? 2. Partnering: Identifying partners (for e.g.) libraries in institutions that are similar in size, subjects, league table positions, geography etc 3. Agreeing: (for e.g.) agree ethics for the confidentiality of results and timetable

The SCONUL benchmarking process (2) 4. Measuring: Identify critical success factors and define a set of measures for comparing. Critical success factors help to define what is important about library services. Consider whether existing data collection methods are useful and applicable to measure these or whether new measures are needed 5. Collecting: Obtain contextual information using a questionnaire. Partners should then visit each other to collect data and to learn more about the partner. The data should then be recorded and shared 6. Analysing: Normalise and compare the data to identify performance gaps. Consider the approaches taken by partner institutions to see whether these can be transferred elsewhere 7. Acting: Embed what has been learnt and set new targets to help to achieve better performance. Devise an action plan to reach the new targets and implement improvements. The results of these actions should be monitored and the whole process reviewed and repeated

Benchmarking processes For the purposes of this course, we have grouped SCONUL’s benchmarking processes to four main areas:

Benchmarking processes 1. Planning for benchmarking 2. Setting targets of the quality of information skills training 3. Measuring: audit or benchmark the quality of information skills training using a check-list (this may include an cost-benefit analysis) 4. Action plan: compare the benchmarks with the targets and produce an action plan to bridge deficits.

Process 1: Planning for benchmarking You may choose to have a panel rather than an individual, to introduce an element of objectivity. The panel should have sufficient gravity to command respect, but not so many members that it becomes unwieldy. You should consult with all the main parties involved, including those who will undergo benchmarking and the customers of the service. You should define the outputs of information skills training courses that you wish to benchmark. This process may involve clarifying who your students are.

Process 2: Set targets of the quality of information skills training courses You can set targets to assess quality across many areas of information skills training: Design and quality of facilities Staffing (levels, expertise) Health and safety (probably more an organisation-wide rather than a departmental issue, but may include issues like cleanliness) Accessibility (training times, disabled access etc) Use of information skills training services User satisfaction with training services Marketing and promotion Targets may be derived from comparisons with other organisations or accepted standards for “best practice” from the wider literature.

Process 3: Measuring This involves data collection and analysis, culminating in comparison with external standards or “best- practice.” Some data can be gleaned from routine statistics already gathered as part of daily activity (e.g. number of participants requesting one-to-one training, or the number of training courses that are run each year). Some data may need specific prospective collection (e.g. a survey of student satisfaction with training courses). In some cases, especially if there is a research component to your information skills training programme, it may involve a site visit or interviews with stakeholders.

Process 4: Action Plan This involves addressing gaps between “best practice” (how information skills training should be run) and current practice (how information skills training is run). An early (and crucial step) may be dissemination of the conclusions to all who will be involved in the action plan. It may lead to an iterative process of repeated review to see if the action plan is working at closing that gap.

Examples of benchmarks to measure the quality of training courses 1. Measurement of the demand for the training course. 2. Measurement of the number of library staff available to provide the information skills training course. 3. Measurement of an increase in the use of related library services (e.g. e-journals, catalogue, requests for usernames and passwords to access electronic resources etc) as a result of the training course. 4. Measurement of student satisfaction with the course using results from the evaluation questionnaire. etc… Look back to the ‘Process 2: Set targets of the quality of information skills training courses’ slide for more ideas about benchmarking training courses.

References 1. J. Stephen Town. SCONUL Benchmarking Manual. London: SCONUL; 2000

Further Reading Balm G (1992) Bench-marking: a practitioner’s guide for becoming and staying the best of the best Schaumburg (Illinois): QPMA Press Bendell T, Boulter L, Kelly J (1993) Benchmarking for competitive advantage London: Pitman John Brockman (Ed). Quality Management and Bench-marking in the Information Sector London, Bowker Saur; 1997 Claire Creaser (ed) As Others See Us: Benchmarking in Practice (LISU Occasional Paper no.33). Online: Accessed March 2010As Others See Us: Benchmarking in Practice