1. UKOLN is supported by: Evidence, Impact, Metrics Institutional and Social Web Services: Evidence for Their Value Welcome Brian Kelly UKOLN University of Bath Bath, UK http://www.ukoln.ac.uk/web-focus/events/workshops/eim-2010-12/ This work is licensed under a Attribution-NonCommercial- ShareAlike 2.0 licence (but note caveat) Acceptable Use Policy Recording this talk, taking photographs, discussing the talk using Twitter, IM, etc. is permitted if distractions to others are minimised. Acceptable Use Policy Recording this talk, taking photographs, discussing the talk using Twitter, IM, etc. is permitted if distractions to others are minimised. Twitter: #ukolneim Blogs:Twitter: http://ukwebfocus.wordpress.com/ @briankelly http://blogs.ukoln.ac.uk/evidence-impact-metrics/@ukwebfocus

2. 2 About Me Brian Kelly: UK Web Focus: a national advisory post Long-standing Web evangelist Established Institutional Web Management Workshop (IWMW) in 1997 Based at UKOLN at the University of Bath UKOLN: A national centre of expertise in digital information management Funded by the JISC A JISC Innovation Support Centre Introduction

3. Evidence, Impact, Metrics Evidence, Impact, Metrics (EIM): UKOLN activity funded by the JISC Aims to: Explore ways of gathering evidence which can demonstrate the impact of services and devise appropriate metrics to support such work By: A number of events The EIM Blog 3

4. Evidence, Impact, Metrics Areas of Work Institutional Web services (November): How can we demonstrate the effectiveness and impact of institutional Web services? What metrics are relevant? What concerns may there be? The Social Web (December): How can we demonstrate the effectiveness and impact of Social Web services? What metrics are relevant? What concerns may there be? …. 4 Introduction

5. 5 Workshop Aims By the end of the workshop we should have: Discussed ways of gathering evidence to demonstrate the value and impact of Social Web services. Identified ways that the value and impact can be measured and articulated to third parties Explored ways in which such measures can be standardised in order to provide level of consistency, whilst acknowledging institutional diversity We should also: Be in a position to develop and/or commission work to gather and interpret evidence Introduction

6. The Context The need to demonstrate value in light of Government cuts 6

7. Why? Why do we need to do this? (Respond to criticisms from others) Be able to demonstrate our value Be able to identify & address deficiencies … 7 Using Freedom of Information legislation the Telegraph discovered eight examples of universities spending between £100,000 and £280,000 on one-off website redesigns, as much as five times higher than the average spending. The average annual spending on the maintenance of a university website is £60,375. That figure excludes additional spending on one-off redesigns, for which the average spending is £60,882. The most expensive university website is the University of xxxx, which spent £278,094 on a redesign by Precedent Communications and Straker UK, completed in May 2008. The university also employs staff whose salaries cost £221,500 every year, in addition to £14,500 each year for software support.

8. Prisoner’s Dilemma We can all benefit by: Sharing best practices Sharing examples of flawed approaches Agreeing on ways forward But concerns that: We might be seen to be doing badly We want to learnt from others, but not share our experiences 8 The aim is to demonstrate the value of institutional Web services across UK HE. That is a clear unambiguous message to sell (to e.g. THE) Concerns

9. Programme TimeContent 10.00-10.20Introduction 10.20-10.40Case Study: What We’re Doing at the University of Bath. Alison Kerwin, University of Bath 10.40-11.00Case Study: Should We Outsource? Assessing Costs and ROI. Stephen Emmott, LSE 11.00-11.20Coffee 11.20-11.40Impact and Revenue: Dashboard Approaches to Measuring Value: Ranjit Sidhu 11.40-12.30Breakout Groups: Reviewing the Approach 12.30-13.30Lunch 13.30-13.45Beyond the Institution: Value of Cloud Services & the Social Web 13.45-14.25Case Studies: Jeremy Speller & Sarah Sherman 14.25-15.00Group Exercise 15.00-15.15Coffee 15.15-15.50Report Back & Action Plans 15.50-16.00Conclusions 9

10. About You In small groups cover: Where you work What you do Your areas of interest Specific issues would you like to see addressed Expertise you can contribute 10 E

11. 11 Questions Any questions or comments?

12. Reviewing Approaches You have heard about: Two case studies A institutional dashboard approach to monitoring value based on institutional priorities You will now: Identify the relevance of such approaches for your institution Explore limitations and benefits Make recommendations for further work 12

13. 13 Questions Any questions or comments?

14. Action Plans What Next? Building on Today’s Work What will you do next? What should your institution do next? What related work needs to be done at a regional or national level? What Next? Additional Areas of Work What additional areas could the EIM activity address? 14 15.15-15.45 D