“Work smarter, not harder” Innovation through evaluation at HYms Introduction Penelope Dunn HYMS/University of York penelope.dunn@york.ac.uk @Lady_PGD

Service Evaluation: What?: Why? eBook use and interface preference Variance in cost Student demand Over 40% of the reading list titles are available as eBooks eBooks are largely viewed as a suitable alternative to/replacement for print Service Evaluation:

Evaluation Method: Focus Groups Why? How? Usage statistics do not tell the whole story New approach How? One focus group at each site Pre-focus group questionnaire – quantitative Focus groups lasted 1 hour– split into two sections - Discussion & interface specific tasks Used a different method to previous evaluations. Only 1 at each site – busy time of year not as much uptake as would have hoped.

eBook Focus Groups: Results Supports rather than replaces print “dip in and out” “great for when I go home” Good alternative if print not available/affordable Access issues: multiple log-ins & “choppy” internet Download period too short Too much variance in design Extra features not easy to spot/use (& not always wanted) No standout choice for preferred interface We learnt a lot from this process and the results informed a set of recommendations.

eBook Focus Groups: Recommendations Longer download periods Interactivity Improved interface design Optimisation for tablets/eReaders eBook ‘Favourites’ folder ‘Search topic’ function on HYMS eBook cross-search Increased availability of dual screen PCs Clarity on reading lists This is what users wanted – some have obviously got to be tackled by publishers/providers and we will/have passed on feedback to each provider that we looked at. Some of the points, however, can be tackled at HYMS level.

Innovation through evaluation Collection development Key text books Specialist items if possible Improving student experience Satisfaction with resources = happy students Forwarding design and usability concerns to providers Development of ‘topic search’ (long term) Evaluate reading lists for clarity and rectify Discuss potential for more dual screen PCs with IT Future evaluations Planning to run more focus groups in 2013/14 Innovation through evaluation So how can the results and recommendations allow us to innovate? Key text books “don’t feel as much at a disadvantage if the eBook is available when print copies are all out of the library” We have areas we can begin to work on to improve things for students. Successful even on small scale – got a lot of information out of the process – it is worth while doing evaluative activities that involve the students – informed evidence-based decisions