1. How Evaluation Helped an Academic Health Sciences Center Library Demonstrate its Value Presented by: Kay Chapa MPA, MSLS Kelly Gonzalez, MSIS, MBA

2.  Background  Methods  Results  Conclusion  Discussion 2

3. Strategic PlanMission 3

4. 4

5.  Capacity building  Organizational building blocks  strategic planning  project management  outcomes-based evaluation 2009 Culture of Assessment established in Library 2010 Clinical Informationist (CI) assigned to county hospital 2011 Clinical Informationist services evaluated 2013 Evaluation of current CI services needed 2014 New University Hospital opens 2015 New County Hospital opens 5

6.  2009 Annual Staff Survey  Connecting with our clients  Library operations  Internal communication  Changes not adequately monitored  Needed an instrument  Evaluate organizational changes  Evaluate and monitor departmental and strategic plan progress 6

7.  Performance measurement  Strategic planning  Project planning  Quality improvement  Program evaluation  Outcomes monitoring  Impact evaluation 7

8. Source: University of Wisconsin – Extension http://www.uwex.edu/ces/pdande/evaluation/evallogicmodel.html 8

9. 9

10. 10

11. 11

12. Methods and Results Evaluation of the Clinical Informationist Service 12

13. 13

14.  Timetable:  Planning – Dec 2011  Survey administered – Jan and Feb 2012  Evaluation period – roughly the 1 st qtr of the FY, that is, Sept – Dec  Survey period - 2 week with 1 week reminder  Study population  Email: - primary faculty contact - key participants – attendings, fellows - one-week follow-up email  Instrument: questionnaire, Survey Monkey  Approval 14

15.  4 main questions  1 open- ended question  Role  Name 15

16. OptionEisenberg n=5 IM n=4 ID n=11 Total n=20 Very high quality 53210 High quality1910 Moderate quality Low quality 16

17. OptionEisenberg n=5 IM n=4 ID n=11 Total n=20 Very positive contribution 53412 Positive178 Little or no Negative 17

18. OptionEisenberg n=5 IM n=4 ID n=11 Total n=20 Very significant (influence on specific treatment or diagnostic decisions) 5218 Significant156 Moderate156 Little or no 18

19. “Having the librarian on our team contributes hugely to the education of our house staff and students. They are able to learn how to ask searchable questions, easy access means they ask questions they would not always take the time to look up on their own, and often the information provided directly affects patient care by directing diagnostic work-up and/or treatment. In addition, getting to know a librarian through their service on the team has encouraged our trainees to access their services at other times, even once off the service.” “Very helpful to have the librarian on the service. I think that the combination of the library consultants and the pharmacist allows us to ensure high quality and evidence based medical care is delivered on a very busy service where it can be difficult to do in- depth literature reviews on your own in a timely manner, even if you have the skills to do such.” 19

20. 20

21. 21

22.  The value of library and information services in patient care: results of a multisite study The value of library and information services in patient care: results of a multisite study  The UT Southwestern Library stopped circulating books permanently (August 19)  Library staff reduction (10 FTE’s)  The UT Southwestern Medical Center increases its emphasis on health services administration 22

23. “By consciously structuring our efforts to identify inputs for decisions we set the stage to achieve meaningful outcomes.” Source: Busby, Lorraine. 2008. “Reality Through Evidence,” Evidence Based Library and Information Practice 3(1:82). 23

24. 24