1. 10/14/99Besser--methodology1.5 1 Using Digital Images on Campus: Lessons from the Museum Educational Site Licensing Project and its descendants Howard Besser Associate Professor UCLA School of Education & Information http://www.sims.berkeley.edu/~howard/ http://sunsite.berkeley.edu/Imaging/Databases/1998mellon

2. 10/14/99Besser--methodology1.5 2 The Museum Educational Site Licensing Project (MESL) distribution of museum images and metadata to university community nearly 10,000 image set from 7 museums identical data set mounted locally at each of 7 universities voluntary participation, each institution paying own way, Getty paying for coordination and meetings

3. 10/14/99Besser--methodology1.5 3 Study Design Issues Conflicting Agendas Getting compliance from participants Cost problems Benchmarking User Study issues

4. 10/14/99Besser--methodology1.5 4 Conflicting Agendas Granting Agency wanted to study Costs I wanted to study Use

5. 10/14/99Besser--methodology1.5 5 Conflicting Agendas Our Solution Granting Agency wanted to study Costs I wanted to study Use Express Use issues as Missed Costs Put up with periodic conflicts with Granting Agency

6. 10/14/99Besser--methodology1.5 6 General Problems Voluntary project Voluntary compliance with study Experimental project –not how they’d run a production-level project –didn’t hire new staff

7. 10/14/99Besser--methodology1.5 7 Relationships with MESL Participants Mutiny against MESL Project Manager –external funding hadn’t materialized –participants (already overworked) felt they were being ordered to conform to unrealistic schedules without even a “thank you” Our first grant project manager alienated project participants

8. 10/14/99Besser--methodology1.5 8 Relationships with MESL Participants Our Solution Mutiny against MESL Project Manager –external funding hadn’t materialized –participants (already overworked) felt they were being ordered to conform to unrealistic schedules without even a “thank you” Our first grant project manager alienated project participants Replace our Project Manager Become sensitive/indulgent of participant needs

9. 10/14/99Besser--methodology1.5 9 Cost Problems Fear that administrators will find out how much was spent on this project Salary levels differed radically from institution to institution Even within same institution, the same functions might be handled sometimes by a highly-paid staff and sometimes by low- paid student help

10. 10/14/99Besser--methodology1.5 10 Cost Problems Our Solution Fear that administrators will find out how much was spent on this project Salary levels differed radically from institution to institution Even within same institution, the same functions might be handled sometimes by a highly-paid staff and sometimes by low- paid student help Express Costs in hours not money Concept of Cost Centers Only report aggregated amounts within any given Cost Center

11. 10/14/99Besser--methodology1.5 11 Benchmarking Problems Where might cost savings lie? No cross-institutional studies of slide library costs

12. 10/14/99Besser--methodology1.5 12 Benchmarking Problems Our Solution Where might cost savings lie? No cross-institutional studies of slide library costs We designed our own Study of Slide Libraries

13. 10/14/99Besser--methodology1.5 13 Resistance from Subject Community Slide Librarians resistant to having their full set of costs exposed

14. 10/14/99Besser--methodology1.5 14 Resistance from Subject Community Our Solution Slide Librarians resistant to having their full set of costs exposed Gain respect from Slide Librarians –Clarify our motives and support –Study Costs plus Services –Advisory Committee

15. 10/14/99Besser--methodology1.5 15 Traditional User Study Tells us little about nuances and problems Doesn’t deal with non-users Fails to address impediments and important issues of adoption

16. 10/14/99Besser--methodology1.5 16 Traditional User Study Our Solution Tells us little about nuances and problems Doesn’t deal with non-users Fails to address impediments and important issues of adoption Focus groups of early adopters including both users and non-users

17. 10/14/99Besser--methodology1.5 17 Problem: How to get Focus Groups Together?

18. 10/14/99Besser--methodology1.5 18 Problem: How to get Focus Groups Together? Our Solution Target attendees at Professional Conference Identify key players (both users and non-users) Have MESL activists pressure faculty at their institutions Rent pleasant convenient room Arrange low-conflict time Offers incentives to Focus Group participants

19. 10/14/99Besser--methodology1.5 19

20. 10/14/99Besser--methodology1.5 20 The UCB Mellon Grant Studying MESL Introduction & Background The Studies –(Comparing User Interfaces) –(Comparing Search Discrepancies) –(Assessing Museum Costs) –University Delivery Study –Slide Library Costs –Slide Circulation Patterns –Faculty User Study Summary & Conclusions

21. 10/14/99Besser--methodology1.5 21 UCB Mellon Grant Research Team Howard Besser, UCB Faculty Bob Yamashita, CSU Faculty Rosalie Lack, SIMS graduate student Joanne Miller, SIMS graduate student Lena Stebley, SJSU graduate student

22. 10/14/99Besser--methodology1.5 22 UCB Mellon Grant Consultants Christie Stephenson, NYU Librarian for Digital Initiatives Beth Sandore, UIUC Library Digital Initiatives Coordinator Christine Sundt, UO Slide Curator...assistance from MESL participants and staff

23. 10/14/99Besser--methodology1.5 23 UCB Mellon Grant Advisory Board Gary Marchionini, Professor of Information Science, Univ of Maryland Marvin Sirbu, Professor of Economics, Carnegie-Mellon Univ Malcolm Getz, Professor of Economics, Vanderbilt Margaret Radin, Professor of Law, Stanford University Clifford Lynch, Executive Director, Coalition for Networked Information

24. 10/14/99Besser--methodology1.5 24 The UCB Mellon Grant- (Comparing MESL User Interfaces) (Comparing MESL Search Discrepancies) (Assessing Museum Costs) Assessing University Costs Assessing Costs of Slide Libraries Examining Faculty & Student Use & Usefullness

25. 10/14/99Besser--methodology1.5 25 Comparing User Interfaces Presentation and layout Search options Image display and labeling

26. 10/14/99Besser--methodology1.5 26 Cost Assessment Methodology MESL Technical Report Questionnaire –primarily voluntary self-reporting Clarifications and follow-up questions from Berkeley researchers Data Analysis by Berkeley researchers

27. 10/14/99Besser--methodology1.5 27 Museum Cost Centers Content Selection Image Preparation Image Transmission Text/Data Preparation Text/Data Transmission

28. 10/14/99Besser--methodology1.5 28 University Digital Distribution Cost Centers Image Preparation Structured Data Unstructured Data Functionality Security Log Files Outreach Usage Training Technical Development

29. 10/14/99Besser--methodology1.5 29 Slide Library Cost Centers Acquisition Capture (equipment) Data (gathering information) Mounting (data on slide, catalog record) Delivery (controlling access and reshelving) Maintenance

30. 10/14/99Besser--methodology1.5 30 Examining Faculty & Student Use & Usefulness What Faculty Do with Digital Images Major Issues for Faculty Faculty Concerns about teaching with Digital Images Faculty Concerns about Image Quality and Metadata

31. 10/14/99Besser--methodology1.5 31 More Information http://sunsite.berkeley.edu/Imaging/Databases/1998mellon –UC Berkeley Mellon Grant –Howard Besser –School of Information Mgmt & Systems –UC Berkeley, CA 94720-4600