10/14/99Besser--methodology1.5 1 Using Digital Images on Campus: Lessons from the Museum Educational Site Licensing Project and its descendants Howard Besser Associate Professor UCLA School of Education & Information

10/14/99Besser--methodology1.5 2 The Museum Educational Site Licensing Project (MESL) distribution of museum images and metadata to university community nearly 10,000 image set from 7 museums identical data set mounted locally at each of 7 universities voluntary participation, each institution paying own way, Getty paying for coordination and meetings

10/14/99Besser--methodology1.5 3 Study Design Issues Conflicting Agendas Getting compliance from participants Cost problems Benchmarking User Study issues

10/14/99Besser--methodology1.5 4 Conflicting Agendas Granting Agency wanted to study Costs I wanted to study Use

10/14/99Besser--methodology1.5 5 Conflicting Agendas Our Solution Granting Agency wanted to study Costs I wanted to study Use Express Use issues as Missed Costs Put up with periodic conflicts with Granting Agency

10/14/99Besser--methodology1.5 6 General Problems Voluntary project Voluntary compliance with study Experimental project –not how they’d run a production-level project –didn’t hire new staff

10/14/99Besser--methodology1.5 7 Relationships with MESL Participants Mutiny against MESL Project Manager –external funding hadn’t materialized –participants (already overworked) felt they were being ordered to conform to unrealistic schedules without even a “thank you” Our first grant project manager alienated project participants

10/14/99Besser--methodology1.5 8 Relationships with MESL Participants Our Solution Mutiny against MESL Project Manager –external funding hadn’t materialized –participants (already overworked) felt they were being ordered to conform to unrealistic schedules without even a “thank you” Our first grant project manager alienated project participants Replace our Project Manager Become sensitive/indulgent of participant needs

10/14/99Besser--methodology1.5 9 Cost Problems Fear that administrators will find out how much was spent on this project Salary levels differed radically from institution to institution Even within same institution, the same functions might be handled sometimes by a highly-paid staff and sometimes by low- paid student help

10/14/99Besser--methodology Cost Problems Our Solution Fear that administrators will find out how much was spent on this project Salary levels differed radically from institution to institution Even within same institution, the same functions might be handled sometimes by a highly-paid staff and sometimes by low- paid student help Express Costs in hours not money Concept of Cost Centers Only report aggregated amounts within any given Cost Center

10/14/99Besser--methodology Benchmarking Problems Where might cost savings lie? No cross-institutional studies of slide library costs

10/14/99Besser--methodology Benchmarking Problems Our Solution Where might cost savings lie? No cross-institutional studies of slide library costs We designed our own Study of Slide Libraries

10/14/99Besser--methodology Resistance from Subject Community Slide Librarians resistant to having their full set of costs exposed

10/14/99Besser--methodology Resistance from Subject Community Our Solution Slide Librarians resistant to having their full set of costs exposed Gain respect from Slide Librarians –Clarify our motives and support –Study Costs plus Services –Advisory Committee

10/14/99Besser--methodology Traditional User Study Tells us little about nuances and problems Doesn’t deal with non-users Fails to address impediments and important issues of adoption

10/14/99Besser--methodology Traditional User Study Our Solution Tells us little about nuances and problems Doesn’t deal with non-users Fails to address impediments and important issues of adoption Focus groups of early adopters including both users and non-users

10/14/99Besser--methodology Problem: How to get Focus Groups Together?

10/14/99Besser--methodology Problem: How to get Focus Groups Together? Our Solution Target attendees at Professional Conference Identify key players (both users and non-users) Have MESL activists pressure faculty at their institutions Rent pleasant convenient room Arrange low-conflict time Offers incentives to Focus Group participants

10/14/99Besser--methodology1.5 19

10/14/99Besser--methodology The UCB Mellon Grant Studying MESL Introduction & Background The Studies –(Comparing User Interfaces) –(Comparing Search Discrepancies) –(Assessing Museum Costs) –University Delivery Study –Slide Library Costs –Slide Circulation Patterns –Faculty User Study Summary & Conclusions

10/14/99Besser--methodology UCB Mellon Grant Research Team Howard Besser, UCB Faculty Bob Yamashita, CSU Faculty Rosalie Lack, SIMS graduate student Joanne Miller, SIMS graduate student Lena Stebley, SJSU graduate student

10/14/99Besser--methodology UCB Mellon Grant Consultants Christie Stephenson, NYU Librarian for Digital Initiatives Beth Sandore, UIUC Library Digital Initiatives Coordinator Christine Sundt, UO Slide Curator...assistance from MESL participants and staff

10/14/99Besser--methodology UCB Mellon Grant Advisory Board Gary Marchionini, Professor of Information Science, Univ of Maryland Marvin Sirbu, Professor of Economics, Carnegie-Mellon Univ Malcolm Getz, Professor of Economics, Vanderbilt Margaret Radin, Professor of Law, Stanford University Clifford Lynch, Executive Director, Coalition for Networked Information

10/14/99Besser--methodology The UCB Mellon Grant- (Comparing MESL User Interfaces) (Comparing MESL Search Discrepancies) (Assessing Museum Costs) Assessing University Costs Assessing Costs of Slide Libraries Examining Faculty & Student Use & Usefullness

10/14/99Besser--methodology Comparing User Interfaces Presentation and layout Search options Image display and labeling

10/14/99Besser--methodology Cost Assessment Methodology MESL Technical Report Questionnaire –primarily voluntary self-reporting Clarifications and follow-up questions from Berkeley researchers Data Analysis by Berkeley researchers

10/14/99Besser--methodology Museum Cost Centers Content Selection Image Preparation Image Transmission Text/Data Preparation Text/Data Transmission

10/14/99Besser--methodology University Digital Distribution Cost Centers Image Preparation Structured Data Unstructured Data Functionality Security Log Files Outreach Usage Training Technical Development

10/14/99Besser--methodology Slide Library Cost Centers Acquisition Capture (equipment) Data (gathering information) Mounting (data on slide, catalog record) Delivery (controlling access and reshelving) Maintenance

10/14/99Besser--methodology Examining Faculty & Student Use & Usefulness What Faculty Do with Digital Images Major Issues for Faculty Faculty Concerns about teaching with Digital Images Faculty Concerns about Image Quality and Metadata

10/14/99Besser--methodology More Information –UC Berkeley Mellon Grant –Howard Besser –School of Information Mgmt & Systems –UC Berkeley, CA