The world’s libraries. Connected. Satisfaction with Data Reuse: Survey Results from Users of a Social Science Data Archive Society of American Archivists 2013 Research Forum August 13, 2013 New Orleans, LA Adam Kriesberg PhD Candidate, University of Michigan School of Information akriesbe [at] umich [dot] edu
The world’s libraries. Connected. An Institute for Museum and Library Services (IMLS) funded project led by Dr. Ixchel Faniel and Dr. Elizabeth Yakel. Studying data reuse in three academic disciplines to identify how contextual information about the data that supports reuse can best be created and preserved. Focuses on research data produced and used by quantitative social scientists, archaeologists, and zoologists. The intended audiences of this project are researchers who use secondary data and the digital curators, digital repository managers, data center staff, and others who collect, manage, and store digital information. For more information, please visit
The world’s libraries. Connected. DIPIR Project Nancy McGovern ICPSR/MIT Ixchel Faniel OCLC Research (PI) Eric Kansa Open Context William Fink UM Museum of Zoology Elizabeth Yakel University of Michigan (Co-PI) The Research Team
The world’s libraries. Connected. Methods Overview ICSPROpen ContextUMMZ Phase 1: Project Start up Interviews Staff 10 Winter Winter Spring 2011 Phase 2: Collecting and analyzing user data Interviews data consumers 43 Winter Winter Fall 2012 Survey data consumers 2000 Summer 2012 Web analytics data consumers Server logs Ongoing Observations data consumers 10 Ongoing Phase 3: Mapping significant properties as representation information
The world’s libraries. Connected. ICPSR Survey Objective and Structure Research Question: What contributes to data reuse satisfaction and intention to continue using ICPSR data among users of the repository? Survey Structure: 3 Sections 1.Critical (Data Reuse) Incident Section Asked about perceptions of data quality Dependent variable: Satisfaction with data reuse experience 2. Repository Section Asked about experiences using ICPSR Dependent variable: Intention to continue using ICPSR 3. Demographics
The world’s libraries. Connected. ICPSR Survey Development and Administration Instrument Development Adapted items from management and management information systems literature (e.g. Flavian et al., 2006; Lee et al., 2002; Wang and Strong, 1996) Created new items Survey Sample 1,632 first authors of journal articles from the ICPSR Bibliography of Data-Related Literature Survey Administration (May – June 2012) Approximate response rate 16% (usable surveys)
The world’s libraries. Connected. The Data Reusers have contributed data to ICPSR 12% feel there is sufficient data available for reuse in their field 62% mean length of time respondents have been reusing data in research 13 years of research conducted by respondents relies on data collected by others 66%
The world’s libraries. Connected. Demographics: Data Sources Used During Research
The world’s libraries. Connected. Demographics: Data Integrators
The world’s libraries. Connected. Demographics: Job Titles 198 tenure track faculty
The world’s libraries. Connected. Respondents: Academic DisciplinesSociology Medicine/ Public Health Economics Criminology/ Criminal Justice
The world’s libraries. Connected. A Closer Look: Satisfaction by Field
The world’s libraries. Connected. Differences in Satisfaction with the Data Reuse Experience Pairs of Fields Mean Difference Std. ErrorSig. Criminology/Criminal Justice (5.81) & Sociology (6.47) * Criminology/Criminal Justice (5.81) & Medicine/Public Health (6.39) * ANOVA Pairwise Comparisons (* = significant at p < 0.05)
The world’s libraries. Connected. Scopus: Average Journal Ranking by Discipline Academic FieldMean Ranking (SJR)n Psychology Education1.463 Political Science1.565 Economics Sociology Medicine/ Public Health (and allied fields) Criminology/ Criminal Justice Social Work Other1.008 Total
The world’s libraries. Connected. Discussion These results represent a small part a larger survey, but what can they tell us? Different research communities report differing levels of data reuse satisfaction 41% combined data from multiple datasets during research Consistency is key to facilitate this type of work 66% collect their own data, but only 12% contribute to ICPSR Where are these data? How can repositories identify these datasets? Next Steps: Conduct regression analysis to assess main predictors driving satisfaction with data reuse
The world’s libraries. Connected.Acknowledgements Institute of Museum and Library Services LG PI: Ixchel Faniel, Ph.D., OCLC Research Co-PI: Elizabeth Yakel, Ph.D., UMSI Partners: Nancy McGovern, Ph.D. (MIT), Eric Kansa, Ph.D. (Open Context), William Fink, Ph.D. (University of Michigan Museum of Zoology) Julianna Barrera-Gomez, OCLC Diversity Fellow Students: Morgan Daniels, Rebecca Frank, Jessica Schaengold, Gavin Strassel, Michele DeLia, Kathleen Fear, Mallory Hood, Molly Haig, Annelise Doll, Monique Lowe
The world’s libraries. Connected. Questions? Adam Kriesberg akriesbe [at] umich
The world’s libraries. Connected Additional Slides -----
The world’s libraries. Connected. Demographics: Data Source for the Critical Incident SourceFrequencyPercent ICPSR only8031.9% Other source(s)5220.7% ICPSR and other source(s) % Do not remember93.6% n=251
The world’s libraries. Connected. A Closer Look: Satisfaction by Field Field N Mean (Satisfaction) Psychology Education Political Science Economics Sociology Medicine/Public Health (and allied fields) Criminology/Criminal Justice Social Work Other Total