Brinley Franklin and Terry Plum August 18, 2005 Successful Web Survey Methodologies for Measuring the Impact of Networked Electronic Services (MINES for LibrariesTM) Brinley Franklin and Terry Plum August 18, 2005

Overview Issues in Web-Based Surveys Open Access – Beyond Vendor Supplied Data An Infrastructure of Assessment The Assessment Gateway MINES for LibrariesTM MINES for LibrariesTM in North American Libraries

Issues in Web-Based Surveys Vendor Supplied Data International Standards for vendor supplied data (like Project Counter) are helpful and trusted Vendor supplied data tends to be gross usage counts Usage Surveys Can go beyond gross usage counts using sampling Have sets of issues that must be addressed (see, for example, Holly Gunn, “Web-based Surveys: Changing the Survey Process”, First Monday, Issue 7, 2002 and D.A. Dillman, Mail and Internet Surveys, The Tailored Design Method. 2nd ed., 2000)

Open Access -- Beyond Vendor Supplied Data ISO standards for the electronic collection include e-books, electronic databases, ejournals, and digital documents. Free internet resources are counted separately. Other electronic resources are important, including: Digital libraries Pre-print and post-print servers Open access journals Open access repositories (e.g., institutional repositories)

An Infrastructure of Assessment

The Assessment Gateway

MINES for LibrariesTM MINES is a transaction-based research methodology consisting of a web-based survey form and a random moments sampling plan. MINES typically measures who is using electronic resources, where users are located at the time of use, and their purpose of use. MINES was adopted by the Association of Research Libraries (ARL) as part of the “New Measures” toolkit in May, 2003. MINES is different from other electronic resource usage measures that quantify total usage (e.g., Project COUNTER, E-Metrics) or measure how well a library makes electronic resources accessible (LibQual+TM).

MINES for LibrariesTM

Demographics by Location of User U.S. Main Libraries MINES for Libraries™ Demographics by Location of User U.S. Main Libraries Inside the Library n = 9,172 On Campus, Not in the Library n = 6,391 Off-Campus n = 4,953

MINES for Libraries™ Demographics by Location of User U.S. Medical Libraries On Campus, Not in the Library n = 19,582 Off-Campus n = 5,133 Inside the Library n = 6,819

MINES for LibrariesTM Demographics by Location of User Ontario Council of University Libraries On Campus, Not in the Library n = 7,090 Inside the Library n = 4,047 Off-Campus n = 9,163

Location of Electronic Resources Users MINES for LibrariesTM Location of Electronic Resources Users U.S. Main Libraries Total Users n = 25,698 U.S. Medical Libraries Total Users n = 31,883 OCUL (Canada) Libraries Total Users n = 20,300

Successful Web Survey Methodologies for Measuring the Impact of Networked Electronic Services (MINES for LibrariesTM) brinley.franklin@uconn.edu terry.plum@simmons.edu http://www.minesforlibraries.org