1. Webmetrics Workshop American Library Association Chicago, IL June 24, 2004 Martha Kyrillidou Director, ARL Statistics and Measurement Program Association of Research Libraries www.statsqual.org StatsQUAL™

2. www.statsqual.org ARL Roles

3. www.statsqual.org ARL Statistics and Measurement …To describe and measure the performance of research libraries and their contribution to teaching, research, scholarship and community service …

4. www.statsqual.org Web Presence

5. www.statsqual.org Future of New Measures Initiative Incorporation of some new data elements in traditional surveys Development of workshops and consulting services for performance measures Establishment of data gathering and statistical analysis tools

6. www.statsqual.org What do we mean by E-Metrics within ARL? DigiQUAL MINES for Libraries ARL Supplementary Statistics Project COUNTER

7. www.statsqual.org It’s…? “familiar” and digital

8. www.statsqual.org Developing DigiQUAL Survey Items Background: ServQUAL ->LibQUAL ->DigiQUAL –LibQUAL dimensions of library service quality DigiQUAL: 12 themes of DL service quality AccessibilityCollection buildingDL as community for usersCopyright NavigabilityResource use...developersRole of federations InteroperabilityEvaluating collections...reviewersDL sustainability

9. www.statsqual.org Building a Survey (cont.) Customize Survey Issue: Flexibility vs. Standardization

10. www.statsqual.org Implementing Survey - Incentives Issues: must be easily transferable, requires email address - clear IRB

11. www.statsqual.org What is MINES for Libraries™ MINES is a research methodology consisting of a web-based survey form and a sampling plan. MINES measures who is using electronic resources, where users are located at the time of use, and their purpose of use. MINES was adopted by the Association of Research Libraries (ARL) as part of the “New Measures” toolkit in May, 2003. MINES is different from other electronic resource usage measures that quantify total usage (e.g., COUNTER, EQUINOX, E-Metrics, ICOLC Guidelines, ISO and NISO standards) or measure how well a library makes electronic resources accessible (LibQual+TM).

12. www.statsqual.org MINES for Libraries™ Methodology A representative sampling plan, including sample size, is determined at the outset. Typically, there are 48 hours of surveying over 12 months at a medical library and 24 hours a year at a main library. Random moment/web-based surveys are employed at each site. Participation is usually mandatory, negating non- respondent bias, and is based on actual use in real-time. Libraries with database-to-web gateways or proxy re- writers offer the most comprehensive networking solution for surveying all networked services users during survey periods.

13. www.statsqual.org

14. What do we mean by E-Metrics within ARL? DigiQUAL MINES for Libraries ARL Supplementary Statistics Project COUNTER

15. www.statsqual.org

18. Interpreting results from individual libraries in the context of other sites Analysis & Reporting - Issues

19. www.statsqual.org