Ranking and benchmarking for repositories Janice Chan, Curtin Peter Green, Curtin Stephen Cramond, University.

Slides:

Advertisements

Similar presentations

Search, access and impact: Web citation services Tim Brody Intelligence, Agents, Multimedia Group University of Southampton.

Advertisements

Assessing and Increasing the Impact of Research at the National Institute of Standards and Technology Susan Makar, Stacy Bruss, and Amanda Malanowski NIST.

Research Information Systems Manager, University of Edinburgh

Challenges of OA in the Next Frontier: ALM & Research Impact Assessment Jennifer Lin Product Manager, PLOS.

? Altmetrics in Practice ALM Workshop San Francisco – Oct 10,

Introducing customer experience JISC OA Good Practice Pathfinder End-to-End event – 12 January 2015 Helping to populate repositories – Jisc Publications.

Making scholarly statistics count in UK repositories Ross MacIntyre, Mimas, The University of Manchester UKSG Conference April 2013.

Supporting education and research Open Access in the UK Neil Jacobs, JISC, UK.

3-DAY INSTITUTIONAL REPOSITORY WORKSHOP USING DSPACE FOR MEMBERS OF AUNILO MAY 2009 INSTITUTIONAL REPOSITORIES Nor Edzan Che Nasir UM Library.

Committed to making the world’s scientific and medical literature a public resource Leading the next frontier of OA: Filtering, Aggregating, and Evaluating.

Making scholarly statistics count in UK repositories Paul Needham, Kings Norton Library, Cranfield University 1:AM Altmetrics Conference, September 2014.

IRUS-UK: Improving understanding of the value and impact of institutional repositories Ross MacIntyre, Mimas Service Manager Munin Conference, November.

Cross-institutional Repository Assessment: A Standardized Model for Institutional Research Assessment Robert H. McDonald Indiana University Charles Thomas.

Online Statistics for Australian, New Zealand & Asian Academic Libraries Cathie Jilovsky.

Irus.mimas.ac.uk Institutional Repository Usage Statistics IRUS-UK in practice webinar, 7 th May 2015 Jo Alcock, Evidence Base Alison Sutton, University.

INCITES PLATFORM NATIONAL OCEANIC AND ATMOSPHERIC ADMINISTRATION (NOAA)

Australian Partnership for Sustainable Repositories Benchmark Statistics Service (BEST) What’s going on with Australian repositories?

Release 4 of the COUNTER Code of Practice for e- Resources and new usage- based measures of impact Peter Shepherd COUNTER May 2014.

Irus.mimas.ac.uk Institutional Repository Usage Statistics IRUS-UK: Overview and update 10 March 2014 Balviar Notay, Jisc Ross MacIntyre, Mimas Paul Needham,

Irus.mimas.ac.uk Institutional Repository Usage Statistics IRUS-UK: An introduction 18 March 2015 Ross MacIntyre, Jisc:Mimas Paul Needham, Cranfield University.

The Digital Journal Collection in Libraries -what Libraries Are doing -Impact on Scientists Carol Tenopir University of Tennessee

Outcome Assessment Tools for the Library of the Future ACRL Conference 2005 April 7, 2005 Minneapolis, MN Martha Kyrillidou Director, ARL Statistics.

Measuring impact: tools for analysing and benchmarking usage Jo Lambert Library Assessment Conference, Seattle 4 August 2014.

Extending and measuring reach and impact of research output: #openaccess, social media and “alternative metrics” Nick Sheppard Repository Developer LEEDS.

1 CONCERT 2004 Power to the Librarian Delivering Transparency in the Serials Market Doug McMillan Managing Director Bowker UK Ltd.

SCOPUS AND SCIVAL EVALUATION AND PROMOTION OF UKRAINIAN RESEARCH RESULTS PIOTR GOŁKIEWICZ PRODUCT SALES MANAGER, CENTRAL AND EASTERN EUROPE LVIV, 11 SEPTEMBER.

THOMSON REUTERS RESEARCH IN VIEW Philip Purnell September 2011 euroCRIS symposium Brussels.

THOMSON SCIENTIFIC Patricia Brennan Thomson Scientific January 10, 2008.

Google Scholar as a cybermetric tool Alastair G Smith Victoria University of Wellington New Zealand

5 Ways To Demonstrate Value Using Usage Statistics Jo Alcock CILIP Conference 2015.

Using JUSP to help with the SCONUL return Angela Conyers Evidence Base

Using JUSP to help with the SCONUL return Angela Conyers Evidence Base, Birmingham City University.

"How much?": Aggregating usage data from Repositories in the UK Jo Lambert, Ross Macintyre, Paul Needham, Jo Alcock OR2015.

IRUS-UK: Improving understanding of the value and impact of institutional repositories Ross MacIntyre, Head Library Analytics Services, Jisc NASIG Conference.

AltMetrics Bruce Antelman ThinkLoud thinkloud.com Capturing the Buzz.

VIVO and Scholarly Repositories: Synergistic Opportunities.

LIBRARY SERVICES Strategies for gaining and maintaining academic support for the institutional open access.

Le New Measures Initiative de l’American Library Association (ARL) A CREPUQ 1 février 2005 Montreal, Canada Martha Kyrillidou Director, ARL.

Leveraging a Library CMS and Social Media to promote #openaccess (OA) to institutional research output Nick Sheppard Research Services Advisor LEEDS BECKETT.

Jisc Monitor: Updates on Developments Dr Frank Manista Senior Open Access Support Coordinator Monitor Local and Monitor UK Photo by Kate Ter Haar CC-BY.

The Digital Journal Collection in Libraries - What Libraries Are Doing -Impact on Scientists Carol Tenopir University of Tennessee

MARKO ZOVKO, ACCOUNT MANAGER STEPHEN SMITH, SOLUTIONS SPECIALIST JOURNALS & HIGHLY-CITED DATA IN INCITES V. OLD JOURNAL CITATION REPORTS. WHAT MORE AM.

PIRUS 2 Creating a common standard for measuring online usage of individual articles Paul Needham, Cranfield University Peter Shepherd, COUNTER October.

PIRUS 2 Creating a common standard for measuring online usage of individual articles Ross MacIntyre, Mimas, The University of Manchester Paul Needham,

RepNet/RSP Event: “Supporting and Enhancing Your Repository” 21 st January, 2013 – BCS, London Andrew Dorward.

EdShare, OERs and impact Debra Morris University Library University of Southampton edshare.soton.ac.uk.

Measuring Your Research Impact Citation and Altmetrics Tools University Libraries Search Savvy Seminar Series April 9 & 10, 2014 Prof. Amanda Izenstark.

PIRUS2: Developing a standard for individual article usage statistics Peter Shepherd COUNTER UKSG Annual Conference April 2010.

THE DATA 1. Selection Collection Indexing Organisation 2.

Tools for Effective Evaluation of Science InCites David Horky Country Manager – Central and Eastern Europe

Peter Ingwersen Royal School of Library & Information Science, DK

PIRUS PIRUS -Publisher and Institutional Repository Usage Statistics

2017 Research Repositories Community Day

Jisc Open Access Dashboard

Measuring Scholarly and Public Impact: Let’s Talk Metrics

Bibliometrics toolkit: Thomson Reuters products

Jon Wheeler | Kenning Arlitsch

Institutional Repository at NIO: Inspiration to Implementation

Advanced Scientometrics Workshop

Concepts and Practices December 17, 2015 Janice Winkler

Introducing the IRUSdataUK pilot

EXCLUSIVE TOOLS FOR IMPACTING THE CONFERENCES PROCEEDINGS

24th Annual Conference & Exhibition of the SLA/AGC

Big Data ESSNet WP 1: Web scraping / Job Vacancies Pilot

Digital commons BENCHMARKING

The Nebraska IR: How We Make It Work

LR HEAnet Seminar: 5 December 2018

swimming instead of drowning in data: Usage statistics SIUC

Supporting Open Research

Citation databases and social networks for researchers: measuring research impact and disseminating results - exercise Elisavet Koutzamani

Presentation transcript:

Ranking and benchmarking for repositories Janice Chan, Curtin Peter Green, Curtin Stephen Cramond, University of Melbourne #NotOnTwitter Attribution: MicroAssist 13 Nov 2015

OVERVIEW OF EXISTING TOOLS

CAUL Statistics Total number of OA/restricted/metadata-only items Number of OA/metadata-only items added during reporting year Number of accesses: metadata-only Number of accesses: OA items Inspired by SCONUL Annual Stats collection

Issues Interpretation and definition – what are we counting? Content and collection in IRS differ System limitations – not able to report on all items

Ranking Web of Repositories Publish twice a year by Cybermetrics Lab in Spain since 2008 Indicators

Issues SEO focused Disadvantage several repository platforms Changing methodology, lack of stability Lack of transparency Not measuring usage

Open Access Repository Ranking Open and transparent metric Evaluates repositories assets and service Criteria and max scores: Interoperability 25

Issues Germany, Austria, and Switzerland only Not measuring usage and activities May increase country coverage in but global coverage unlikely. Reviewing criteria in 2016

IRUS-UK Aggregates stats for broad range of UK and [some] Dutch IR's. Allow comparison and benchmarking of performance. COUNTER-compliant so apples are compared with apples. Stats by item type Includes Thesis downloads report

Issues Only supports DSpace, ePrints and "Fedora" at present Not available to ANZ institutions

EMERGING TOOLS

"Measuring Up" Project OCLC Research, ARL, MSU, UNM Web analytics focus Will develop standard web metrics for outcomes-based assessment Will demonstrate relationship between IR's, citations and university rankings. Allow libraries can build more effective business cases for IR initiatives.

bepress benchmarking model Percentile rank – 3 factors – Growth: content added – Breadth: number of collections getting new objects – Demand: download counts, interest

CrossRef DOI Event Tracker Tracking events associated with a DOI Built on PLOS ALM code Production service available mid-2016 Might develop an understanding of relative overall importance of IR downloads within the broader resource discovery ecosystem. tracker-pilot.html tracker-pilot.html

What is missing? Coverage - % of institutional output captured Open Access ratio Quality (beyond ERA metrics) Scope of repository beyond peer reviewed publications Interoperability Demonstrating impact and not just usage

DISCUSSION