PUBLONS INTEGRATION INTO AN INSTITUTIONAL REPOSITORY Andrew Heath | Manager, UQ eSpace Dr Amberyn Thomas | Associate Director, Scholarly Communication and Repository Services

It is currently ranked in the top 50 research universities worldwide. The University of Queensland is a comprehensive, research intensive University located in Brisbane, on the east coast of Australia. It is currently ranked in the top 50 research universities worldwide. UQ has 2,800 academic staff, more than 50000 students of which, 13,800 are Research Higher Degree students. Or more blatantly, come and visit next year for the OR 2017 conference.

UQ eSpace 145088 Journal articles 49914 Conference papers 6852 Books 14409 Book Chapters 17282 Theses To provide context for the Publons pilot project, I will give a brief overview of our institutional repository, UQ eSpace. eSpace is ranked in the top 25 of world repositories in the current Ranking Web of Repositories. eSpace is managed and developed by the Library and currently uses Fedora/Fez software. It is a comprehensive repository that is the single authoritative source for the research outputs of the staff and students of the University of Queensland UQ eSpace serves to raise the visibility and accessibility of UQ publications and provides data for mandatory Government reporting requirements such as Excellence in Research for Australia (ERA) as well as for a range of internal UQ systems. It also operates as a repository for open access publications, research datasets, and digitised cultural heritage materials including manuscripts, print materials, photographs, audio materials, and other non-traditional research outputs. UQ eSpace is also the central store of researcher identifiers and associated permissions, particularly ORCID. UQ eSpace is more than a repository but rather a Current Research Information System. 7062 Images 35733 Open Access items

eSpace data is also well integrated with a range of UQ systems

As Repository Managers we attempt to anticipate and meet the needs of researchers and academic leaders of the University. This has meant that we have focussed on the development of tools that support researchers needs to not only record publications and deposit open access materials, but also to monitor and benchmark their performance and demonstrate achievements. An example of this the Author Statistics app which is closely integrated with UQ eSpace. This provides a hook to encourage use of the repository. UQ eSpace is also the central store of researcher identifiers and associated permissions, particularly ORCID.

Author Statistics The UQ Author Statistics app is has been developed to leverage the value of content in the repository and provide a range of metrics in a single place. The application reports on and visualises a range of impact data available in UQ eSpace, including citation and benchmarking data from the Web of Science, Incites and the Scopus custom dataset. This application attempts to gather information is assist researchers in understanding aspects of their publication performance.

Why is peer review important to researchers? Peer review is a core component of a researcher’s role. Peer review activity is evidence of a researchers service to the community, and is external validation that academic editors deem the researcher to be an expert in their field. Until recently, it was not possible for a researcher to independently report on or for a university to accurately know about the peer review activity of their researchers. At the same time, funding bodies are starting to consider outputs other than the published articles in assessments of a researchers and institutions. The Australian Research Council’s (ARC) Excellence in Research Assessment already includes “non­-traditional research outputs”, and there is an opportunity to include peer review activity in their assessments. What is Publons? Publons is a website that works with peer reviewers, editors, and publishers to motivate reviewers by giving credit for peer review. For peer reviewers, Publons provides a way to get credit for their contributions (without breaking reviewer anonymity) in a format they can include in promotion and funding applications. Peer Reviewers can register and provide information about their peer reviewing activity that is then verified by Publons. This allows for the creation of a publisher-independent profile in order to demonstrate experience and expertise.

Publons provides a profile of researchers Lists editorships

Lists each review by year and journal title Provides summary statistics including visualisation of reviews over time and by distribution of impact factors

Total reviews over time

So, is Publons 'accurate' and 'comprehensive'? Authors need to send their reviewing acknowledgement emails and the process of checking is semi-automated at Publons. Once verified the results are displayed in researcher’s profiles. Publons is however developing partnerships with a range of publishers to automatically capture reviewing activity and to report reviewing activity independently. Publons is also partnered with ORCID

Gratuitous snot

So, why what was the motivation for an institutional repository to get involved with a pilot to integrate promote and integrate Publons data in UQ eSpace UQ researchers were already represented in Publons, indicating that there may be wider interest in recording and being recognised for peer review activity There was a good fit for the data in the existing Author statistics app and there is the potential to integrate the data in other UQ systems such as Workload Tool and for Academic Portfolios The company indicated an interest in doing a trial It provided another hook to encourage registration and linking of ORCID ID to eSpace Project approved at UQ in late 2015 and development work begun Publons agreed to develop an API and allow access. It was agreed that the method of linking via ORCID alone UQ Developers undertook to create an application to allow linking of Publons accounts via ORCID, nightly data capture, UQ Tiered Journal matching + UQ data visualisations

Selling Points to Researchers Develop a comprehensive and independently verified picture of your peer reviewing activity Allow you to use peer review activity as part of promotions applications Demonstrate peer reviewing workloads to your employer Demonstrate your relationship with influential and important journals in your field Follow discussions about your papers where reviews are open Selling points to researchers: Why get a Publons account?

How do researchers register and link? We have developed an app that allows for the creation and linking of various ID’s to our repository. This allows researchers to link IDs to eSpace and obtains the relevant permissions required.

2 options are presented. To create a Publons account (using ORCID as the logon) To adjust the setting in the users Publon account to include an ORCID This allows eSpace to use Publons API to harvest reviewing activity. How does it work? Nightly download of data from Publons using ORCID as the identifier and matched to the UQ Tiered Journal list

This slide shows how Publons data is presented in the Author Statistics app List of peer reviews by date matched to the UQ Tiered Journal list (a bit like JIF)

Peer Reviews visualised by UQ Tiered list broken down by year

Registered Researchers RESULTS 175 Registered Researchers 3227 Reviews Results - number of Researchers signed up  and number of reviews recorded

RESEARCHER FEEDBACK As I do a lot of reviews I am quite a fan of Publons and I am pleased to see it being integrated into more UQ systems. The value for me is that when I claim that I provide service to the discipline by doing paper reviews I am now able to substantiate this claim with evidence. This is useful for annual performance appraisals and promotion committees. –Associate Professor “I think it would be a good addition if it would be made available to other UQ systems: reviewing does take up time and is an important part of the scientific process and it would be great if there was an official way of receiving credit for it in the UQ system.” –Research Fellow “A good way to record the review work I did…. I fully support the idea of made it available to other UQ systems as the review I completed are engagement/contribution to the field and these outcomes should be counted towards my workload.” –Lecturer Some comments

RESEARCHER FEEDBACK The Author Stats provided by UQ allows me to visualise the Publons data in a different way to the publons website and this is very helpful. It would be useful if this could be integrated into systems like the workload tool and the Q-index. –Associate Professor “as with the Author Statistics site in general, I find this integration both very useful and very well implemented.” –Research Fellow “I would definitely support its integration with other UQ systems as it provides a record of relevant academic contribution (and time spent therein).” –Associate Professor More comments

FUTURE Ongoing promotion via librarians Full evaluation, including survey Investigate organisational interest in including Publons data in other UQ systems