What is the impact of the publications read by the different Mendeley users? Could they help to identify alternative types of impact? Zohreh Zahedi, Rodrigo Costas & Paul Wouters Centre for Science and Technology Studies (CWTS) ALM Workshop, San Francisco, CA, USA October 10-12, 2013

Outline Introduction Objectives Research Questions Methodology Findings Conclusions, Discussions & Limitations 1

Introduction Altmetrics Tools: Mendeley, Impact Story, altmetric.com, PLOS ALM, F1000, Plum Analytics, …. 2

Previous research Altmetrics & Citation Correlation: Henning (2010);Priem, Piwowar & Hemminger (2012); Bar-Ilan et. al. (2012a & 2012b); Li, Thelwall & Giustini (2012); Li & Thelwall (2012); Zahedi, Costas & Wouters (2013); Mohammadi & Thelwall (2013); Schlögl et. al. (2013); Haustein et.al. (2013a & 2013b) Altmetrics & Citation as predictors: Wardle, 2010 Eysenbach, 2011 Waltman & Costas,

Objectives & Research Questions: To distinguish patterns in terms of impact depending on the types of Mendeley users Q1. What do the different Mendeley users read in terms of document types and Subject fields? Q2. To what extent do the readerships of the different users in Mendeley correlate with citation indicators? Q3. What is the impact of publications read by different users in Mendeley? 4

Methodology (1) Random Samples: 1.20,000 WOS publications from all disciplines between ,000 WOS publications from all disciplines between Metrics: Mendeley & Impact Story APIs 5

Methodology (2) Collecting altmetrics on the basis of DOIs of the publications Using Mendeley & Impact Story APIs Linking and matching with WOS Adding bibliometric indicators Analyzing the data 6

Types of Mendeley users Professors (Associate, Assistant) Lecturers (Senior) Postdocs Researchers (Academics/non-Academics) Students (Bachelor, Master, Postgraduate) PhD/Doctoral Librarian Other professionals Unknown 7

Distribution of readerships in the samples by types of users 8

Modeling impact by Mendeley users:  Scientific: Professors, PhD, Postdocs, Academic Researchers  Educational: Lecturers, Bachelor, Master & Postgraduate Students  Professional: Librarians, Other Professionals, non Academic Researchers  Unknown: unidentified users 9 Sample 1

What document type are more read by the different users? (sample 1) 10

Which fields are more read by types of users?(sample 1) 11

Which fields are more cited/read per publication?(sample 1) 12

Which fields are more cited/read per publication? (sample 2) 13

To what extent do the different types of users in Mendeley correlate with citation indicators? Correlation ReadersUnknownPhDsPostDocsStudentsResearchers ProfessorsOther ProfessionalLibrarianLecturers Sample 1 Citations 0,520,510,460,430,340,150,090,02-0,01 Sample 2 0,350,330,290,240,220,10,030,04-0,01 14 Correlation ReadersUnknownScientificEducationalProfessional Sample 1 Citations 0.520,510, ,05 Sample 2 0,350,330,

What are the impact of publications read by different types of readers? 15 PP Top 10%

Limitations Access only to the top 3 categories of readers in Mendeley Data collection (time consuming) Speed of use the APIs (API limit) Scalability (limitations for the medium-large scale analysis) Not perfect data matching with WOS (DOIs, ….) 16

Conclusions & Discussions Potential advantage of Mendeley over citations: – for publications from social sciences and humanities – for recent publications [!] Scientific users are more correlated with citations than educational and professional users The other users could help to identify other types of impact: educational, professional [?] Some users tend to read more highly cited papers than others: Postdoc, PhD Students vs Professors Identifying the unknown users can shed some light in detecting these other types of impact Further analysis needs to be done to dig into the content of reading by different types of users 17

Thanks for your attention! 18