Citation Impact Trends: Attention, Aggregation, and Relation James Pringle Thomson Reuters 4/14/2010

Attention, Aggregation, and Relation Proxies for value and quality –Citations: attribution, credit, impact, influence –Attention—a more general concept? Aggregates are complex –Researcher: Sum of achievements, with ORCID as identifier? –Institution: Sum of outputs or intellectual capacities? –Journals: Pre-defined aggregates without standard units? –Documents: Standard units in process of disaggregation? Metadata provides a gold mine of link relationships 2

Mining Linked Relationships 3 Funder Funds Acknowledgement Peer Review Grant, P&T Rankings Authorship Researcher Peer Review Manuscript Download Researcher Journal University Co-author Document Cites Is Cited By Data Set Supplementary Material Video Web Editorial Board

Using Citations to Measure Aggregates Journal Aggregates –Impact Factor and variants: Direct measures of journal aggregates –Network-based measures –Cross-field comparisons (“fractional” or “citing-side”) Generalized Aggregate Measures –H-type measures –Normalized impact (citation baselines) 4

5 Analytics Require Normalized Aggregates Relative Impact (InCites™) Evidence (Impact Profiles®) Actual/Expected Citation Rates (InCites™)

6 Network Analysis Organizes Link Relationships Co-funding network (Discovery Logic) Co-citation based disciplinary network: JCR categories mapped (after Leydesdorff )

Portfolio Key Performance Indicators Source: NIAID e-SPA Discovery Logic / IU 7 Multivariate Portfolio Analysis Funding Portfolio Analysis: (Discovery Logic)

Some References Alonsoa, S., et. al., H-Index: A review focused in its variants, computation and standardization for different scientific fields Journal of Informetrics 3 (2009) 273–289. See also updated web site at Bergstrom, Carl, Johan Bollen, Herbert Van de Sompel, Aric Hagberg, Luis Bettencourt, Ryan Chute, Marko A. Rodriguez, Lyudmila Balakireva. “Clickstream data yields high-resolution maps of science”. PLoS One, March Cronin, Blaise, The Hand of Science, The Scarecrow Press, De Moya, F., Description of SciMago journal rank indicator, Pringle, James. Trends in the use of ISI citation databases for evaluation, Learned Publishing, 21, 85–91, doi: / X Using Bibliometrics in Evaluating Research, Moed, H. Measuring contextual citation impact of scientific journals, Georg Frank, Scientific Communication: A Vanity Fair? Science, October 1999, Vol no. 5437, pp. 53 – 55, DOI: /science Leydesdorff, L., Theories of Citation? Scientometrics 43(1), 1998, 5-25 Zitt, M., Small, H., Modifying the Journal Impact Factor by Fractional Citation Weighting: the Audience Factor, JASIST (2008) 59, 11,

9 Thank You!