1. Citation Impact Trends: Attention, Aggregation, and Relation James Pringle Thomson Reuters james.pringle@thomsonreuters.com 4/14/2010

2. Attention, Aggregation, and Relation Proxies for value and quality –Citations: attribution, credit, impact, influence –Attention—a more general concept? Aggregates are complex –Researcher: Sum of achievements, with ORCID as identifier? –Institution: Sum of outputs or intellectual capacities? –Journals: Pre-defined aggregates without standard units? –Documents: Standard units in process of disaggregation? Metadata provides a gold mine of link relationships 2

3. Mining Linked Relationships 3 Funder Funds Acknowledgement Peer Review Grant, P&T Rankings Authorship Researcher Peer Review Manuscript Download Researcher Journal University Co-author Document Cites Is Cited By Data Set Supplementary Material Video Web Editorial Board

4. Using Citations to Measure Aggregates Journal Aggregates –Impact Factor and variants: Direct measures of journal aggregates –Network-based measures –Cross-field comparisons (“fractional” or “citing-side”) Generalized Aggregate Measures –H-type measures –Normalized impact (citation baselines) 4

5. 5 Analytics Require Normalized Aggregates Relative Impact (InCites™) Evidence (Impact Profiles®) Actual/Expected Citation Rates (InCites™)

6. 6 Network Analysis Organizes Link Relationships Co-funding network (Discovery Logic) Co-citation based disciplinary network: JCR categories mapped (after Leydesdorff )

7. Portfolio Key Performance Indicators Source: NIAID e-SPA Discovery Logic / IU 7 Multivariate Portfolio Analysis Funding Portfolio Analysis: (Discovery Logic)

8. Some References Alonsoa, S., et. al., H-Index: A review focused in its variants, computation and standardization for different scientific fields Journal of Informetrics 3 (2009) 273–289. See also updated web site at http://sci2s.ugr.es/hindex/ http://sci2s.ugr.es/hindex/ Bergstrom, Carl, http://www.eigenfactor.org/methods.htmhttp://www.eigenfactor.org/methods.htm Johan Bollen, Herbert Van de Sompel, Aric Hagberg, Luis Bettencourt, Ryan Chute, Marko A. Rodriguez, Lyudmila Balakireva. “Clickstream data yields high-resolution maps of science”. PLoS One, March 2009. Cronin, Blaise, The Hand of Science, The Scarecrow Press, 2005. De Moya, F., Description of SciMago journal rank indicator, http://www.scimagojr.com/http://www.scimagojr.com/ Pringle, James. Trends in the use of ISI citation databases for evaluation, Learned Publishing, 21, 85–91, doi: 10.1087/095315108X288901 Using Bibliometrics in Evaluating Research, http://scientific.thomsonreuters.com/bibliometrics2/http://scientific.thomsonreuters.com/bibliometrics2/ Moed, H. Measuring contextual citation impact of scientific journals, http://arxiv.org/ftp/arxiv/papers/0911/0911.2632.pdf. Georg Frank, Scientific Communication: A Vanity Fair? Science, October 1999, Vol. 286. no. 5437, pp. 53 – 55, DOI: 10.1126/science.286.5437.53 Leydesdorff, L., Theories of Citation? Scientometrics 43(1), 1998, 5-25 Zitt, M., Small, H., Modifying the Journal Impact Factor by Fractional Citation Weighting: the Audience Factor, JASIST (2008) 59, 11, 1856-1860 8

9. 9 Thank You!