Ronald L. Larsen May 22, 2014. Trace relationships amongst academic journal citations Determine the popularity and impact of articles, authors, and publications.

Slides:



Advertisements
Similar presentations
Assessing and Increasing the Impact of Research at the National Institute of Standards and Technology Susan Makar, Stacy Bruss, and Amanda Malanowski NIST.
Advertisements

Challenges of OA in the Next Frontier: ALM & Research Impact Assessment Jennifer Lin Product Manager, PLOS.
29/04/2015www.rba.co.uk1 Google Scholar citation indexes Wednesday, 30 th October 2013 London This presentation is licensed under a Creative Commons Attribution.
The building blocks What’s in it for me? Bibliometrics – an overview Research impact can be measured in many ways: quantitative approaches include publication.
Bibliometrics Toolkit Google Scholar (GS) is one of three central tools (the others being ISI and Scopus) used to generate bibliometrics for researchers.
Vermelding onderdeel organisatie May 3, Literature Search IN 3305 Created by Tomas Klos. Edited by Alexandru Iosup. Parallel and Distributed Systems.
Bibliometrics – an overview of the main metrics and products The MyRI Project team.
N EW WAYS TO TRACK SCHOLARLY PRODUCTIVITY : T HE H - AND G - INDICES.
Bibliometrics: Measuring the Impact of Your Publications Jane Buggle Deputy Librarian.
Measuring Research: Impact Factors, Citation Metrics, and "Altmetrics" Can Tweets be more important than a good Impact Factor? Thane Chambers Christina.
CURTIN UNIVERSITY LIBRARY Curtin University is a trademark of Curtin University of Technology CRICOS Provider code 00301J July 2014 Tell your impact story:
OFFICE OF SCHOLARLY COMMUNICATIONS Texas A&M University Libraries Open Access Publishing and Citation Rates: Getting Rewarded by Improving Access to Your.
Committed to making the world’s scientific and medical literature a public resource Leading the next frontier of OA: Filtering, Aggregating, and Evaluating.
Evaluating (Scientific) Knowledge for people, documents, organizations/activities/communities ICiS Workshop: Integrating, Representing and Reasoning over.
Bibliometrics overview slides. Contents of this slide set Slides 2-5 Various definitions Slide 6 The context, bibliometrics as 1 tools to assess Slides.
1 Using metrics to your advantage Fei Yu and Martin Cvelbar.
Using Journal Citation Reports The MyRI Project Team.
Publishing strategies – A seminar about the scientific publishing landscape Peter Sjögårde, Bibliometric analyst KTH Royal Institute of Technology, ECE.
Web of Science Pros Excellent depth of coverage in the full product (from 1900-present for some journals) A large number of the records are enhanced with.
Bibliometrics in Computer Science MyRI project team.
Publication and impact in English
SCOPUS AND SCIVAL EVALUATION AND PROMOTION OF UKRAINIAN RESEARCH RESULTS PIOTR GOŁKIEWICZ PRODUCT SALES MANAGER, CENTRAL AND EASTERN EUROPE KIEV, 31 JANUARY.
Bibliometrics toolkit: ISI products Website: Last edited: 11 Mar 2011 Thomson Reuters ISI product set is the market leader for.
Rajesh Singh Deputy Librarian University of Delhi Research Metrics Impact Factor & h-Index.
Digital Libraries: Redefining the Library Value Paradigm Peter E Sidorko The University of Hong Kong 3 December 2010.
Rajesh Singh Deputy Librarian University of Delhi Measuring Research Output.
LORRIE JOHNSON U.S. DEPARTMENT OF ENERGY OFFICE OF SCIENTIFIC AND TECHNICAL INFORMATION (OSTI) ICSTI TECHNICAL ACTIVITIES COORDINATING (TACC) MEETING OCTOBER.
Altmetrics Gail McMillan, Director CDRS Services.
SCOPUS AND SCIVAL EVALUATION AND PROMOTION OF UKRAINIAN RESEARCH RESULTS PIOTR GOŁKIEWICZ PRODUCT SALES MANAGER, CENTRAL AND EASTERN EUROPE LVIV, 11 SEPTEMBER.
THOMSON SCIENTIFIC Patricia Brennan Thomson Scientific January 10, 2008.
Rome, January 2014 European Commission Information Society and Media General Assembly GALA Game and Learning Alliance The European Network of Excellence.
ISC Journal Citation Reprots تقارير استنادية للمجلات Mohammad Reza – Ghane Assistant Prof. in Library and Information Science & Director of Research Department.
Bibliometrics for your CV Web of Science Google Scholar & PoP Scopus Bibliometric measurements can be used to assess the output and impact of an individual’s.
1 ALLmetrics. Not Altmetrics. Know What is Going on with Your Research Jan Luprich Regional Sales Manager, EBSCO
How to use Bibliometrics in your Career The MyRI Project Team.
CITATION ANALYSIS A Tool for Collection Development and Enhanced Liaison Services Christine Brown and Denis Lacroix.
AltMetrics Bruce Antelman ThinkLoud thinkloud.com Capturing the Buzz.
Bibliometrics toolkit Website: xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx Further info: xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx Scopus Scopus was launched by Elsevier in.
Who’s citing you? Citation tracking tools. Angela Carritt & Juliet Ralph
What’s the difference between altmetrics and other measures of research influence? Exploring alternative metrics, impact factors, and more. Lillian Hoffecker,
Bibliometrics and Publishing Peter Sjögårde, Bibliometric analyst KTH Royal Institute of Technology, ECE School of Education and Communication in Engineering.
Web of Science: The Use & Abuse of Citation Data Mark Robertson & Adam Taves Scott Library Reference Dept.
Scholarly Metrics Tahirah Akbar-Williams, Mark Cyzyk, Robin Sinn The Sheridan Libraries Johns Hopkins University.
Tools for building literature review and measuring research impact Jan. 27, 2016 Mei Ling Lo Math/Computer Science Librarian
Proving Your Value: The Librarian’s Contribution to the Promotion and Tenure Process ACRL 2013.
Understanding Altmetrics and Their Impact on Scholarly Communication Yingting Zhang, Medical Information & Education Librarian Minglu Wang, Data Services.
PROMOTE FOR IMPACT! HOW TO IMPROVE YOUR RESEARCH IMPACT: 30+ TIPS Guus van den Brekel Central Medical Library, University Medical Center Groningen Kolff.
Measuring Your Research Impact Citation and Altmetrics Tools University Libraries Search Savvy Seminar Series April 9 & 10, 2014 Prof. Amanda Izenstark.
THE BIBLIOMETRIC INDICATORS. BIBLIOMETRIC INDICATORS COMPARING ‘LIKE TO LIKE’ Productivity And Impact Productivity And Impact Normalization Top Performance.
Measuring Research Impact Using Bibliometrics Constance Wiebrands Manager, Library Services.
Bibliometrics at the University of Glasgow Susan Ashworth.
CitEc as a source for research assessment and evaluation José Manuel Barrueco Universitat de València (SPAIN) May, й Международной научно-практической.
INTRODUCTION TO BIBLIOMETRICS 1. History Terminology Uses 2.
Role of librarians in improving the research impact and academic profiling of Indian universities J. K. Vijayakumar Ph. D Manager, Collections & Information.
EERQI Final Conference, Brussels, March 2011 This project is funded by the Socioeconomic Sciences and Humanities Section. EERQI Innovative Indicators.
Rob van der Bliek Mark Robertson
Google Scholar and ShareLaTeX
Strategies to Address Research Opportunity and Performance Evidence (ROPE)/Track Record: ARC Discovery Projects Weighting of Selection Criteria to Obtain.
Demonstrating Scholarly Impact: Metrics, Tools and Trends
Measuring Scholarly and Public Impact: Let’s Talk Metrics
Bibliometrics toolkit: Thomson Reuters products
Altmetrics What do they measure?
Citation Analysis Your article Jill Otto InCites Other?
Altmetrics: Analysis of Library and Information Science (LIS) Research in the Social Media Ifeanyi J. Ezema (Ph.D) Paper Presented at the 1st International.
Altmetric Indicators vs. Bibliometric Indicators
How to Improve the Visibility and Impact of Your Research
Advanced Scientometrics Workshop
Metrics: a game of hide and seek
Jason altmetrics an exploratory study of impact metrics based on social media Jason
Qualities of a Good Researcher
Presentation transcript:

Ronald L. Larsen May 22, 2014

Trace relationships amongst academic journal citations Determine the popularity and impact of articles, authors, and publications Gauge the importance of one's work (e.g., for tenure) Assess core journal titles and watershed publications Identify interrelationships between authors Plan retrospective bibliographies Create bibliographies and thesauri Measure term frequencies Extract metrics for scientometric analysis Explore grammatical and syntactical structures of texts Measure usage by readers * Wikipedia

Qualitative validation Peer review (publications, proposals, …) Teaching evaluation (student, CIDDE, …) Awards (grants, professional recognition, …) Patents (engineering, medicine, …) Software (licensing, open source, …) Data (mining, analytics, …)

Quantitative validation Funding (salary, prizes, …) Students (research, fellowships, …) Benchmarks (peers, competitors, …) Reputation (papers, citations, …) Professional recognition Promotion & tenure Impact Ranking

Faculty / Researchers Stay abreast of scholarship in their discipline Identify potential collaborators and competitors Select preferred publication venues Enhance dossier Dean / Department Chair Faculty performance review Promotion and tenure consideration Benchmarking against peers & competitors Positioning within university

Web of Science Scopus Google Scholar Harzing’s Publish or Perish Scholarometer Microsoft Academic Search CiteSeer …

Hirsch’s h-index (2005) – n papers with ≥ n citations

Egghe’s g-index (2006) – greater weight to highly cited papers Contemporary h-index (2006) – greater weight to recent papers Individual h-index (2006) – addresses co-authorship by normalizing citation counts (3 variants include h I, h I,norm, and h m ) AR-index (2007) – introduces age-weighting to h-index (several variants) Multi-authored h-index (2008) – another approach to address co- authorship using fractional paper counts Zhang’s e-index (2009) – another measure to differentiate high citation patterns with similar h-indexes Average annual increase in h-index – reduces effects of career length Google’s i10-index (2011) – number of papers with at least 10 citations confusion

Scopus Harzing’s Publish or Perish No. of papers = 311 Citations = 15,524 h-index = 51 g-index = 122 e-index = hc-index = 34 hI-index = hI,norm = 38 … h-index = 20 h-index = 5 h-index = 51

h-index = 0 h-index = 20 h-index = 5 Harzing’s Publish or Perish No. of papers = 117 Citations = 677 h-index = 14 g-index = 21 e-index = hc-index = 8 hI-index = 9.80 hI,norm = 13 …

Consistency of index computation among bibliometric services Coverage (journals, conferences, books, book chapters, …) Normalization across disciplines Traditions, expectations, and publication venues Accompanying risks… Misalignment of coverage with discipline Indexes underestimate impact Inappropriate aggregation for comparative benchmarks Institutional decision making is flawed

*Kaur, Radicchi, & Menczer, “Universality of scholarly impact metrics” (2013)

* Bollen, Van de Sompel, & Rodriguez, “Towards Usage-based Impact Metrics: First Results from the MESUR Project”

Number of views and downloads HTML, PDF Discussions on social media Facebook, Google+, Twitter, blogs Bookmarked CiteULike, Mendeley Cited Google Scholar, CrossRef, PubMed Central, Scopus, ImpactStory, CitedIn Recommended LinkedIn, Amazon, Pinterest *Wikipedia, Altmetric.com You

Bibliometric research services are … Valuable Seductive Dangerous Good bibliometric research services are … Increasingly important Labor-intensive Hard (even with good tools) University bibliometric research services are … Too vital to leave to others An opportunity for proactive leadership and education A natural domain for libraries and librarians to excel