TIPS WHEN USING BIBLIOMETRICS UNITED KINGDOM OCTOBER 2010.

Slides:



Advertisements
Similar presentations
Assessing and Increasing the Impact of Research at the National Institute of Standards and Technology Susan Makar, Stacy Bruss, and Amanda Malanowski NIST.
Advertisements

Using Incites to evaluate Research Performance Advanced
Presented by: Michael A Mabe Director ofVisiting Professor Academic Relations Dept Information Science Elsevier City University, London Globality & Disciplinarity.
IDENTIFYING HOT BRAZILIAN SCIENCE AND TECHNOLOGY: TECH MINING METHODS FOR RELATING SOURCES OF KNOWLEDGE AND EMERGING RESEARCH AREAS EU-SPRI CONFERENCE,
Research evaluation at CWTS Meaningful metrics, evaluation in context
INCITES PLATFORM NATIONAL OCEANIC AND ATMOSPHERIC ADMINISTRATION (NOAA)
3. Challenges of bibliometrics DATA: many problems linked to the collection of data FIELDS – DISCIPLINES : various classifications, not satisfactory INDICATORS.
Håkan Carlsson Gothenburg University Library Bibliometrics – A Tool in the Evaluation of Science.
Bibliometrics overview slides. Contents of this slide set Slides 2-5 Various definitions Slide 6 The context, bibliometrics as 1 tools to assess Slides.
Informing Collection Development through Citation Examination of the Civil Engineering Research Literature Scott Curtis University of Missouri – Kansas.
1 Using metrics to your advantage Fei Yu and Martin Cvelbar.
THE ROLE OF CITATION ANALYSIS IN RESEARCH EVALUATION Philip Purnell September 2010.
T H O M S O N S C I E N T I F I C Editorial Development James Testa, Director.
Slovenian Science in Scopus Zaida Chinchilla-Rodríguez Instituto de Políticas y Bienes Públicos - CSIC. SCImago Research Group. Faculty of Social Sciences.
Journal Impact Factors and H index
The Changing Role of Intangibles over the Crisis Intangibles & Economic Crisis & Company’s Value : the Analysis using Scientometric Instruments Anna Bykova.
Scientometric study of CSIR-NAL Scholarly Literature.
SCIENTIFIC SOLUTIONS Searching for Value in a Changing Research Environment Patricia Brennan Academic & Government Product Development Thomson Scientific.
Welcome to Scopus Training by : Arash Nikyar June 2014
The Profile (Google Scholar Citations) May 2015 Prof Hiran Amarasekera University of Sri Jayewardenepura Japura Media.
R. LAKSHMI MLIS – Final Year Student.  Publication productivity of any literature is the index to know the growth of that science. Measuring the publication.
Standards in science indicators Vincent Larivière EBSI, Université de Montréal OST, Université du Québec à Montréal Standards in science workshop SLIS-Indiana.
Bibliometrics toolkit: ISI products Website: Last edited: 11 Mar 2011 Thomson Reuters ISI product set is the market leader for.
Impact factorcillin®: hype or hope for treatment of academititis? Acknowledgement Seglen O Per (BMJ 1997; 134:497)
THOMSON SCIENTIFIC Patricia Brennan Thomson Scientific January 10, 2008.
Web of Science® Krzysztof Szymanski October 13, 2010.
ISC Journal Citation Reprots تقارير استنادية للمجلات Mohammad Reza – Ghane Assistant Prof. in Library and Information Science & Director of Research Department.
Journal Impact Factors: What Are They & How Can They Be Used? Pamela Sherwill, MLS, AHIP April 27, 2004.
A Bibliometric Analysis of Greek Scientific Publications Υπέρτιτλος………… ……………………… Ευάγγελος Μπούµπουκας | Διευθυντής ΕΚΤ A Bibliometric Analysis.
An overview of main bibliometric indicators: Dag W. Aksnes Data sources, methods and applications Nordic Institute for Studies in Innovation, Research.
The use and abuse of citations Robert West & Kerstin Stenius
Bibliometrics for your CV Web of Science Google Scholar & PoP Scopus Bibliometric measurements can be used to assess the output and impact of an individual’s.
1 International Open Access Week St. Lukes Campus, University of Exeter, 25 th October 2012.
Maximizing Library Investments in Digital Collections Through Better Data Gathering and Analysis (MaxData) Carol Tenopir and Donald.
Bibliometrics toolkit Website: xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx Further info: xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx Scopus Scopus was launched by Elsevier in.
RESEARCH EVALUATION - THE METRICS UNITED KINGDOM OCTOBER 2010.
Bibliometrics and Publishing Peter Sjögårde, Bibliometric analyst KTH Royal Institute of Technology, ECE School of Education and Communication in Engineering.
Karin Henning Bibliometric Services Gothenburg University Library Bibliometrics – an introduction to indicators and analyses.
Web of Science: The Use & Abuse of Citation Data Mark Robertson & Adam Taves Scott Library Reference Dept.
1 RUSSIAN SCIENCE UNDER THE MICROSCOPE Philip Purnell Moscow, October 2013.
RESEARCH EVALUATION WORKSHOP The use of bibliometrics for research evaluation Dr Guillaume Rivalle Product Specialist.
Bibliometrics in support of research strategy & policy Anna Grey and Nicola Meenan.
Assessing Hyperthermia and Cancer Research Productivity Shu-Wan Yeh 1 *, Shih-Ting Hung 1, Yuan-Hsin Chang 1, Yee-Shuan Lee 2 and Yuh-Shan Ho 1# 1 School.
Writing scientific papers and publishing your research 1) Writing a paper helps you identify missing information 2) Helps develop new ideas 3) Documents.
Publication Pattern of CA-A Cancer Journal for Clinician Hsin Chen 1 *, Yee-Shuan Lee 2 and Yuh-Shan Ho 1# 1 School of Public Health, Taipei Medical University.
THE BIBLIOMETRIC INDICATORS. BIBLIOMETRIC INDICATORS COMPARING ‘LIKE TO LIKE’ Productivity And Impact Productivity And Impact Normalization Top Performance.
Measuring Research Impact Using Bibliometrics Constance Wiebrands Manager, Library Services.
Bibliometrics at the University of Glasgow Susan Ashworth.
CitEc as a source for research assessment and evaluation José Manuel Barrueco Universitat de València (SPAIN) May, й Международной научно-практической.
Conclusions  A high percentage share of meeting abstracts (36%) and a low percentage share of articles (40%) was found in the ten journals in the category.
INTRODUCTION TO BIBLIOMETRICS 1. History Terminology Uses 2.
Tools for Effective Evaluation of Science InCites David Horky Country Manager – Central and Eastern Europe
CHALLENGES 1.
Bibliometrics toolkit: Thomson Reuters products
Influence of UK Academic Research in Biochemistry
Bibliometric Analysis of Herbal Medicine Publications, 1991 to 2004
The use and abuse of citations
Altmetrics: Analysis of Library and Information Science (LIS) Research in the Social Media Ifeanyi J. Ezema (Ph.D) Paper Presented at the 1st International.
DECIDING PERTINENT CITATIONS IN PUBLISHED EMPIRICAL ARTICLES
Turning Your Research Into Publications
Bibliometric Analysis of Water Research
Scott Curtis University of Missouri – Kansas City
Indication of Publication Pattern of Scientometrics
Bibliometric Analysis of Process Safety and Environmental Protection
Bibliometric Analysis of Quality of Life Publication
Writing scientific papers and publishing your research
Performance of Cancer Research in Taiwan
Scientometrics of Horizontal Gene Transfer Research during
How good is our research? New approaches to research indicators
Qualities of a Good Researcher
Presentation transcript:

TIPS WHEN USING BIBLIOMETRICS UNITED KINGDOM OCTOBER 2010

USING BIBLIOMETRICS IN CITATION ANALYSIS The Development of Publication and Citation Analysis Bibliometrics and Peer Judgment: A Two-Pronged Approach

ONE: CONSIDER WHETHER AVAILABLE DATA CAN ADDRESS THE QUESTION Large data sets (nations, regions, large institutions) Engineering & Applied Sciences Fundamental & Basic Sciences Small data sets (small departments, individual researchers) Low Confidence Moderate Confidence High Confidence Social Sciences Individual Medical Country

TWO: CHOOSE PUBLICATION TYPES, FIELD DEFINITIONS AND YEARS OF DATA Publication types –Research Articles –Notes –Review articles Field definitions –Difficulties with characterization Time frame –Citation lag

THREE: DECIDE ON WHOLE OR FRACTIONAL COUNTING 68 authors 17 institutions 18 citations

FOUR: JUDGE WHETHER DATA REQUIRE EDITING TO REMOVE ARTIFACTS Artifacts of variation –Institution names Heidelberg Univ, Heidelberg Univ Clin, Heidelberg Univ Educ, Heidelberg Univ Hosp, Heidelberg Univ I, Heidelberg Univ II, Univ Heidelberg, Univ Heidelberg BZH, Univ Heidelberg Cardiol, Univ Heidelberg Clin, Univ Heidelberg Hosp, Univ Heidelberg Hosp & Clins, Univ Heidelberg J5, Univ Heidelberg Klinikujm, Univ Heidelberg Klinikum, Univ Heidelberg Mannheim, Univ Heidelberg Miriam Roehrig, Univ Heidelberg Neuebheimer Feld, Univ Heidelberg ZMBH, Univ Heidelburg, Univ Heilderberg, Univ Hosp Heidelberg, Univ Hosp Heidelberg Mannheim, Univ Klin Heidelberg, Univ Klin Heidelburg, Univ Klinikum Heidelberg, Univ Klinikum Heidelbert, Univ Klinikum Heidelburg, Univ Klinikum Heiderlberg –Author names Is ROTHWELL N different from ROTHWELL NJ? LEE S returns 14,022 publications; SUZUKI T (21,462)

…ARTIFACTS contd. COMMON OBJECTIONS TO CITATION COUNTS Negative citations Over citations –Reviews –Methods Self-citation and citation circles

FIVE: COMPARE LIKE WITH LIKE Impact Factor

FIVE: COMPARE LIKE WITH LIKE Different citation behaviour between categories Even within the same category: –Age of paper –Age and stage of author’s career

SIX: USE RELATIVE MEASURES – NOT JUST ABSOLUTE COUNTS Absolute counts –Total publications –Papers published per year on average –Papers published in top journals (various definitions) –Total citations received Relative counts –Citations per paper compared with field average –Citations versus expected citations –Cited vs un-cited papers compared with average –Rank within field or peer group

EIGHT: RECOGNIZE THE SKEWED NATURE OF CITATION DATA Citation distribution is always skewed –Few highly cited papers –Majority cited little or not at all Distribution type –Always distorted –Human decision E.g. Criticality

TREAT CITATION ANALYSIS AS A SCIENTIFIC STUDY Are the data collected relevant to the question? Are the results reasonable? Follow scientific process for evaluating data Apply scientific skepticism