Information Retrieval to Informed Action with Research Metrics Thomson Scientific Research Services Group 2007

Science is very dynamic and growing exponentially Research is happening in a global and multidisciplinary context Emerging fields make it difficult to determine relevancy Selectivity becomes more challenging, e.g. how to find the right journals Challenge of Managing and Evaluating Research Keep up to date on new and developing science Nurture new research through direction and funding Measure the impact of scientific efforts Access timely, objective and informed information to make policy and budget decisions Responsibilities of leaders in research

Metrics – How to measure science? Scientists communicate through the literature in academic journals Citations are considered the “coin of the realm” in science Bibliometrics uses statistical analysis to draw a landscape of scientific communication and productivity. Citation analysis: examines the elements of bibliographic records (citations) studies relationships between citations measures the amount of scientific activity in a subject category, journal, country, topic or other areas of interest.

Why Metrics? Uses readily available data Employs transparent and reproducible methodology Provides quantitative information that policy makers can apply to their decision process “If you can measure that of which you speak, and can express it by a number, you know something of your subject; but if you cannot measure it, your knowledge is meager and unsatisfactory” - Lord Kelvin (William Thomson) “If you can measure that of which you speak, and can express it by a number, you know something of your subject; but if you cannot measure it, your knowledge is meager and unsatisfactory” - Lord Kelvin (William Thomson)

Elements of Evaluation using Bibliometric Methods Theory of citation: –Citations are a form of peer recognition Basic measures: –Papers, citations, citations per paper (impact) Relative measures: –impact relative to baselines; –expected citation rates for articles; –percentiles Units of analysis: –papers, authors, institutions, countries, journals Measures of interaction: –research fronts, interdisciplinarity, collaboration

A National view of Turkish Research

Economics informs but citation analysis provides more detail Turkish research motivation is seen in the OECD records on percentage of GDP dedicated to Research & Development. Turkey is surging and soon to exceed Portugal. Source: OECD Factbook 2008 Science and technology - Research and Development (R&D) - Expenditure on R&D Turkey

Research Growth and Impact in Turkey, Turkish research has grown steadily over the last 27 years. On average, Turkey produced over 14,000 scientific papers per year from , with large movement in aggregate citations between 2003 and Source: National Science Indicators, – WOS version

Annual Research Growth in Turkey, In 2003, Turkey broke through to go above 10,000 research papers produced in a single year. Source: National Science Indicators, – WOS version Total Papers

Research Growth in Turkey, , compared to Greece Among the countries in the region, Greece is the closest in publications but continues to lag behind Turkey’s strong growth trend. Source: National Science Indicators, – WOS version Total Papers

Percentage of papers in the world, Source: National Science Indicators, – WOS version Turkey also exceeds Greece in overall contribution to research in the world. % Papers In World

Research in Turkey – Citation Impact Citation impact is the average citation rate: total cites/total papers. Turkey’s average citation rate has risen consistently since the mid-1990’s and is trending to continue its steep movement into the world scientific community. Source: National Science Indicators, – WOS version Baseline=1 Avg. Cite Per Paper

Research in Turkey – Percentage Cited While publication growth is strong, Turkey is still working to exceed Greece in percentage of papers cited. Source: National Science Indicators, – WOS version % of Papers Cited

Turkey: Field Specialization The following 10 fields make up over 85% of Turkish scientific research Source: National Citation Report on the nation of Turkey (ESI),

Turkey: Field Specialization Generally Turkey contributes 1.48% of all world papers in The following fields exceed that level and indicate a national strength for Turkey in world contribution Field % papers in field in the world Agricultural Sciences 2.76 Clinical Medicine 2.62 Engineering 1.94 Plant & Animal Science 1.89 Field % papers in field in the world Ecology/Environment 1.59 Pharmacology1.54 Materials Science1.50 Source: National Science Indicators, , ESI version

Turkey: International Collaboration Turkish research is written more often within the country. Here are the top 20 countries represented in Turkish collaborations since Source: National Citation Report on the nation of Turkey,

Key Universities in Turkish Research

University Publications Source: National Science Indicators customized for Turkish Institutions, These 17 universities published 1000 or more papers over the period This illustrates academic contribution to the national performance

Growth of Publications in Specific Universities Source: National Science Indicators customized for Turkish Institutions, In the period, these 5 leading Turkish universities fit into the mid-range of publication counts for the US, UK, Australia, and Canada university indicators. Ankara University Hacettepe University Instanbul University Ege University Gazi University

Relation of University Strengths to National Strengths Source: National Science Indicators customized for Turkish Institutions, Most active fields for top 5 schools # of papersTurkey overall% of country contribution Agricultural Sciences % Biology & Biochemistry % Chemistry % Clinical Medicine % Ecology/Environment % Engineering % Geosciences % Materials Science % Neurosciences & Behavior % Pharmacology % Physics %

Field Specialization, Source: National Science Indicators customized for Turkish Institutions, Other fields of Turkish strength like Engineering are represented by a unique set of universities.

Growth of Publications in Leading Technical Universities, Source: National Science Indicators customized for Turkish Institutions, Highlight comparisons between Middle East Technical University and Instanbul Tecknick

Engineering subfields at METU Source: National Science Indicators customized for Turkish Institutions, CitesFieldPapersAvg. Cites/Paper 2,845ENGINEERING, CHEMICAL ,426ENGINEERING, BIOMEDICAL ,168ENGINEERING, ELECTRICAL & ELECTRONIC MATERIALS SCIENCE, BIOMATERIALS ENGINEERING, MECHANICAL

Engineering at METU: ChemE journals Source: National Science Indicators customized for Turkish Institutions, JournalCitesPapersAvg. Cites/Paper 2006 Journal Impact factor ENERGY SOURCE TURKISH JOURNAL OF CHEMISTRY CHEMICAL ENGINEERING COMMUNICATIONS FUEL INDUSTRIAL & ENGINEERING CHEMISTRY REESARCH CHEMICAL ENGINEERING SCIENCE ENERGY & FUEL JOURNAL OF FOOD ENGINEERING AIChE JOURNAL MINERALS ENGINEERING

Engineering at METU: Authors in ChemE Source: National Science Indicators customized for Turkish Institutions, CitesAuthorPapersAvg. Cites/Paper Cites2H index C indexAverage Percentile 548DOGU, T668.33, DOGU, G , YILMAZ, L , KOK, MV TOSUN, I HICYILMAZ C BAGCI, S TURKER, L

Engineering at METU: A well cited ChemE paper from Dr. T. Dogu Source: National Science Indicators customized for Turkish Institutions,

Comments Because science is such a dynamic enterprise, no one metric is adequate for evaluation. Evaluation is the culmination of quantitative and qualitative considerations, within a particular environment. Citation analysis can help highlight researchers and the work that impacts the overall impact of an organization, group, or nation. –Examines the elements of publıcatıon records –Studies relationships between citations –Allows for the measurement of the amount of scientific activity in varıous areas, e.g. Organızatıons, nıdıvıduals, journals, subject areas

Thank you!