The Empty Chair at the Metrics Table Discussing the absence of educational impact metrics and a framework for their creation Lauren Ashby: Associate Editor,

Slides:

Advertisements

Similar presentations

Farmer School of Business Discussion of The Acceptance and Adoption of Continuous Auditing by Internal Auditors: A Micro Analysis Douglas Havelka Farmer.

Advertisements

Usage statistics in context - panel discussion on understanding usage, measuring success Peter Shepherd Project Director COUNTER AAP/PSP 9 February 2005.

How can I find the number of times a work has been cited by other authors?

An application of semantic linkage technique within a CRIS Sergey Parinov, Central Economics an Mathematics Institute of RAS, Moscow.

CrossRef Linking and Library Users “The vast majority of scholarly journals are now online, and there have been a number of studies of what features scholars.

The building blocks What’s in it for me? Bibliometrics – an overview Research impact can be measured in many ways: quantitative approaches include publication.

MAIN MESSAGE key reasons enumerated ->please read speaker notes Research. Report. Reposit. Deposit your scholarly research - it’s as easy as 1, 2, 3 id.

CURTIN UNIVERSITY LIBRARY Curtin University is a trademark of Curtin University of Technology CRICOS Provider code 00301J July 2014 Tell your impact story:

Institutional repositories and libraries : being visible Nor Edzan Che Nasir Library University of Malaya.

Presenting your track record for ARC proposals Mariella Herberstein: Mary Spongberg:

Measuring Scholarly Communication on the Web Mike Thelwall Statistical Cybermetrics Research Group University of Wolverhampton, UK Bibliometric Analysis.

Bibliometrics overview slides. Contents of this slide set Slides 2-5 Various definitions Slide 6 The context, bibliometrics as 1 tools to assess Slides.

Aims Correlation between ISI citation counts and either Google Scholar or Google Web/URL citation counts for articles in OA journals in eight disciplines.

Secondary Data Sources & Secondary Analysis

1 Using metrics to your advantage Fei Yu and Martin Cvelbar.

Using Journal Citation Reports The MyRI Project Team.

The Student Experience Project Overview for Kosovo Higher Education visit Mark Wilkinson October 2014.

SCOPUS AND SCIVAL EVALUATION AND PROMOTION OF UKRAINIAN RESEARCH RESULTS PIOTR GOŁKIEWICZ PRODUCT SALES MANAGER, CENTRAL AND EASTERN EUROPE KIEV, 31 JANUARY.

Doctor of Education (EdD). Programme Objectives March EdD Program 1  The Doctor of Education (Ed.D) is designed to produce high quality academics.

Journal level impact assessment a diversity of new metrics Sarah Huggett Publishing Information Manager, Scientometrics & Market Analysis, Research & Academic.

STUDENT-CENTERED VALUE RESEARCH Assessment activities of the UNT Libraries Sian Brannon, Ph.D. Kathleen Murray, Ph.D. UNT Libraries May 2, 2013.

Providing Access to Your Data: Tracking Data Usage Robert R. Downs, PhD NASA Socioeconomic Data and Applications Center (SEDAC) Center for International.

GL14 - Fourteenth International Conference on Grey Literature National Research Council Rome, Italy November 2012 Rosa Di Cesare, Marianna Nobile.

Impact, measurement and funding Jane Tinkler RENU RESEARCH EXCELLENCE AND FUNDING 28 APRIL 2015.

UCL LIBRARY SERVICES Open Access publishing tools and services Dr Paul Ayris Director of UCL Library Services and UCL Copyright Officer President of LIBER.

Journal Usage Statistics Portal (JUSP) Adding value and assessing impact through a collaborative approach to service development and delivery Angela Conyers.

Rajesh Singh Deputy Librarian University of Delhi Research Metrics Impact Factor & h-Index.

Group 1 Case Study Presentation Proposal for Open Access (OA) Library Leadership Institute 2014.

The Open Access Continuum: Open Research and Altmetrics Michelle Willmers Scholarly Communication in Africa Programme CC-BY-SA.

Providing Access to Your Data: Tracking Data Usage Robert R. Downs, PhD NASA Socioeconomic Data and Applications Center (SEDAC) Center for International.

Bibliometrics and Impact Analyses at the National Institute of Standards and Technology Stacy Bruss and Susan Makar Research Librarians SLA Pharmaceutical.

2 Journals in the arts and humanities: their role and evaluation Professor Geoffrey Crossick Warden Goldsmiths, University of London.

Login / Upload / Share Deposit your scholarly research - it’s as easy as 1, 2, 3 MAIN MESSAGE key reasons enumerated ->please read speaker notes id / who.

Information Services Academic Services Librarian Support for HDR Researchers Cheryl Stevens Academic Services Librarian (Arts, Education, & Business) Scholarly.

SCIENCE, RESEARCH DATA, AND PUBLISHING Stewart Wills Editorial Director, Web & New Media, Science 26 February 2013.

SCOPUS AND SCIVAL EVALUATION AND PROMOTION OF UKRAINIAN RESEARCH RESULTS PIOTR GOŁKIEWICZ PRODUCT SALES MANAGER, CENTRAL AND EASTERN EUROPE LVIV, 11 SEPTEMBER.

DRJI Directory of Research Journals Indexing Presenter: Elnaz Faraji, Kowsar Corp.

Measuring Value and Outcomes of Reading Dr. Carol Tenopir University of Tennessee

An African framework for e- knowledge Buhle Mbambo University of Zimbabwe Harare Zimbabwe.

Where Should I Publish? Journal Ranking Tools eigenfactor.org SCImago is a freely available web resource available at This uses.

Bibliometrics for your CV Web of Science Google Scholar & PoP Scopus Bibliometric measurements can be used to assess the output and impact of an individual’s.

Why publishing (and publishing in European Urology) is important for you Christian Gratzke Associate Editor European Urology How to Write a Manuscript.

A Challenge of Research Outputs in GL Circuit: From Open Access to Open Use Sergey Parinov, Central Economics an Mathematics Institute of RAS (Moscow);

Presenter: Thanaletchumi Dharmalingam Information Technology Officer Malaysia Citation Centre Ministry of Higher Education Malaysia Increasing Visibility.

 Depending on what kind of paper you are writing determines which format you use. Your professor or teacher will also direct which format they want to.

Weaving Data into the Scholarly Information Network UNECE Work Session on the Communication of Statistics OECD Conference Centre, Paris June 30 - July.

Supporting further and higher education UK LOCKSS Pilot Programme Hazel Woodward Cranfield University & JISC.

Making use of (alt)metrics Phill Jones, PhD Head of Publisher Outreach @altmetrics.

Subject indexing of a library-published open access journal

Carla Basili - Luisa De Biagi Carla Basili * - Luisa De Biagi * * IRCrES Institute, Rome (IT) *CNR –IRCrES Institute, Rome (IT) Central Library ‘G. Marconi’,

DE GRUYTER OPEN PUBLISHING PROPOSAL 2January 2016Publishing Proposal.

Jason Eury, Brandon Rodriguez, and Lauren Kalaw.  Business/Economics Librarian.

Developing a Work Based Portfolio

A framework to improve evidence-informed decision-making in health service management Ph.D Candidate in Health Care Management Tabriz University of Medical.

Evaluating Collections – EBSS Current Topic Facilitator: Dana Peterman Librarian for Education, Psychology, and Cognitive Sciences at UC-Irvine December.

Altmetrics CAS Scholarship Day March 24, 2015 Betty Landesman Head of Technical Services and Content Management Langsdale Library.

EERQI Final Conference, Brussels, March 2011 This project is funded by the Socioeconomic Sciences and Humanities Section. EERQI Innovative Indicators.

Where Should I Publish? Journal Ranking Tools

Rob van der Bliek Mark Robertson

Strategies to Address Research Opportunity and Performance Evidence (ROPE)/Track Record: ARC Discovery Projects Weighting of Selection Criteria to Obtain.

Warwick Journal of Education – Transforming Teaching

Sociology / Anthropology Library Workshop Graduate Students

© The Author(s) Published by Science and Education Publishing.

Research impact and library support

Concepts and Practices December 17, 2015 Janice Winkler

What, why and best practices in open research

Research impact and library support

Measuring Your Research Impact

© The Author(s) Published by Science and Education Publishing.

EERQI Innovative Indicators and Test Results

Presentation transcript:

The Empty Chair at the Metrics Table Discussing the absence of educational impact metrics and a framework for their creation Lauren Ashby: Associate Editor, SAGE Publications Mathias Astell: Marketing Manager, Nature Publishing Group

Why are we here? Currently no metrics which focus on the educational impact of scholarly outputs We propose the creation of a quantitative metric for educational impact

Questions 1. Who are the audiences of scholarly outputs? 2. What potential measures of educational impact currently exist? 3. What would an educational metric look like, and how might it be used?

Who are the audiences of scholarly outputs?

Research focus in representing audiences

The Rest of the Picture Practitioners Students (School, Further and Higher Education) Teachers The journal as a university JournalTextbook Monograph ReaderHandbookThesis Web Resource SlidesVideos Researcher XXXXXXX Practitioner XXXXXX Student XXXXXXXXX Teacher XXXXXX

What potential measures of educational impact currently exist?

Online Syllabi and Reading Lists Homa, N. et al. (2013) “An Analysis of Learning Objectives and Content Coverage in Introductory Psychology Syllabi”, Teaching of Psychology, 40(3). “...evidence from this research indicates that online syllabus citations are useful sources of evidence about educational value...” Kousha, K. & Thelwall, M.(2008) "Assessing the impact of disciplinary research on teaching: An automatic analysis of online syllabuses." Journal of the American Society for Information Science and Technology 59(13): p

Usage Publisher Usage Statistics University Library Holdings Usage Data

Other sources Counting of URLs Journal clubs Public and university library holdings Cites in academic presentations Reference management system Dissertation and Thesis Citation Measurement

What would an educational metric look like, and how might it be used?

Blending approaches Data gathered in previous research studies chiefly focused on benefit to researchers - recast techniques to help expressing educational impact Open, not weighted and informational Quantitative for use in qualitative assessments. this information has to be used collectively in order to make a useful assessment of the different ways in which a scholarly output is being used. The benefits: Credit for the creation of more educationally focussed outputs Global awareness of usage of scholarly outputs in education Support creating syllabi - and the post graduate teaching community Students accessing core information more easily Supporting library collection development

In conclusion Our thinking aims to devise a quantitative measure of educational impact: a count of when and how scholarly outputs are used in teaching and learning to better represent and promote these valuable resources.