This content is available under a Creative Commons Attribution License

Slides:



Advertisements
Similar presentations
Cathy Jordan, PhD Associate Professor of Pediatrics Director, Children, Youth and Family Consortium University of Minnesota Member, Community Campus Partnerships.
Advertisements

UCSC History. UCSC: A brief history 60s University Placement Committee A lot of field trips/interaction with employers.
Excellence with Impact Declan Mulkeen January 2011.
New promotion and tenure guidelines New peer review processes &
Enter System Name AdvancED TM External Review Exit Report Calhoun County School System Jacksonville, Alabama April 27-30, 2014.
Sharing research data: expectations of research funders Nature Publishing Group meeting 14 November 2014 Dave Carr Wellcome Trust
Options for Evaluating Research: Inputs, Outputs, Outcomes Michele Garfinkel Manager, Science Policy Programme ICSTI ITOC Workshop 19 January 2015, Berlin.
Enter System Name AdvancED TM External Review Exit Report Catalyst High School May 11,12,13, 2014.
Accreditation Engaging in Continuous Improvement.
 HEFCEmetrics. “I can announce today that I have asked HEFCE to undertake a review of the role of metrics in research assessment and management. The.
© 2014 The Regents of the University of Michigan. This work is licensed under the Creative Commons Attribution 4.0 Unported License. To view a copy of.
LIBR 559L – Topics in scholarly communication & publishing, UBC SLAIS, May 26, 2011 Heather Morrison This work.
Leading Change. THE ROLE OF POLICY IN CHANGE Leading Change – The Role of Policy Drift to Quantitative Compliance- Behavior will focus on whatever is.
Page 1 RCUK : PATHWAYS TO IMPACT WHAT IT MEANS AND WHAT TO DO NOW Professor John Marshall Director Academic Research Development CREDO workshop May 2011.
Development of the Strategic Vision and Where We Go From Here? Dan Dooley Vice President.
AdvancED TM External Review Exit Report Polk Pre-Collegiate Academy April 16– 17, 2014.
Research Quality Framework Presentation to APSR - ARROW - Repository Market Day 4 May 2007 Sandra Fox Department of Education Science and Training.
Quality Assurance Review Team Oral Exit Report School Accreditation AUTEC School 4-8 March 2012.
Dr. Salwa B. El-Magoli 16/1/2007Dr.Salwa B. El-magoli Cairo: 16/1/2007 Quality Assurance and Accreditation (The Egyptian Experience) Dr. Salwa B. El-Magoli.
Loudon County Schools External Review Exit Report February 19-21, 2013.
Research Impact Sarah Hall Research Impact Strategy and Policy Manager.
MEASURING RESEARCHERS: FROM RESEARCH PUBLICATIONS AND COMMUNICATION TO RESEARCH EVALUATION Lucie Vavříková 1.
OA Ambassadors Conference, November, 2014 DORA the reformer – prospects for new approaches to research assessment Mark Patterson, Executive Director, eLife.
Measuring Your Research Impact Citation and Altmetrics Tools University Libraries Search Savvy Seminar Series April 9 & 10, 2014 Prof. Amanda Izenstark.
Demonstrating impact as a practitioner- researcher FORCE16 | Portland, OR | Monday, April 18, 2016 Heather Coates IUPUI University Library Center for Digital.
Data Sources & Using VIVO Data Visualizing Science VIVO provides network analysis and visualization tools to maximize the benefits afforded by the data.
The Eugene T. Moore School of Education Working together to promote the growth, education, and social development of children and youth David E. Barrett.
UTS CRICOS PROVIDER CODE: 00099F Big Picture Research Translation, Altmetrics and Impact uts.edu.au Alex Byrnes Research Publication Officer, RIO
Contextualization in English and Reading: A Few Examples
Intellectual Merit & Broader Impact Statements August 2016
REMOVE THIS SLIDE BEFORE PRESENTATION
Our Digital Showcase Scholars’ Mine Annual Report from July 2015 – June 2016 Providing global access to the digital, scholarly and cultural resources.
Instructional Leadership for a Professional Learning Culture:
Measuring Scholarly and Public Impact: Let’s Talk Metrics
New Faculty Orientation Provost’s Report August 22, 2016
University Career Services Committee
SHARE: A Public Good to Increase Scholarly Innovation
Assessing the impact of SSH: The Dutch approach
NSF/NIH Review Processes University of Southern Mississippi
Research Translation: Lessons from Dissemination and Implementation Research for Interventions Promoting Walking and Walkability August 18, am Pacific,
City Afterschool System Framework
Student Voice Our contribution to our school community is centred on the following values.
NSF/NIH Review Processes University of Southern Mississippi
The Teaching-Research Nexus
Challenges in Evaluating Basic Science Investments: a Funder’s Perspective Julia Klebanov.
Dr Mark Walport Director The Wellcome Trust
Impact and the REF Tweet #rfringe17
Open Science at the Royal Society Dr Stuart Taylor Publishing Director
Extension Scholarship
What, why and best practices in open research
Somalia NGO Consortium
THE OFFICE FOR SCHOLARLY COMMUNICATION/ Responsible Metrics at Kent
UC policy states:  "Superior intellectual attainment, as evidenced both in teaching and in research or other creative achievement, is an indispensable.
Teacher Prep.
Intellectual Merit & Broader Impact Statements August 2018
Implementation Community Meeting
Creating a Culture of Open Data in Academia
Internship Bill of Rights
This content is available under a Creative Commons Attribution License
Intellectual Merit & Broader Impact Statements August 2017
Civic Engagement in Minnesota
Measuring Your Research Impact
Troy School District External Review Exit Report April 21-24, 2013.
Cal Poly Strategic Plan
REF and research funding update
This content is available under a Creative Commons Attribution License
You publish. We care..
to Sustainably Develop Nurse Leaders in Targeted Areas of Excellence
Table 1. Conceptual Framework Learning Outcomes
Intellectual Merit & Broader Impact Statements August 2019
Presentation transcript:

Notes and additional resources for users are included in the notes section. This content is available under a Creative Commons Attribution License. Logos are trademarks or registered trademarks of their respective organizations and may not be reused or reproduced without permission.

Declaration On Research Assessment Improving how research is assessed DORA is an initiative supported by nine organizations to push for real change in research assessment. The vision of DORA is to advance practical and robust approaches to research assessment globally and across all scholarly disciplines. Individuals and organizations can sign the declaration pledging to improve culture around research evaluation. DORA is collecting best practices to help members of the community learn from each other and create change. More information is on the website: sfdora.org Journal-based metrics are often misused and ill applied in research and researcher evaluation. This is happens at key transition points during a researcher’s career, including hiring, promotion, and tenure. Declaration On Research Assessment Improving how research is assessed sfdora.org @DORAssessment Signed by >500 organizations and >12,500 individuals Supporting organizations

Meaningful Assessment Improves Research Promotes value of all scholarly outputs Focuses on the merits of the work Journal articles Protocols Preprints Research materials Datasets Well-trained researchers Software Societal outcomes and policy changes Reduces JIF-chasing Facilitates Open Science practices Improves rigor and reproducibility Enhances collaboration

Change is happening: Research Institutes UT Southwestern Medical Center Dallas, Texas Charité University Hospital Berlin, Germany Application includes: Contribution to research field Open Science Team Science Interactions with stakeholders Staff member sits on hiring deliberation meetings as a neutral party to promote balanced discussions UT Southwestern example: https://sfdora.org/2018/05/15/how-to-strengthen-hiring-practices-at-academic-institutions-an-interview-with-dr-sandra-schmid/ Charité University Hospital: https://sfdora.org/2018/07/06/simple-questions-big-insights-charite-uses-bio-sketch-questions-to-recruit-faculty/ Candidates receive questions before Skype interviews, so they have time to reflect. The goal is to identify thoughtful individuals, in addition to candidates who process information quickly.

Change is happening: Funders Wellcome example: https://wellcome.ac.uk/news/how-we-judge-research-outputs-when-making-funding-decisions Cancer Research UK example: https://www.cancerresearchuk.org/funding-for-researchers/research-features/2018-02-20-improving-research-evaluation-dora Cancer Research UK London, UK Application includes: List of research outputs Summary of 3-5 achievements Space to describe other measures of impact Reminds peer reviewers and committee members of DORA principles throughout funding process Wellcome London, United Kingdom Application includes: List of research outputs Contributions to mentorship Output sharing plan to advance potential health benefits Plans for public engagement Guidance provided to advisory panel members

Change is happening: Publishers “Development uses a number of metrics that together provide a rich view of the journal’s performance” PLOS San Francisco, California PLOS example: https://www.plos.org/dora Company of Biologists example: http://dev.biologists.org/content/about EMBO examples: http://emboj.embopress.org/about#bibliometrics; http://emboj.embopress.org/content/34/12/1601 Dedicated page on website describing how its journals comply with DORA recommendations The Company of Biologists Cambridge, UK EMBO Press Heidelberg, Germany Acknowledges DORA signature Shows citation distributions for its journals Presents all available metrics side-by-side and rounded to single digits

What can you do? Sign DORA Ask your institution/employer to review assessment practices Use our collection of good practices to implement change Tell us about how you improved assessment so we can share your ideas with others