Brian Nosek University of Virginia -- Center for Open Science -- Improving Openness.

Slides:

Advertisements

Similar presentations

Selecting a Data Sharing Repository. 2 Why Share Data? Enabling others to replicate and verify results as part of the scientific process Allows researchers.

Advertisements

Improving Integrity, Transparency, and Reproducibility Through Connection of the Scholarly Workflow Andrew Sallans Partnerships Lead Center for Open Science.

Open Science Framework: Supporting the research worflow Brian Nosek University of Virginia.

The Open Science Framework: a Free, Open Source Solution for Connecting Global Research Infrastructure Andrew Sallans Center for Open Science 15 April.

Sara Bowman Center for Open Science Open Science Framework: Facilitating Transparency and Reproducibility.

Much Ado about Everything: Data, Publications, and the Role of Repositories Rebecca Kennison Center for Digital Research and Scholarship Columbia University.

Collaborative Approach to Open Access: Experience from Bioline International Leslie Chan Associate Director Bioline International University of Toronto.

UC3 Standards and Best Practices for Datasets and Other Supplemental Journal Article Materials UC3 Stephen Abrams Patricia Cruse John Kunze.

Making Connections: SHARE and the Open Science Framework Jeffrey Open Repositories 2015.

The DART Project: building the new collaborative e- research infrastructure Presentation to 2006 AusWeb Conference.

Life Cycle Models & Principles Jake Carlson Associate Professor of Library Science Data Services Specialist Purdue University Libraries.

DA-RT What publishing houses can and can’t do Patrick McCartan Publishing Director, Social Science and Humanities Journals Cambridge University Press.

Data Archives: Brokers for DART Improving Data Access and Research Transparency in Switzerland November 7, 2014 Bern Brian Kleiner, FORS.

Open Science Framework Jeffrey Spies University of Virginia.

Brian Nosek University of Virginia -- Center for Open Science -- Improving Openness.

Scientific Utopia: Improving Openness and Reproducibility Brian Nosek University of Virginia Center for Open Science.

Practical Steps for Increasing Openness and Reproducibility Courtney Soderberg Statistical and Methodological Consultant Center for Open Science.

Webinar on increasing openness and reproducibility April Clyburne-Sherin Reproducible Research Evangelist

Practical Steps for Increasing Openness and Reproducibility Courtney Soderberg Statistical and Methodological Consultant Center for Open Science.

Scientific Utopia: I. Improving Scientific Communication Brian Nosek University of Virginia Center for Open Science.

Brian Nosek University of Virginia -- Center for Open Science -- Improving Openness.

David Mellor, PhD Project Manager at Improving Openness and Reproducibility of Scientific Research.

Breakout Groups Goal Format Demo Pitch. Overview Monday – 3-6p Breakouts Tuesday – 9-12p Pitches (10 min, 10 discussion) – 2-6p breakouts Wednesday –

BERKELEY INITIATIVE FOR TRANSPARENCY IN THE SOCIAL SCIENCES Garret Christensen, Research Fellow BITSS and Berkeley Institute for Data Science.

Sara Bowman Center for Open Science | Promoting, Supporting, and Incentivizing Openness in Scientific Research.

Lisa Hussey Associate Publisher, Clinical Medicine 4 th March 2016 Born open access – a new approach to publishing and science.

Open Science Framework Jeffrey Center for Open Science | University of Virginia.

Sara Bowman Center for Open Science | Promoting, Supporting, and Incentivizing Openness in Scientific Research.

Improving Openness and Reproducibility of Scientific Research

David Mellor Building infrastructure to connect, preserve, speed up, and improve scholarship David Mellor

Increasing openness, reproducibility, and prediction in social science research My general substantive interest in the gap between values and practices.

Dataverse Integration with Open Science Framework (OSF)

Scholarly Workflow: Federal Prototype and Preprints

Study pre-registration

Improving Openness and Reproducibility of Scientific Research

Pre-Workshop Prep Download example files:

Improving Openness and Reproducibility of Scientific Research

Shifting the research culture toward openness and reproducibility

Center for Open Science: Practical Steps for Increasing Openness

Lorne Campbell University of Western Ontario

Three points 1. Scientists’ Conflict of Interest 2

Practical Steps for Increasing Openness and Reproducibility

Improving Openness and Reproducibility of Scientific Research

Practical Steps for Increasing Openness and Reproducibility

Connection of the scholarly work flow with the open science framework

SHARE: A Public Good to Increase Scholarly Innovation

David Mellor Building infrastructure to connect, preserve, speed up, and improve scholarship David Mellor

Psi Chi’s Network for International Collaborative Exchange (NICE)

Open Science Framework

An Open Science Framework for Managing and Sharing Research Workflows

Open Science Framework

Achieving Open Science

Data Sharing Now and in the Future

Transparency increases the credibility and relevance of research

Scaling the Open Science Framework: National Data Service Dashboard, Cloud Storage Add-ons, and Sharing Science Data on the Decentralized Web Natalie K.

A Framework for Managing and Sharing Research Workflow

Reinventing Scholarly Communication by Separating Publication From Evaluation Brian Nosek University of Virginia -- Center for Open Science

Shifting incentives from getting it published to getting it right

Incentives for a more #openscience

Improving Openness and Reproducibility of Scientific Research

Session 4 Open Workflow: OSF and Pre-registration exercise

Modularity and Interoperability

Study Pre-Registration

Disrupting Scholarly Communication

Open Science at the Royal Society Dr Stuart Taylor Publishing Director

Mission SHARE is a higher education initiative whose mission is to maximize research impact by making research widely accessible, discoverable, and reusable.

School of Psychology, Cardiff University

Research data in library catalogues and the joint initiative of European technical libraries for data registration Jan Brase Workshop Primary data for.

Badges to Acknowledge Open Practices

Dataverse for citing and sharing research data

Presentation transcript:

Brian Nosek University of Virginia -- Center for Open Science Improving Openness of Scholarly Communication

Anderson, Martinson, & DeVries, 2007

Problems Flexibility in analysis Selective reporting Ignoring nulls Lack of replication Sterling, 1959; Cohen, 1962; Lykken, 1968; Tukey, 1969; Greenwald, 1975; Meehl, 1978; Rosenthal, 1979

Silberzahn et al., 2015 Figure credit: fivethirtyeight.com

97%37% xx Open Science Collaboration, 2015, Science

Incentives for individual success are focused on getting it published, not getting it right Nosek, Spies, & Motyl, 2012

Barriers 1.Perceived norms (Anderson, Martinson, & DeVries, 2007) 2.Motivated reasoning (Kunda, 1990) 3.Minimal accountability (Lerner & Tetlock, 1999) 4.I am busy (Me & You, 2016)

Mission: Improve openness, integrity, and reproducibility of research

Open Access Open Data Open Workflows Outcomes Content Process

ProvidersConsumers Notify Gather

Documentation Curation Preservation Accessibility

Search and discover Develop idea Design study Acquire materials Collect data Store data Analyze data Interpret findings Write report Publish report OSF Open Science Framework A scholarly commons connecting the entire research lifecycle

Collaboration Documentation Archiving

Version Control

Merges Public- Private Workflows

File downloads Incentives for Openness

File downloads Forks

Persistent Citable Identifiers

Registration

Connects Services Researchers Use

OpenSesame

Awaiting Instruction…

OSF 4 Institutions

OSF Application Framework Workflow Authentication File Storage File Rendering Meta-database Integrations Search SHARE Data osf.io journals registries preprint servers grants management curation, annotation peer review services

Technology to enable change Training to enact change Incentives to embrace change

Outcomes Publication MEANS REWARDS Novel, Positive, Clean Process Research Content Transparency, Reproducibility Data and Materials

Signals: Making Behaviors Visible Promotes Adoption

% Articles reporting that data was available 40% 30% 20% 10% 0%

Registered Reports Design Collect & Analyze Report Publish PEER REVIEW PEER REVIEW

Registered Reports AIMS Neuroscience Attention, Perception, & Psychophysics Cognition and Emotion Comprehensive Results in Social Psychology Cortex Drug and Alcohol Dependence eLife Euro Journal of Neuroscience Experimental Psychology Journal of Accounting Research Journal of Business and Psychology Journal of Personnel Psychology Journal of Media Psychology Nutrition and Food Science Journal Perspectives on Psych. Science Royal Society Open Science Social Psychology Stress and Health Work, Aging, and Retirement

538 Journals 58 Organizations

What can you do? Libraries and institutions – OSF training – OSF for Institutions – SHARE Harvesters – OSF Integrations – OSF for Meetings – COS Ambassadors Publishers – TOP Guidelines, Badges, Registered Reports or