Center for Open Science: Practical Steps for Increasing Openness Courtney Soderberg Statistical and Methodological Consultant Center for Open Science

Infrastructure Metascience Community

Technology to enable change Improving scientific ecosystem

Open Science Framework http://osf.io free, open source

Technology to enable change Training to enact change Improving scientific ecosystem

Free training on how to make research more reproducible Partner with others on training --- librarians are great partners in this ---- to teach researchers skills in how to deal with basic data management and how to improve their research workflows for personal and sharing purposes. Software Carpentry and Data Carpentry are other great examples of efforts in this area, and partnerships with those in libraries --- we’ve done some work with them and are exploring ways to do more. Free training on how to make research more reproducible http://cos.io/stats_consulting

Technology to enable change Training to enact change Incentives to embrace change Improving scientific ecosystem

The $1,000,000 Preregistration Challenge Endorse TOP Guidelines Badges for Open Practices Registered Reports Another incentive for researchers to try out preregistration.

Signals: Making Behaviors Visible Promotes Adoption Badges Open Data Open Materials Preregistration Psychological Science (Jan 2014)

Also have an initiave to get journals ot adopt review of pre-registered reports of publications, so not even publication decisions are data dependent, but are made instead on the solidness of theory, study design, and analyses

Data Availability in Psychological Science 10x increase from 2013 to 2015

There’s more to it than sharing of discrete objects There’s more to it than sharing of discrete objects. Think about using this as an opportunity to increase transparency by capturing the entire workflow, and to do so while connecting tools and services that make up the parts of the workflow, not requiring people to change all of their practices at once, and providing immediate efficiencies and value to the researcher AS they comply with requirements. Easy, right? Obviously not.

We tend to talk about sharing: Data (maybe code) underlying published articles Great first step Computational reproducibility checks But…

Outcomes Content Process Open Access Open Data Open Workflows Improving scientific ecosystem Make outcomes more accessible Make research content more accessible Make research process more accessible

There’s more to it than sharing of discrete objects There’s more to it than sharing of discrete objects. Think about using this as an opportunity to increase transparency by capturing the entire workflow, and to do so while connecting tools and services that make up the parts of the workflow, not requiring people to change all of their practices at once, and providing immediate efficiencies and value to the researcher AS they comply with requirements. Easy, right? Obviously not.

Research Management Planning What are you going to store? Where and how are you going to store it? Who will have access to it? When will they have access to it?

Research Management Planning What are you going to store? Where and how are you going to store it? Who will have access to it? When will they have access to it? PLAN AHEAD Checklists and common structures are your best friend!

Ledgerwood Lab Experimental Archive https://ucdavis.app.box.com/s/f8hn7rqtwwf6aa6hjtkthdbiuehup312

Campbell Lab https://osf.io/ydh84/

Corker Lab https://osf.io/sjtyr/

When we share Findable Accessible Interpretable & Reusable

Most likely to be sharing with your future self When we share Findable Accessible Interpretable & Reusable Most likely to be sharing with your future self

When we share Findable Files have unique, persistent identifiers Files are described with rich meta-data Files are in a searchable resource

When we share Accessible Files stored somewhere you’ll always have access to and collaborators have access to What if you move schools? What if about collaborators at other institutions/countries? Files are in formats you’ll always be able to view Open formats

When we share Interpretable & Reusable Files are described Commenting of code Code books/data dictionary for data Process is tracked Pre-registration Version control Content is licensed CC-0 or CC-By Makes it clear how reuse is allowed

These are applicable even for purely internal reuse When we share Findable Accessible Interpretable & Reusable These are applicable even for purely internal reuse

Open Science Framework http://osf.io free, open source

There’s more to it than sharing of discrete objects There’s more to it than sharing of discrete objects. Think about using this as an opportunity to increase transparency by capturing the entire workflow, and to do so while connecting tools and services that make up the parts of the workflow, not requiring people to change all of their practices at once, and providing immediate efficiencies and value to the researcher AS they comply with requirements. Easy, right? Obviously not. OpenSesame

There’s more to it than sharing of discrete objects There’s more to it than sharing of discrete objects. Think about using this as an opportunity to increase transparency by capturing the entire workflow, and to do so while connecting tools and services that make up the parts of the workflow, not requiring people to change all of their practices at once, and providing immediate efficiencies and value to the researcher AS they comply with requirements. Easy, right? Obviously not. OpenSesame

Help/questions Email Video courtney@cos.io stats-consulting@cos.io contact@cos.io Video JASP and OSF: https://youtu.be/B98FwY_frAw R and OSF: https://youtu.be/cnE3AcdeGVY All webinars: COS youtube channel

Where to get help: Emails courtney@cos.io stats-consulting@cos.io contact@cos.io OSF and JASP video: https://www.youtube.com/watch?v=cnE3AcdeGVY