Open Science as Pro-Social and Pro-Self Charlie Ebersole University of Virginia Slides from this session: osf.io/3chwb/
Increasing Openness in Research Open PracticesBenefits to Science Costs to YouBenefits to You Open Materials Enables future research, Encourages replication Time spent organizing/posting Enables collaboration, Methods section done Open Analysis/Preregistr ation Increase confidence, Checking past findings Time spent planning analyses, Simulating data Save time in analysis/writing results, Increased confidence Open Data Enables new exploration/analysis, Checking past findings Time spent organizing/posting, Possibility of being scooped More efficient reviews, More citations, Future collaborations
Open Science as Pro-Social Open PracticesBenefits to ScienceCosts to You Benefits to You Open Materials Enables future research, Encourages replication Time spent organizing/posting Enables collaboration, Methods section done Open Analysis/Preregistr ation Increase confidence, Checking past findings Time spent planning analyses, Simulating data Save time in analysis/writing results, Increased confidence Open Data Enables new exploration/analysis, Checking past findings Time spent organizing/posting, Possibility of being scooped More efficient reviews, More citations, Future collaborations
Open Science as Pro-Social
Openness in Practice Study Idea Design Methods Data Collection Data Analysis Write-up/Peer Review Full protocol shared, with analysis plan Analysis scripts preregistered Open Data Many Labs 3: osf.io/ct89g
Open Materials as Pro-Self Catch errors early – Enables review from experts/collaborators – Ensures data can be analyzed Methods section – Copy and paste – Regain initial time loss
Open Analysis/Preregistration as Pro-Self Data analysis – Results a click away (regain initial time loss) – Helps future you Peer review – Bonus points from reviewers – Facilitates answering reviewer questions
Open Data as Pro-Self Peer review – Reviewers able to answer own questions – Don’t have to answer every new question Accelerating impact – Enables more research (more citations) – Open up new (efficient) collaborations
Open Science as Pro-Self Open PracticesBenefits to ScienceCosts to YouBenefits to You Open Materials Enables future research, Encourages replication Time spent organizing/posting Catch errors early, Methods section done Open Analysis/Preregistr ation Increase confidence, Checking past findings Time spent planning analyses, Simulating data Save time in analysis and in future use, Easier peer review Open Data Enables new exploration/analysis, Checking past findings Time spent organizing/posting, Possibility of being scooped More efficient reviews, More citations, Future collaborations
Facilitating Open Science Psi Chi Research Opportunities Page – Collaborative Replications and Education Project (CREP) – osf.io/wfc6u/ Measures and Materials Repository – osf.io/4np7u/
Acknowledgments Brian Nosek and the Center for Open Science John Edlund and the Psi Chi Research Advisory Committee Many Labs 3 Leadership Team, Collaborators, and Peer Reviewers Slides from this session: osf.io/3chwb/
Open Science as Pro-Self Open PracticesBenefits to ScienceCosts to YouBenefits to You Open Materials Enables future research, Encourages replication Time spent organizing/posting Catch errors early, Methods section done Open Analysis/Preregistr ation Increase confidence, Checking past findings Time spent planning analyses, Simulating data Save time in analysis and in future use, Easier peer review Open Data Enables new exploration/analysis, Checking past findings Time spent organizing/posting, Possibility of being scooped More efficient reviews, More citations, Future collaborations
Increasing Openness in Research Institutions: Center for Open Science, Open Science Framework Incentives: Badges, BITSS Awards Policy: Transparency and Openness Promotion (TOP) Guidelines
Openness in Many Labs 3 Commitment to Openness and Preregistration Prior to data collection – Full protocol, all materials created (in detail) – Analysis plans for all effects written Prior to analysis – All analysis scripts created – Data cleaned and posted
Open Science as Pro-Social Open PracticesBenefits to ScienceCosts to YouBenefits to You Open MaterialsEnables future research, Encourages replication Time spent organizing/posting Enables collaboration, Methods section done Open Analysis/Preregistrati on Increase confidence, Checking of past findings Time spent planning analyses, Simulating data, Loss of flexibility Save time in analysis, More efficient reviews, Also increased confidence Open DataEnables new exploration/analysis, Checking of past findings Time spent organizing/posting, Possibility of being proactively scooped More efficient reviews, More citations and collaboration