Breakout Groups Goal Format Demo Pitch

Overview Monday – 3-6p Breakouts Tuesday – 9-12p Pitches (10 min, 10 discussion) – 2-6p breakouts Wednesday – 8:30-11:30a Pitches (10 min, 10 discussion) – 3-? Open collaboration

Goals Define problem, solution Propose projects to advance solution – Practical – Actionable with existing resources – Build on existing efforts Implement

Approach Pick a group Document work via OSF for others to follow Breakouts can split, consolidate, disband Updates to Simine/Brian or Prepare pitches to whole group

Format Monday – Defining problem and scope – Assessment of existing and proposed solutions Tuesday – Pitch to whole meeting (10/10) – Revision Wednesday – Revised pitch to whole meeting (10/10) – Implementation

Success Define aspirational goal Break down problem into practical, incremental, cumulative steps Avoid redundancy 80/20 rule

Design Principles DON’T Anchor at desired end Rely on “do the right thing” Be parochial on “my field” Append to the workflow DO Start where community is Incorporate incentives Look for general principles Integrate with existing workflows

Signals: Making Behaviors Visible Promotes Adoption

% Articles reporting that data was available 40% 30% 20% 10% 0%

Demo Tuesday Pitch

Aspirational Goal Make transparency the default for content underlying published research Concrete Goal Get 90% of Psychology journals to adopt TOP Guidelines (score = 8+)

Why journal guidelines/policies? Publication is key part of research lifecycle Journal policies affect all published research now and future SIPS community can facilitate adoption

Why TOP Guidelines? TOP exists Modular: 8 standards Low barrier: 3 levels (disclose, require, verify) Discipline agnostic Anticipates exceptions Established: Committee, COS supported, 538 journal/60 org signatories

TOP Guidelines 1.Data citation 2.Design transparency 3.Research materials transparency 4.Data transparency 5.Analytic methods (code) transparency 6.Preregistration of studies 7.Preregistration of analysis plans 8.Replication

SIPS Strategy 1.Needs at least 5-10 people & bit help from many 2.Define population of journals 3.Gather contact information for decision-makers 4.Gather info on prior engagement 5.Define engagement method for each journal, society, publisher 6.Implement strategy to – move journal from 0 to signatory – move journal from signatory to adopter – move journal from adopter to implementation

Spin-off project Transparency scorecard for journals and funders to nudge action Proposal:

BUS STOP 6p, 7p, 8p, 9p, 10p COS OMNI MARRIOTT

1.Improving teaching and training (including undergrad, grad, and re-training). Moderators = Victoria Savalei and Courtney Soderberg / Breakout room: Large conference room at COS 2.What journals and societies can do. Moderators = Dan Simons and Bobbie Spellman / Breakout room: Marriott conference room 3.Meta-science, interventions, and evaluations. Moderators = Tal Yarkoni and Joe Simmons / Breakout room: Alberto at COS 4.Making replication mainstream. Moderator = Rich Lucas / Breakout room: Aperi at COS 5.Improving hiring and promotion - and what job candidates can do. Moderators = Sanjay Srivastava and David Funder / Breakout room: Lobby at Marriott 6.Broadening the model of science - recognizing different types of contributions. Moderator = Katie Corker / Breakout room: Lobby at Marriott 7.Improving research in individual labs. Moderators = Lorne Campbell and Mike Frank / Breakout room: Bukas at COS 8.Developing norms for data sharing. Moderators = Michelle Meyer and Jake Westfall / Breakout room: Furan at COS 9.Growing the tent: Promoting fruitful dialogue with those unfamiliar with or skeptical of open science. Moderators = Scott Lilienfeld and Alexa Tullett / Breakout room: Lobby at Marriott