1. Breakout Groups Goal Format Demo Pitch

2. Overview Monday – 3-6p Breakouts Tuesday – 9-12p Pitches (10 min, 10 discussion) – 2-6p breakouts Wednesday – 8:30-11:30a Pitches (10 min, 10 discussion) – 3-? Open collaboration

3. Goals Define problem, solution Propose projects to advance solution – Practical – Actionable with existing resources – Build on existing efforts Implement

4. Approach Pick a group Document work via OSF for others to follow Breakouts can split, consolidate, disband Updates to Simine/Brian or sips@cos.io Prepare pitches to whole group

5. Format Monday – Defining problem and scope – Assessment of existing and proposed solutions Tuesday – Pitch to whole meeting (10/10) – Revision Wednesday – Revised pitch to whole meeting (10/10) – Implementation

6. Success Define aspirational goal Break down problem into practical, incremental, cumulative steps Avoid redundancy 80/20 rule

7. Design Principles DON’T Anchor at desired end Rely on “do the right thing” Be parochial on “my field” Append to the workflow DO Start where community is Incorporate incentives Look for general principles Integrate with existing workflows

8. Signals: Making Behaviors Visible Promotes Adoption

9. % Articles reporting that data was available 40% 30% 20% 10% 0%

10. Demo Tuesday Pitch

11. Aspirational Goal Make transparency the default for content underlying published research Concrete Goal Get 90% of Psychology journals to adopt TOP Guidelines (score = 8+)

12. Why journal guidelines/policies? Publication is key part of research lifecycle Journal policies affect all published research now and future SIPS community can facilitate adoption

13. Why TOP Guidelines? TOP exists Modular: 8 standards Low barrier: 3 levels (disclose, require, verify) Discipline agnostic Anticipates exceptions Established: Committee, COS supported, 538 journal/60 org signatories

14. TOP Guidelines 1.Data citation 2.Design transparency 3.Research materials transparency 4.Data transparency 5.Analytic methods (code) transparency 6.Preregistration of studies 7.Preregistration of analysis plans 8.Replication

15. SIPS Strategy 1.Needs at least 5-10 people & bit help from many 2.Define population of journals 3.Gather contact information for decision-makers 4.Gather info on prior engagement 5.Define engagement method for each journal, society, publisher 6.Implement strategy to – move journal from 0 to signatory – move journal from signatory to adopter – move journal from adopter to implementation

16. Spin-off project Transparency scorecard for journals and funders to nudge action Proposal: http://bit.ly/1TT2FKG

17. BUS STOP 6p, 7p, 8p, 9p, 10p COS OMNI MARRIOTT

18. 1.Improving teaching and training (including undergrad, grad, and re-training). Moderators = Victoria Savalei and Courtney Soderberg / Breakout room: Large conference room at COS 2.What journals and societies can do. Moderators = Dan Simons and Bobbie Spellman / Breakout room: Marriott conference room 3.Meta-science, interventions, and evaluations. Moderators = Tal Yarkoni and Joe Simmons / Breakout room: Alberto at COS 4.Making replication mainstream. Moderator = Rich Lucas / Breakout room: Aperi at COS 5.Improving hiring and promotion - and what job candidates can do. Moderators = Sanjay Srivastava and David Funder / Breakout room: Lobby at Marriott 6.Broadening the model of science - recognizing different types of contributions. Moderator = Katie Corker / Breakout room: Lobby at Marriott 7.Improving research in individual labs. Moderators = Lorne Campbell and Mike Frank / Breakout room: Bukas at COS 8.Developing norms for data sharing. Moderators = Michelle Meyer and Jake Westfall / Breakout room: Furan at COS 9.Growing the tent: Promoting fruitful dialogue with those unfamiliar with or skeptical of open science. Moderators = Scott Lilienfeld and Alexa Tullett / Breakout room: Lobby at Marriott