Psi Chi’s Network for International Collaborative Exchange (NICE) Jon Grahe Presented at Association for Psychological Sciences May 26th, 2017 In all my affiliations, there are projects that utilize the OSF. At PLU, my scholarship is housed there; At JSP, authors use it to apply for Open Science Badges; At Psi Chi, the Research Advisory Committee uses it to compile measurement scales for members to use.

Outline Psi Chi Diverse Resources Meta Science Projects NICE Development and Vision https://osf.io/juupx/ Advancing Diversity through Research

Diverse Resources for NICE Diversity Committee International Advisory Committee Research Advisory Committee Psi Chi Journal and Communicational Dept. Each of these is invested in PSI CHI:NICE

Meta-Science Projects and Openness Crisis of Confidence in Psychology (Science) Replication Crisis sparked the Revolution Calls for increased Scientific Transparency Outcome is better Science Increased interest in Large-Scale Replications The Creation of the Open Science Framework

Open Science as Antidote Confirmatory Tests require forward planning Preregistration and the “Pre-reg Challenge” Replication requires access to materials Open Materials Reproducibility requires data reanalysis Open Data Open Transparency Badges and the Transparency and Openness in Publishing Guidelines (ToP guidelines)

Idealistic Meta-Science “Imagine if the Association for Psychological Science published a list of 10 research questions each spring. Across the nation, faculty and students at undergraduate institutions could choose to study one or more of these questions through replication; data collection might also include inviting participants to complete additional measures of personality, attitudes, or background information, providing a richer data source. Once each project was completed, the collected data, along with a brief APA-style report, could be submitted to a Web portal. The most impressive projects might receive awards and stipends.” Grahe et al. (2012) My suggestion for Brian Nosek’s and Jeffrey Spies Scientific Utopia. Bring replication and open science into the classroom as option for research methods or capstone students or Psi Chi members. This is my goal. This is the ideal that I want the audience to consider.

Previous and Current Open-Invitation Research Projects School Spirit Study Group Project Implicit (other online invitations) Emerging Adulthood and Politics (EAMMI: 1st Install) Collective Undergraduate Research Project Psi Beta National Research Projects Psych FileDrawer Project Registered Replication Reports The Pipeline Project Reproducibility Project: Psychology International Situations Project and Psi Chi/Psi Beta National Extension of the ISP Collaborative Replications and Education Project (CREP) Many Labs Projects (I, II, III, IV, V, …. coming in 2017?) The Study Swap

Characteristics of Open-Invitation Open Science Research Projects Type of Contribution: Generate or Collect Data Invitation List: Open to All, Open to Qualified, Open to Certain Groups Replication or Novel: If Replication; Close/Direct, Conceptual Research Question Selection Methods Top-Down vs. Bottom Up Determination Random, Theoretical, or Convenient Methods Barrier of Entry to Contribute Online Surveys vs. Intensive Experimentation Number of minN required for access Support from Project Leaders (monetary, administrative, methodological, manuscript) Potential Benefits to Contributors Access to Data, Authorship Possibilities, Access to awards/grants, Potential Meta-Science Contribution of Findings Top Tiered Publication vs. Online Documentation Number of times cited in peer-reviewed publications?

Network for International Collaborative Exchange (NICE) Diverse Conversations at Psi Chi Implementation through Social Networking Call for Collaborators – April 2017 Current Status Chair-Kelly Cuccolo Collaborators 120on NICE-Google.sheet

NICE Opportunities Planning Committee Project Coordination Research Proposals Making Connections Open to collaboration Recruiting International Collaborators

NICE Vision Hybrid Project combining power of meta-science with personal connections NICE: Crowd – Three Research Questions selected by as Priority Projects Call for research proposals using the COS Preregistration Template Select subset further review. Select top choices that are most feasible for undergraduates. NICE: Connect  -- Bottom Up Collaborations Contributors post their Expertise and Research Goals on OSF personal page. (See Instruction to Contributors Component) Propose Research using COS Preregistration Template Employ The Study Swap Platform

NICE Structures Planning Committee Provides Instructions on the OSF Guidelines Contributor Expectations Authorship, Procedures, Dispute Resolution Collaborative Grant Funding Deadlines NICE: CROWD NICE: CONNECT

NICE CHARACTERISTICS? Type of Contribution: Collect Data Invitation List: Open to Qualified (interested researchers) Replication or Novel: Might be either Research Question Selection Methods Top-Down (CROWD) and Bottom Up (CONNECT) Barrier of Entry to Contribute (undetermined) Online Surveys vs. Intensive Experimentation Number of minN required for access Support from Project Leaders (monetary, administrative, methodological, manuscript) Potential Benefits to Contributors Access to Data, Authorship Possibilities, Potential Meta-Science Contribution of Findings Top Tiered Publications is goal

Advancing Diversity through Research Better Cross-Cultural Research Connections with International Collaborators Connections between Chapters Benefits of Research on Vulnerable Students