1. Study pre-registration
Benefits and considerations

2. The problem
Science isn’t perfect.

3. 53eig.ht/HackingScience
Half of the room will try to see how Republicans are improving economy and the other half will try to show the same for Democrats.

4. The first principle is that you must not fool yourself and you are the easiest person to fool.
Richard P. Feynman

5. Different types of bias

6. The solution
Pre-registration

7. What is a preregistration?
It’s the introduction and methods section of your future paper.

8. What should be included in a preregistration?
Hypotheses
Predictions
Models
Dependent variables
ROIs
Confounds
Exclusion criteria
Feature definition (“functional connectivity defined as…”)
Analysis plan
Statistical techniques (algorithms)
Multiple comparison correction
Parameters

9. Types of preregistration
Reviewed Pre-Registration
(RPR aka “Registered Report”)
Registration is submitted to a journal and reviewed by experts
Unreviewed Pre-Registration (UPR)
Pre-registration is deposited in a public or private repository

10. Reviewed Pre-Registration

11. Reviewed Pre-Registration
Advances in Methodologies and Practices in Psychological Science
Journal of Cognitive Enhancement
Journal of European Psychology Students
AIMS Neuroscience
Journal of Experimental Political Science
Animal Behavior and Cognition
Journal of Media Psychology
Attention, Perception, and Psychophysics
Journal of Personnel Psychology
Behavioral Neuroscience
Journal of Research in Personality
Cognition and Emotion
Judgment and Decision Making
Cognitive Research: Principles and Implications
Management and Organization Review
Comprehensive Results in Social Psychology
Memory
Cortex
Nature Human Behaviour
Drug and Alcohol Dependence
NFS Journal
European Journal of Neuroscience
Nicotine & Tobacco Research
Experimental Psychology
Perspectives on Psychological Science
Health Psychology Bulletin
Royal Society Open Science
Human Movement Science
Stress and Health
Infancy
The Leadership Quarterly
International Journal of Psychophysiology
Work, Aging and Retirement
Journal of Business and Psychology

12. Reviewed Pre-Registration

13. Unreviewed Pre-Registration
Where to submit?

14. AsPredicted.org Demo

15. Benefits for science Reduced publication bias

16. Benefits for science Reduced reporting bias
Clear distinction between exploratory and confirmatory research
Prioritizing theory and method

17. Benefits for the researcher
Pre-analysis review feedback (RPR only)
Guaranteed publication (RPR only)
Clarity among collaborators

18. Pre registration misconceptions
It’s too much work
It does not allow for exploratory science
It will flood the literature with “boring” null results
My reviewers will scoop me
It forces researchers to stick to their hypotheses instead of listening to the data

19. Q & A

20. van ’t Veer, A. E. , & Giner-Sorolla, R. (2016)
van ’t Veer, A. E., & Giner-Sorolla, R. (2016). Pre-registration in social psychology—A discussion and suggested template. Journal of experimental social psychology, 67, 2–12.