1. Methodology & Open Science
Craft of Research: Week 4

2. Objectives Methodology Objectives How to write the Method Section
Introduction to Open Science

3. Methodology Objectives
1. Describe how data were obtained (Who, What, Where) 2. Explain how concepts and variables were measured 3. Inform on the techniques utilized to gain the results so that other researchers can replicate

4. Subheadings left aligned
Method
Centered & Bold
Subheadings left aligned
Not New Page
Subheadings:
Participants: Describe participants in your study, including N, who they were (type of participant, demographic features), selection & compensation
Measures and Materials: Describe materials, measures, equipment, or stimuli used in the study. For observational studies – include operationalizations and observational rating forms. How were variables defined and measured?
Procedure: Explain procedures used in your study. Explain what you did or had participants do, how you collected data, and the order in which steps occurred.
Includes enough detail to allow another researcher to replicate your study

5. Participants/Subjects
Introducing the subjects/participants describes the subjects or participants in your study (animate or inanimate).
For a study involving humans, this answers the “who” question (i.e., age, ethnicity, gender, etc.)
For studies without humans, the often answers the “what” question.
Should also detail the process by which subjects/participants were recruited/selected (i.e., how were they compensated)

6. Materials & Measures
Describing tools/instruments/materials/equipment describes the materials (physical or abstract) used in data acquisition or experimental procedures.
Need enough detail to allow another researcher to replicate the study
Should describe how variables were measured (i.e., self-reports, observations, physiological measures, etc.)

7. Procedure Break down of what was actually done during the study
In what order did the steps occur?
How long did everything take?
Were participants randomly assigned?

8. Tips for Scientific Writing
Gender Neutral Language
Don’t use he/she/his/her
Use the individual/the participant, etc.
Personal Pronouns
Don’t use I/we
Use the researchers/the observer, etc.
Use an Active Voice
“The participants completed X.”
Not “X was completed by the participants.”
Be Clear and Concise
Explain your point fully
Don’t use unnecessary language to explain a point
Avoid Anthropomorphism
the attribution of human characteristics or behavior to a god, animal, or object.
Ex. “The study found x to be true.”

9. Group Task Work with your group to list methodology details
Assign one group member to write Participant section, Material section, and Procedure
If there are things you don’t know, make a list of questions to ask your PI/grad mentors

10. What is Open Science Mission Statement of COS:
All scholarly content is preserved, connected, and versioned to foster discovery, accumulation of evidence, and respect for uncertainty.

11. Good Research Practice
Good researchers
Strive for excellence and take responsibility
Respect the law, research ethics, and professional standards
Support a culture of transparency, openness, and honesty towards other researchers and the public
Maximize public benefit and avoid resource waste
Continue learning and mentor others
Open Science is directly connected to these points. What we are going to learn in this workshop is a set of different practices that can routinely support scientists in fulfilling these goals. This set of practices is summarized under the label of “Open Science”.
Open Science
Picture from freepik.com
Medical Research Council (2012)

12. Pillars of Open Science
Open Data
Open Material
Open Access
Open Source (Software)
Open Peer Review
Open Educational Resources

13. What is preregistration?
Preregistration The specification of a research design, hypotheses, and analysis plan prior to observing the outcomes of a study Benefits 1. Requires a Clear distinction between confirmatory and exploratory research 2. Allows ease of replication 3. Helps prevent questionable research practices
Here is a proper definition of preregistration. Doesn‘t sound too hard, does it?
Nosek & Lindsay (2018)

14. Upcoming Milestones for Next Week
What is your research question?
Literature Review
Method Section (Participants, Materials, Procedure)
Consult with your PI/grad mentors to fill in the gaps

15. Questions??