1. PSYC512: Research Methods PSYC512: Research Methods Lecture 17 Brian P. Dyre University of Idaho

2. PSYC512: Research Methods Lecture 17 Outline Lecture 16 Review Lecture 16 Review Relational Research Relational Research Sampling Sampling Research Ethics Research Ethics Writing Research Proposal Writing Research Proposal The Art of Peer Review The Art of Peer Review Addressing Reviewer’s Comments Addressing Reviewer’s Comments

3. PSYC512: Research Methods Ethics associated with Human Subjects The unspoken subject-experimenter contract The unspoken subject-experimenter contract Subject expectation is that experimenter will Subject expectation is that experimenter will give clear instructions give clear instructions ensure safety & warn of dangers ensure safety & warn of dangers inform subjects of the nature of the experiment inform subjects of the nature of the experiment Experimenter expectation is that subjects will Experimenter expectation is that subjects will cooperate cooperate be honest (faithful) be honest (faithful) In psychology, subjects frequently see experimenter not as a scientist but rather as a therapist In psychology, subjects frequently see experimenter not as a scientist but rather as a therapist

4. PSYC512: Research Methods Institutional Ethical Oversight Institutional Review Board Institutional Review Board research must be approved prior to conducting the research research must be approved prior to conducting the research approval does not lesson responsibility of the experimenter approval does not lesson responsibility of the experimenter Federal Review may also occur for projects receiving federal funding (e.g., NIH, NIMH) Federal Review may also occur for projects receiving federal funding (e.g., NIH, NIMH)

5. PSYC512: Research Methods Basic Ethical Principles Minimize harm to participants Minimize harm to participants Informed consent Informed consent Freedom to withdraw Freedom to withdraw Protection from harm Protection from harm Confidentiality Confidentiality Maximize benefit to science Maximize benefit to science

6. PSYC512: Research Methods Informed Consent Ss should be given a description of what they will do and possible problems (and detrimental effects), the purpose of the experiment Ss should be given a description of what they will do and possible problems (and detrimental effects), the purpose of the experiment Ss must sign a consent form that describes risks or discomforts and explicitly states that Ss must sign a consent form that describes risks or discomforts and explicitly states that participation is voluntary participation is voluntary the subject may withdraw at any time without penalty the subject may withdraw at any time without penalty responses are confidential or anonymous responses are confidential or anonymous Deception Deception “cover story” used to minimize reactivity to experimental procedures “cover story” used to minimize reactivity to experimental procedures if used must provide a full debriefing! if used must provide a full debriefing!

7. PSYC512: Research Methods The Debriefing As a part of informed consent, subjects should be told of the full nature of the study As a part of informed consent, subjects should be told of the full nature of the study Especially important if study causes temporary detrimental effects or uses deception Especially important if study causes temporary detrimental effects or uses deception Goal: identify and remove misunderstandings Goal: identify and remove misunderstandings Opportunity to collect additional data Opportunity to collect additional data Opportunity to educate Opportunity to educate

8. PSYC512: Research Methods Freedom to Withdraw Ss must be allowed to withdraw from an experiment at any time Ss must be allowed to withdraw from an experiment at any time Ss must KNOW they have the freedom to withdraw Ss must KNOW they have the freedom to withdraw

9. PSYC512: Research Methods Protection from Harm Experiments that subject Ss to any risk require very strong justification Experiments that subject Ss to any risk require very strong justification Experimenters’ responsibility to anticipate risks and take measures to minimize risks Experimenters’ responsibility to anticipate risks and take measures to minimize risks

10. PSYC512: Research Methods Confidentiality Information given by or collected from Ss should be kept confidential Information given by or collected from Ss should be kept confidential Sometimes confidentiality conflicts with protection from harm Sometimes confidentiality conflicts with protection from harm Easiest manner to insure confidentiality is to collect data in a manner that makes the data anonymous Easiest manner to insure confidentiality is to collect data in a manner that makes the data anonymous Maintaining confidentiality Maintaining confidentiality Data security Data security Keep information coding identity separate from the data itself Keep information coding identity separate from the data itself

11. PSYC512: Research Methods Maximizing benefit to science Minimize waste by using pilot studies Minimize waste by using pilot studies insure equipment and stimulus materials are appropriate and working correctly insure equipment and stimulus materials are appropriate and working correctly eliminate bugs from data collection and data reduction (analysis) eliminate bugs from data collection and data reduction (analysis) Make sure your measures are reliable Make sure your measures are reliable

12. PSYC512: Research Methods Writing a Research Proposal Purpose of Research Proposal Presents a literature review that defines the concepts and intervening variables pertinent to a particular research question Presents a specific research question with explicit hypotheses to be tested Develops a plan for addressing that research question empirically, including descriptions of Target population and subject sampling The research design, including explicit definition of independent and dependent variables and how the stimuli and procedures implement these variables Aspects of stimuli and procedures that help to control for extraneous variables and confounding variables Types of analyses to be used, predicted results, and how these predictions relate to the hypotheses

13. PSYC512: Research Methods Research Proposals: Global Concerns Scientific Writing Style Precision more important than entertainment, but… Research is part science and part advertising – not only do you need to develop good ideas but you must be able to sell your ideas Proposal is often the basis of first impression for the quality of the research project Proposal must be clear on ALL levels of analysis Words Sentences Paragraphs OUTLINE! Sections

14. PSYC512: Research Methods Research Proposals: Global Concerns APA guidelines Orderly expression of ideas - organization Smoothness of expression - transitions Economy of expression - concise language Precision and clarity – use scientific vocabulary “jargon” correctly and insure that all terms are defined the first time they are used

15. PSYC512: Research Methods Organization of a Research Proposal – USE APA STYLE! Title Page – title should specifically describe what the paper is about so that it is useful information for other researchers’ literature searches Abstract essentially a mini-paper for lit. searches be extremely CONCISE! (< 150 words) introduce specific topic discuss variables, etc. present major results (no statistics!) discuss important conclusions

16. PSYC512: Research Methods Organization of a Research Proposal – USE APA STYLE! Introduction Purpose Demonstrate knowledge of relevant research Define intervening variables and their relation to manipulations and measurements used in previous reserach Present and justify research question and hypotheses Present and justify the general method to be used Organization Start broad then narrow to your general purpose Discuss only relevant research in a logical flow Near the end provide an explicit statement of hypotheses and an overview of the general research design

17. PSYC512: Research Methods Organization of a Research Proposal – USE APA STYLE! Method explicitly state how variables are manipulated define in separate sub-sections Participants (subjects) Design Stimuli/Apparatus/Materials Procedures Results scales of IVs and DVs transformations of DVs list analyses you plan to perform summarize predictions

18. PSYC512: Research Methods Things to Avoid: Brian’s Proposal Pet Peeves Use of informal language: e.g., you don’t “run” subjects, you test subjects Ambiguous pronouns: if you use the word “it” make sure the surrounding context makes the meaning of the word “it” obvious, otherwise avoid using it (as in “it”) Sexist pronouns (he vs. she) – word sentences to avoid having to use these if at all possible, or use “he or she” Verb tense Introduction Section: discussion of specific previous research  past tense, ideas or concepts that are general for all time and not linked to past  present tense Method and results: future tense Plural/singular mismatches Passive voice – word sentences in active voice Superfluous, imprecise language (e.g., avoid vague adverbs— search for all words ending in “ly” and consider eliminating them) Style issues like “that” vs. “which”

19. PSYC512: Research Methods The Art of Peer Review Example review available online in lecture schedule Example review available online in lecture schedule Goal: Assist author in improving the clarity and impact of the paper (or proposal) by offering specific constructive criticism (no name calling!) and complements (where appropriate) Goal: Assist author in improving the clarity and impact of the paper (or proposal) by offering specific constructive criticism (no name calling!) and complements (where appropriate) Structure Structure Summary Summary Major (or general) criticisms (typically <=3) Major (or general) criticisms (typically <=3) Minor (specific) criticisms (any number, specifically listed by page and line number) Minor (specific) criticisms (any number, specifically listed by page and line number)

20. PSYC512: Research Methods Addressing Reviewer’s Comments Never blame a reviewer for a negative review Never blame a reviewer for a negative review Consider all criticism as constructive—the reviewer is trying to help you! Consider all criticism as constructive—the reviewer is trying to help you! Assume misunderstandings are your fault, not the reviewers. All misunderstandings occur because you did not write clearly enough Assume misunderstandings are your fault, not the reviewers. All misunderstandings occur because you did not write clearly enough The cover letter (required with submission of revised proposal) The cover letter (required with submission of revised proposal) Specifically responds to the reviewers comments by Specifically responds to the reviewers comments by describing specific changes made in the paper to address criticisms describing specific changes made in the paper to address criticisms Presenting a rationale for why a reviewer’s criticism was not addressed Presenting a rationale for why a reviewer’s criticism was not addressed Must be worded very diplomatically! Must be worded very diplomatically!

21. PSYC512: Research Methods Presenting Research Time-allotted: 20 minutes  strictly enforced! Time-allotted: 20 minutes  strictly enforced! Use same general format as the written report Use same general format as the written report introduction (roughly 10 minutes) introduction (roughly 10 minutes) method (roughly 8 minutes) method (roughly 8 minutes) Summary (2 minutes or so) Summary (2 minutes or so) Given time allotted you cannot go into the same level of detail as your written report Given time allotted you cannot go into the same level of detail as your written report Materials Materials Talk from an outline of points you wish to make Talk from an outline of points you wish to make Visual Aids  power point Visual Aids  power point Elements of Style Elements of Style PRACTICE YOUR PRESENTATION! PRACTICE YOUR PRESENTATION! Anticipate questions and how you will answer them Anticipate questions and how you will answer them