Chapter 2 Personality Research Methods

Slides:



Advertisements
Similar presentations
Agenda Levels of measurement Measurement reliability Measurement validity Some examples Need for Cognition Horn-honking.
Advertisements

Measurement Concepts Operational Definition: is the definition of a variable in terms of the actual procedures used by the researcher to measure and/or.
Cal State Northridge Psy 427 Andrew Ainsworth PhD
1 COMM 301: Empirical Research in Communication Kwan M Lee Lect4_1.
Experiment Basics: Variables Psych 231: Research Methods in Psychology.
Validity, Sampling & Experimental Control Psych 231: Research Methods in Psychology.
Manipulation and Measurement of Variables
Psych 231: Research Methods in Psychology
Manipulation and Measurement of Variables
Variables cont. Psych 231: Research Methods in Psychology.
Validity, Reliability, & Sampling
1 Evaluating Psychological Tests. 2 Psychological testing Suffers a credibility problem within the eyes of general public Two main problems –Tests used.
Defining and Measuring Variables Slides Prepared by Alison L. O’Malley Passer Chapter 4.
Experimental Research
Instrumentation.
McMillan Educational Research: Fundamentals for the Consumer, 6e © 2012 Pearson Education, Inc. All rights reserved. Educational Research: Fundamentals.
Unanswered Questions in Typical Literature Review 1. Thoroughness – How thorough was the literature search? – Did it include a computer search and a hand.
Final Study Guide Research Design. Experimental Research.
The Psychology of the Person Chapter 2 Research Naomi Wagner, Ph.D Lecture Outlines Based on Burger, 8 th edition.
Validity. Face Validity  The extent to which items on a test appear to be meaningful and relevant to the construct being measured.
Tests and Measurements Intersession 2006.
Chapter 4 – Research Methods in Clinical Psych Copyright © 2014 John Wiley & Sons, Inc. All rights reserved.
Measurement Validity.
Chapter 8 Validity and Reliability. Validity How well can you defend the measure? –Face V –Content V –Criterion-related V –Construct V.
Experiment Basics: Variables Psych 231: Research Methods in Psychology.
Chapter 2: Behavioral Variability and Research Variability and Research 1. Behavioral science involves the study of variability in behavior how and why.
Research Methodology and Methods of Social Inquiry Nov 8, 2011 Assessing Measurement Reliability & Validity.
Chapter 4 Validity Robert J. Drummond and Karyn Dayle Jones Assessment Procedures for Counselors and Helping Professionals, 6 th edition Copyright ©2006.
Copyright © 2008 Wolters Kluwer Health | Lippincott Williams & Wilkins Chapter 17 Assessing Measurement Quality in Quantitative Studies.
Measurement Experiment - effect of IV on DV. Independent Variable (2 or more levels) MANIPULATED a) situational - features in the environment b) task.
Chapter 6 - Standardized Measurement and Assessment
©2005, Pearson Education/Prentice Hall CHAPTER 6 Nonexperimental Strategies.
 Characteristics or conditions that change or have different values for different individuals  Age  Gender  Score  Elapsed Time.
Measurement and Scaling Concepts
Survey Methodology Reliability and Validity
Reliability and Validity
Ch. 5 Measurement Concepts.
Chapter 4 Research Methods in Clinical Psychology
Constructing Trait Measures for Self- and Observer Report
Product Reliability Measuring
Experiment Basics: Variables
Personality Research Methods: Correlation and Reliability
Concept of Test Validity
Measurement: Part 1.
Chapter 4: Studying Behavior
Reliability & Validity
Construct Validity and Methods for Studying Personality
CHAPTER 5 MEASUREMENT CONCEPTS © 2007 The McGraw-Hill Companies, Inc.
Tests and Measurements: Reliability
Journalism 614: Reliability and Validity
Human Resource Management By Dr. Debashish Sengupta
Research Methods: Concepts and Connections First Edition
Chapter Nine Measurement and Scaling: Noncomparative Scaling
پرسشنامه کارگاه.
5. Reliability and Validity
Chapter 2 Personality Research Methods
Reliability, validity, and scaling
Constructing Trait Measures for Self- and Observer Report
Chapter 4 Studying Behavior
Experiment Basics: Variables
How can one measure intelligence?
Constructing Trait Measures for Self- and Observer Report
Construct Validity and Methods for Studying Personality
Personality Research Methods: Correlation and Reliability
Research Methods.
Cal State Northridge Psy 427 Andrew Ainsworth PhD
Chapter 8 VALIDITY AND RELIABILITY
Presentation transcript:

Chapter 2 Personality Research Methods

Measuring personality variables What is a variable? What kinds of variables are there? Categorical variables (examples: gender, political affiliation) Continuous variables (height, weight) How can we measure an aspect of personality as a variable? Psychometrics (psyche – mind, metric – measure): an applied branch of psychology that deals with psycho-logical measurement The most commonly used approach to study human personality: the self-report questionnaire measure

I am socially somewhat awkward. Personality Inventory Please read the following items and decide how well they describe your personality. Respond to each according to the following list of alternatives: a. very much unlike me b. somewhat unlike me c. somewhat like me d. very much like me I am socially somewhat awkward. I don’t find it hard to talk with strangers I feel tense when I’m with people I don’t know well. When conversing I worry about saying something dumb. I feel nervous when speaking to someone in authority. I am often uncomfortable at parties and other social functions. I feel inhibited in social situations. I have trouble looking someone right in the eye. I am more shy with members of the opposite sex.

Correlating variables Correlating two variables Measure the two variables (X and Y) as accurately as necessary Plot the variables as X-Y coordinates on a two-dimensional space Examine the shape of the “scatterplot” to estimate the size and “direction” of the resulting correlation Compute the correlation coefficient using the correct mathematical formula (or let the computer do it for you)

NAME HEIGHT (X) WEIGHT (Y) Allport, Allen 69 175 Bimiup, Scotty 68 159 Brewer, Joseph 71 177 Derrickson, Derek 150 Dorman, Carlton 67 162 Horne, Karyn 65 134 Ingram, Irene 64 121 James, Jocelyn 125 Jones, Ernie 158 Lang, Fred 161 Kelly, Christine 63 119 Lime, Nora 128 etc.

Reliability and validity in personality measurement Reliability (consistency of measurement) Internal consistency Item-to-total correlation Split-half reliability Cronbach’s alpha Test-retest reliability Validity (construct validity) Face validity Concurrent validity Convergent and discriminant validity Criterion (predictive) validity

I am socially somewhat awkward. Personality Inventory Please read the following items and decide how well they describe your personality. Respond to each according to the following list of alternatives: a. very much unlike me b. somewhat unlike me c. somewhat like me d. very much like me I am socially somewhat awkward. I don’t find it hard to talk with strangers I feel tense when I’m with people I don’t know well. When conversing I worry about saying something dumb. I feel nervous when speaking to someone in authority. I am often uncomfortable at parties and other social functions. I feel inhibited in social situations. I have trouble looking someone right in the eye. I am more shy with members of the opposite sex.

Reliability and validity in personality measurement Reliability (consistency of measurement) Internal consistency Item-to-total correlation Split-half reliability Cronbach’s alpha Test-retest reliability Validity (construct validity) Face validity Concurrent validity Convergent and discriminant validity Criterion (predictive) validity

Item-to-total correlations SHY1 SHY2 SHY3 SHY4 SHY5 SHY6 SHY7 SHY8 SHY9 SHY .68 .64 .67 .65 .73 .75 .57 .61

Reliability and validity in personality measurement Reliability (consistency of measurement) Internal consistency Item-to-total correlation Split-half reliability Cronbach’s alpha Test-retest reliability Validity (construct validity) Face validity Concurrent validity Convergent and discriminant validity Criterion (predictive) validity

Reliability and validity in personality measurement Reliability (consistency of measurement) Internal consistency Item-to-total correlation Split-half reliability Cronbach’s alpha Test-retest reliability Validity (construct validity) Face validity Concurrent validity Convergent and discriminant validity Criterion (predictive) validity

Reliability (internal consistency) Cronbach’s alpha = Reliability (internal consistency) Cronbach’s alpha = .83 Factor pattern Factor 1 SHY1 .69 SHY2 .62 SHY3 .67 SHY4 .66 SHY5 .65 SHY6 .75 SHY7 .78 SHY8 .54 SHY9 .58

Reliability and validity in personality measurement Reliability (consistency of measurement) Internal consistency Item-to-total correlation Split-half reliability Cronbach’s alpha Test-retest reliability Validity (construct validity) Face validity Concurrent validity Convergent and discriminant validity Criterion (predictive) validity

Reliability and validity in personality measurement Reliability (consistency of measurement) Internal consistency Item-to-total correlation Split-half reliability Cronbach’s alpha Test-retest reliability Validity (construct validity) Face validity Concurrent validity Convergent and discriminant validity Criterion (predictive) validity

I am socially somewhat awkward. Personality Inventory Please read the following items and decide how well they describe your personality. Respond to each according to the following list of alternatives: a. very much unlike me b. somewhat unlike me c. somewhat like me d. very much like me I am socially somewhat awkward. I don’t find it hard to talk with strangers I feel tense when I’m with people I don’t know well. When conversing I worry about saying something dumb. I feel nervous when speaking to someone in authority. I am often uncomfortable at parties and other social functions. I feel inhibited in social situations. I have trouble looking someone right in the eye. I am more shy with members of the opposite sex.

Reliability and validity in personality measurement Reliability (consistency of measurement) Internal consistency Item-to-total correlation Split-half reliability Cronbach’s alpha Test-retest reliability Validity (construct validity) Face validity Concurrent validity Convergent and discriminant validity Criterion (predictive) validity

Example of concurrent validity Correlate the participants’ total shyness score for the 9-item measure of shyness (X variable) with their rating on the following dimensional scale (Y variable): In general, how shy are you? _________________________________________________________ 0 10 20 30 40 50 60 70 80 90 100 If both X and Y are good alternative ways to measure shyness, the correlation between X and Y should be positive and large (for example, r = .86).

Reliability and validity in personality measurement Reliability (consistency of measurement) Internal consistency Item-to-total correlation Split-half reliability Cronbach’s alpha Test-retest reliability Validity (construct validity) Face validity Concurrent validity Convergent and discriminant validity Criterion (predictive) validity

Example of convergent and discriminant validity Correlate the participants’ total shyness score for the 9-item measure of shyness (X variable) with their total scores on the following other personality measures: Shyness score correlated with: Social anxiety .91 Introversion .66 Conscientiousness .15 IQ .03 The first two correlations provide evidence of the shyness measure’s convergent validity. The last two correlations provide evidence of the shyness measure’s discriminant validity.

Reliability and validity in personality measurement Reliability (consistency of measurement) Internal consistency Item-to-total correlation Split-half reliability Cronbach’s alpha Test-retest reliability Validity (construct validity) Face validity Concurrent validity Convergent and discriminant validity Criterion (predictive) validity

Four possible causal structures of an A-B relationship A B Changes in Variable A cause corresponding changes to occur in Variable B B A Changes in Variable B cause corresponding changes to occur in Variable A A B Changes in Variable A cause changes in Variable B, which in turn cause changes in Variable A, which in turn . . . A Changes in Variable C cause corresponding changes in both C Variables A and B. Variables A and B therefore covary even B though neither one causes the other

Three categories of moderating variables in personality research Category Function Representative Example Situational moderating variables Specify in which types of situations traits will be good versus poor predictors of their trait-relevant behaviors Psychologically weak versus strong situations Personal moderating variables Specify for which types of people traits will be good versus poor predictors of their trait-relevant behaviors Private self-consciousness Criterion moderating variables Specify the types of behaviors that traits will predict either well or poorly Level of aggregation of the behavioral measure

Experimental study Correlational study Goal Variables Criteria Test for a causal relationship between a manipulated variable and a measured variable Test for a correlational relationship between two measured variables Variables Independent variable (manipulated) Dependent variable (measured) Predictor variable (measured) Criterion variable (measured) Criteria Experimenter controls the IV Random assignment to conditions Measures of both the predictor and the criterion variables must be obtained Major pitfalls Confounded manipulation of the independent variable Confounded measurement of the dependent variable Using a measured variable that is unreliable or that lacks validity Confounded measurement of the predictor variable Confounded measurement of the criterion variable Using measured variables that are unreliable or that lack validity Possible conclusions Level of IV affects level of DV Level of IV doesn’t affect level of DV PV is related to (associated with) CV PV is not related to CV Best safeguard Replication

Methods for measuring aspects of personality Trait measures (e.g., self-report questionnaires) State experience measures (e.g., mood ratings) Ability tests (e.g., intelligence test) Subjective ratings of behavior (e.g., self-ratings of one’s own behavior) Objective ratings of behavior (e.g., observer ratings of one’s behavior) Behavioral measures (e.g., counts of specific behaviors) Physiological measures (e.g., galvanic skin response)

I am socially somewhat awkward. Personality Inventory Please read the following items and decide how well they describe your personality. Respond to each according to the following list of alternatives: a. very much unlike me b. somewhat unlike me c. somewhat like me d. very much like me I am socially somewhat awkward. I don’t find it hard to talk with strangers I feel tense when I’m with people I don’t know well. When conversing I worry about saying something dumb. I feel nervous when speaking to someone in authority. I am often uncomfortable at parties and other social functions. I feel inhibited in social situations. I have trouble looking someone right in the eye. I am more shy with members of the opposite sex.

Methods for measuring aspects of personality Trait inventories (e.g., self-report questionnaires) State experience measures (e.g., mood ratings) Ability tests (e.g., intelligence test) Subjective ratings (e.g., self-ratings of behavior) Objective ratings (e.g., observer ratings of behavior) Behavioral measures (e.g., counts of specific behaviors) Physiological measures (e.g., galvanic skin response)

Example of a Mood Adjective Check List Check all of the following adjectives that describe your current mood: ____ anxious ____ confident ____ agitated ____ confused ____ serene ____ nervous ____ apprehensive ____ relaxed ____ calm OR . . . To what extent do you feel anxious? 0 1 2 3 not at all slightly moderately extremely

Methods for measuring aspects of personality Trait inventories (e.g., self-report questionnaires) State experience measures (e.g., mood ratings) Ability tests (e.g., intelligence test) Subjective ratings (e.g., self-ratings of behavior) Objective ratings (e.g., observer ratings of behavior) Behavioral measures (e.g., counts of specific behaviors) Physiological measures (e.g., galvanic skin response)

IQ tests are cognitive ability tests

Methods for measuring aspects of personality Trait inventories (e.g., self-report questionnaires) State experience measures (e.g., mood ratings) Ability tests (e.g., intelligence test) Subjective ratings (e.g., self-ratings of behavior) Objective ratings (e.g., observer ratings of behavior) Behavioral measures (e.g., counts of specific behaviors) Physiological measures (e.g., galvanic skin response)

Subjective self-ratings of behaviors 1. To what extent did you take the lead during the conversation? not at all somewhat moderately very much 2. To what extent did you disclose personal information during the conversation? 3. To what extent did you appear self-conscious during the conversation?

Observing and rating people’s behavior

Objective observer ratings of behaviors 1. To what extent did Participant A take the lead during the conversation? not at all somewhat moderately very much 2. To what extent did Participant A disclose personal information during the conversation? 3. To what extent did Participant A appear self-conscious during the conversation?

Methods for measuring aspects of personality Trait inventories (e.g., self-report questionnaires) State experience measures (e.g., mood ratings) Ability tests (e.g., intelligence test) Subjective ratings (e.g., self-ratings of behavior) Objective ratings (e.g., observer ratings of behavior) Behavioral measures (e.g., counts of specific behaviors) Physiological measures (e.g., galvanic skin response)

Observing and recording behavioral measures

Methods for measuring aspects of personality Trait inventories (e.g., self-report questionnaires) State experience measures (e.g., mood ratings) Ability tests (e.g., intelligence test) Subjective ratings (e.g., self-ratings of behavior) Objective ratings (e.g., observer ratings of behavior) Behavioral measures (e.g., counts of specific behaviors) Physiological measures (e.g., galvanic skin response)

A penile plethysmograph