Construct Validity and Methods for Studying Personality

Establishing construct validity in personality measurement Validity (construct validity) Face or content validity Concurrent validity Convergent and discriminant validity Criterion (predictive) validity

I am socially somewhat awkward. Personality Inventory Please read the following items and decide how well they describe your personality. Respond to each according to the following list of alternatives: a. very much unlike me b. somewhat unlike me c. somewhat like me d. very much like me I am socially somewhat awkward. I don’t find it hard to talk with strangers I feel tense when I’m with people I don’t know well. When conversing I worry about saying something dumb. I feel nervous when speaking to someone in authority. I am often uncomfortable at parties and other social functions. I feel inhibited in social situations. I have trouble looking someone right in the eye. I am more shy with members of the opposite sex.

I am socially somewhat awkward. Personality Inventory Please read the following items and decide how well they describe your personality. Respond to each according to the following list of alternatives: a. very much unlike me b. somewhat unlike me c. somewhat like me d. very much like me I am socially somewhat awkward. I don’t find it hard to talk with strangers I feel tense when I’m with people I don’t know well. I enjoy visiting new cultures I haven’t encountered before. I feel nervous when speaking to someone in authority. I am often uncomfortable at parties and other social functions. I prefer to stick with familiar beliefs and ways of doing things. I have trouble looking someone right in the eye. I am more shy with members of the opposite sex.

Establishing construct validity in personality measurement Validity (construct validity) Face or content validity Concurrent validity Convergent and discriminant validity Criterion (predictive) validity

Example of concurrent validity Correlate the participants’ total shyness score for the 9-item measure of shyness (X variable) with their rating on the following dimensional scale (Y variable): In general, how shy are you? _________________________________________________________ 0 10 20 30 40 50 60 70 80 90 100 If both X and Y are good alternative ways to measure shyness, the correlation between X and Y should be positive and large (for example, r = .88).

Establishing construct validity in personality measurement Validity (construct validity) Face or content validity Concurrent validity Convergent and discriminant validity Criterion (predictive) validity

Example of convergent and discriminant validity Correlate the participants’ total shyness score for the 9-item measure of shyness (X variable) with their total scores on the following other personality measures: Shyness score correlated with: Social anxiety .91 Introversion .66 Conscientiousness .15 IQ .03 The first two correlations provide evidence of the shyness measure’s convergent validity. The last two correlations provide evidence of the shyness measure’s discriminant validity.

Establishing construct validity in personality measurement Validity (construct validity) Face or content validity Concurrent validity Convergent and discriminant validity Criterion (predictive) validity

Four possible causal structures of an A-B relationship: Correlation is not causation A B Changes in Variable A cause corresponding changes to occur in Variable B B A Changes in Variable B cause corresponding changes to occur in Variable A A B Changes in Variable A cause changes in Variable B, which in turn cause changes in Variable A, which in turn . . . A Changes in Variable C cause corresponding changes in both C Variables A and B. Variables A and B therefore covary even B though neither one causes the other

Methods for measuring aspects of personality Trait inventories (e.g., self-report questionnaires) State experience measures (e.g., mood ratings) Ability tests (e.g., intelligence test) Subjective ratings of behavior (e.g., self-ratings of one’s own behavior) Objective ratings of behavior (e.g., observer ratings of one’s behavior) Behavioral measures (e.g., counts of specific behaviors) Physiological measures (e.g., galvanic skin response) Biodata (life outcome data)

I am socially somewhat awkward. Personality Inventory Please read the following items and decide how well they describe your personality. Respond to each according to the following list of alternatives: a. very much unlike me b. somewhat unlike me c. somewhat like me d. very much like me I am socially somewhat awkward. I don’t find it hard to talk with strangers I feel tense when I’m with people I don’t know well. When conversing I worry about saying something dumb. I feel nervous when speaking to someone in authority. I am often uncomfortable at parties and other social functions. I feel inhibited in social situations. I have trouble looking someone right in the eye. I am more shy with members of the opposite sex.

Methods for measuring aspects of personality Trait inventories (e.g., self-report questionnaires) State experience measures (e.g., mood ratings) Ability tests (e.g., intelligence test) Subjective ratings (e.g., self-ratings of perceptions or behavior) Objective ratings (e.g., observer ratings of behavior) Behavioral measures (e.g., counts of specific behaviors) Physiological measures (e.g., galvanic skin response) Biodata (life outcome data)

Example of a state experience measure On a 1 to 5 scale where 1 means “very little” and 5 means “a great deal,” please rate the degree to which you are currently experiencing each of the following psychological states: ____ anxious ____ confident ____ agitated ____ confused ____ serene ____ nervous ____ apprehensive ____ relaxed ____ calm

Methods for measuring aspects of personality Trait inventories (e.g., self-report questionnaires) State experience measures (e.g., mood ratings) Ability tests (e.g., intelligence test) Subjective ratings (e.g., self-ratings of behavior) Objective ratings (e.g., observer ratings of behavior) Behavioral measures (e.g., counts of specific behaviors) Physiological measures (e.g., galvanic skin response) Biodata (life outcome data)

IQ tests are cognitive ability tests

Methods for measuring aspects of personality Trait inventories (e.g., self-report questionnaires) State experience measures (e.g., mood ratings) Ability tests (e.g., intelligence test) Subjective ratings (e.g., self-ratings of behavior) Objective ratings (e.g., observer ratings of behavior) Behavioral measures (e.g., counts of specific behaviors) Physiological measures (e.g., galvanic skin response) Biodata (life outcome data)

Subjective self-ratings of behaviors 1. To what extent did you take the lead during the conversation? not at all somewhat moderately very much 2. To what extent did you disclose personal information during the conversation? 3. To what extent did you appear self-conscious during the conversation?

Observing and recording behavioral measures

Objective observer ratings of behaviors 1. To what extent did Participant A take the lead during the conversation? not at all somewhat moderately very much 2. To what extent did Participant A disclose personal information during the conversation? 3. To what extent did Participant A appear self-conscious during the conversation?

Methods for measuring aspects of personality Trait inventories (e.g., self-report questionnaires) State experience measures (e.g., mood ratings) Ability tests (e.g., intelligence test) Subjective ratings (e.g., self-ratings of behavior) Objective ratings (e.g., observer ratings of behavior) Behavioral measures (e.g., counts of specific behaviors) Physiological measures (e.g., galvanic skin response) Biodata (life outcome data)

Observing and recording behavioral measures

A penile plethysmograph

Methods for measuring aspects of personality Trait inventories (e.g., self-report questionnaires) State experience measures (e.g., mood ratings) Ability tests (e.g., intelligence test) Subjective ratings (e.g., self-ratings of behavior) Objective ratings (e.g., observer ratings of behavior) Behavioral measures (e.g., counts of specific behaviors) Physiological measures (e.g., galvanic skin response) Biodata (life outcome data)

Examples of biodata measures Driving accident record Criminal arrest record Grade point average Number of divorces