Data Analysis Outline What is an experiment? What are independent vs. dependent variables in an experimental study? What are our dependent measures/variables.

Slides:



Advertisements
Similar presentations
Hypothesis testing 5th - 9th December 2011, Rome.
Advertisements

Some (Simplified) Steps for Creating a Personality Questionnaire Generate an item pool Administer the items to a sample of people Assess the uni-dimensionality.
Quiz Do random errors accumulate? Name 2 ways to minimize the effect of random error in your data set.
Validity In our last class, we began to discuss some of the ways in which we can assess the quality of our measurements. We discussed the concept of reliability.
1 SSS II Lecture 1: Correlation and Regression Graduate School 2008/2009 Social Science Statistics II Gwilym Pryce
Review of the Basic Logic of NHST Significance tests are used to accept or reject the null hypothesis. This is done by studying the sampling distribution.
Reliability, the Properties of Random Errors, and Composite Scores.
QUESTIONARIES: Rosenberg´s Self-Esteem Scale 2 Filip Habrman Veronika Foltýnková.
Operational Definitions In our last class, we discussed (a) what it means to quantify psychological variables and (b) the different scales of measurement.
Chapter 8 Linear Regression © 2010 Pearson Education 1.
MSS 905 Methods of Missiological Research
Today’s Question Example: Dave gets a 50 on his Statistics midterm and an 50 on his Calculus midterm. Did he do equally well on these two exams? Big question:
Analysis of frequency counts with Chi square
Intro to Statistics for the Behavioral Sciences PSYC 1900 Lecture 10: Hypothesis Tests for Two Means: Related & Independent Samples.
Basic Statistical Concepts
Statistics Psych 231: Research Methods in Psychology.
MEASURES OF DISPERSION: SPREAD AND VARIABILITY. DATA SETS FOR PROJECT NES2000.sav States.sav World.sav.
Operational Definitions In our last class, we discussed (a) what it means to quantify psychological variables and (b) the different scales of measurement.
Scatterplots Represent two variables at once Show the relationship between X and Y Y X trust love.
Lecture 5: Simple Linear Regression
Quiz Name one latent variable Name 2 manifest variables that are indicators for the latent variable.
Z Scores & Correlation Greg C Elvers.
Psy B07 Chapter 1Slide 1 ANALYSIS OF VARIANCE. Psy B07 Chapter 1Slide 2 t-test refresher  In chapter 7 we talked about analyses that could be conducted.
LEARNING PROGRAMME Hypothesis testing Intermediate Training in Quantitative Analysis Bangkok November 2007.
Covariance and correlation
Goals for Today Review the basics of an experiment Learn how to create a unit-weighted composite variable and how/why it is used in psychology. Learn how.
By C. Kohn Waterford Agricultural Sciences.   A major concern in science is proving that what we have observed would occur again if we repeated the.
User Study Evaluation Human-Computer Interaction.
Answering Descriptive Questions in Multivariate Research When we are studying more than one variable, we are typically asking one (or more) of the following.
Multivariate Descriptive Research In the previous lecture, we discussed ways to quantify the relationship between two variables when those variables are.
1 rules of engagement no computer or no power → no lesson no SPSS → no lesson no homework done → no lesson GE 5 Tutorial 5.
Multiple linear indicators A better scenario, but one that is more challenging to use, is to work with multiple linear indicators. Example: Attraction.
Testing Hypotheses about Differences among Several Means.
Hypothesis testing Intermediate Food Security Analysis Training Rome, July 2010.
Intro: “BASIC” STATS CPSY 501 Advanced stats requires successful completion of a first course in psych stats (a grade of C+ or above) as a prerequisite.
Psychology 3051 Psychology 305A: Theories of Personality Lecture 1 1.
Operational Definitions In our last class, we discussed (a) what it means to quantify psychological variables and (b) the different scales of measurement.
Multiple Regression Petter Mostad Review: Simple linear regression We define a model where are independent (normally distributed) with equal.
Validity In our last class, we began to discuss some of the ways in which we can assess the quality of our measurements. We discussed the concept of reliability.
Multiple linear indicators A better scenario, but one that is more challenging to use, is to work with multiple linear indicators. Example: Attraction.
Operational definitions and latent variables As we discussed in our last class, many psychological variables of interest cannot be directly observed These.
Psychology 3051 Psychology 305A: Theories of Personality Lecture 2 1.
Department of Cognitive Science Michael J. Kalsher Adv. Experimental Methods & Statistics PSYC 4310 / COGS 6310 Regression 1 PSYC 4310/6310 Advanced Experimental.
Chapter 14 – 1 Chapter 14: Analysis of Variance Understanding Analysis of Variance The Structure of Hypothesis Testing with ANOVA Decomposition of SST.
Reliability, the Properties of Random Errors, and Composite Scores Week 7, Psych R. Chris Fraley
DESCRIPTIVE STATISTICS. Nothing new!! You are already using it!!
© 2008 McGraw-Hill Higher Education The Statistical Imagination Chapter 11: Bivariate Relationships: t-test for Comparing the Means of Two Groups.
CORRELATION. Correlation key concepts: Types of correlation Methods of studying correlation a) Scatter diagram b) Karl pearson’s coefficient of correlation.
1 Psychology 305A: Personality Psychology September 9 Lecture 2.
The Analysis of Variance ANOVA
Validity and Reliability in Instrumentation : Research I: Basics Dr. Leonard February 24, 2010.
Answering Descriptive Questions in Multivariate Research When we are studying more than one variable, we are typically asking one (or more) of the following.
Outline of Today’s Discussion 1.The Chi-Square Test of Independence 2.The Chi-Square Test of Goodness of Fit.
WEIGHTED AVERAGE ALG114 Weighted Average: an average where every quantity is assigned a weight. Example: If a teacher thinks it’s more important, a final.
Psychology 3051 Psychology 305A: Theories of Personality Lecture 2 1.
1 Research Methods in Psychology AS Descriptive Statistics.
DESCRIPTIVE STATISTICS. Nothing new!! You are already using it!!
What is the Scientific Method?. The scientific method is a way to ask and answer scientific questions by making observations and doing experiments.
Data Analysis. Qualitative vs. Quantitative Data collection methods can be roughly divided into two groups. It is essential to understand the difference.
Psychology as a Science. Scientific Method  How is it used in psychology? It helps us separate true claims about the world from mere opinion It helps.
Introduction Dispersion 1 Central Tendency alone does not explain the observations fully as it does reveal the degree of spread or variability of individual.
Michael J. Kalsher PSYCHOMETRICS MGMT 6971 Regression 1 PSYC 4310 Advanced Experimental Methods and Statistics © 2014, Michael Kalsher.
Part II Exploring Relationships Between Variables.
Measures of dispersion
Comparing several means: ANOVA (GLM 1)
Descriptive Statistics I REVIEW
By C. Kohn Waterford Agricultural Sciences
Reliability, the Properties of Random Errors, and Composite Scores
Psychological Measurement: Reliability and the Properties of Random Errors The last two lectures were concerned with some basics of psychological measurement:
Analysis of Variance: repeated measures
Presentation transcript:

Data Analysis Outline What is an experiment? What are independent vs. dependent variables in an experimental study? What are our dependent measures/variables in this study?

Goals for Today Learn about the basics of an experiment Learn how to create a unit-weighted composite variable and how/why it is used in psychology. Learn how to create composite variables in SPSS. Learn how to compare the difference between two groups using Cohen’s d.

Composite Scores When we have used multiple ways of assessing a construct (e.g., self-esteem), we often create a composite that captures the these scores.

It is assumed that there is variation across people with respect to the latent variable (i.e., self-esteem). A “latent variable” is one that we assume exists, but that we cannot observe directly. Most constructs in psychology are latent variables: memory, extraversion, self-esteem, intelligence.

Latent Self-esteem Item 1 Self-esteem Item 2 Self-esteem Item 3 Self-esteem Item 4 Self-esteem It is also assumed that variation in this latent variable causes variation in the observed responses (i.e., the ratings of each item).

Reverse Scored Items Some items are negatively related to the construct of interest. –Ex: “I feel I do not have much to be proud of. ” These items cannot be weighted in the same fashion as the others when creating a composite variable.

Unit-weighted composite To create a “unit-weighted composite”—the most commonly used composite in personality psychology, do the following: –1. Reverse-key responses to items that are in the opposite direction of the construct.

One way to do this is to use the following formula: Max - X + Min Thus, on a 1 (Min) to 5 (Max) scale, like the one we used, we would use the following equation to reverse key the responses: Rev key response = 5 – X + 1

2. Once the appropriate responses have been reverse keyed, simply average the responses for each person.

ItemPerson 1Person 2Person 3 I feel that I'm a person of worth, at least on an equal plane with others 552 I feel that I have a number of good qualities.543 All in all, I am inclined to feel that I am a failure. (Reverse) 1 (5)2 (4)3 (3) I am able to do things as well as most other people. 552 I feel I do not have much to be proud of. (Reverse) 1 (5) 4 (2) Sum Average

Qualifications This method is the simplest, but there are more complex ways of creating composites. –For example, sometimes responses to each variable are standardized before the averaging takes place. –In some work, the different variables are weighted differently. That is, some variables count more than others. –In other work, non-linear relationships might be assumed between the latent variable and an item response (e.g., Item Response Theory models).

Mean Differences The big question in our experiment is whether people’s self-esteem improves after listening to a subliminal recording containing subliminal messages designed to improve self-esteem.

Our Experiment Two conditions: –A. People in the “good” condition were presented with self-affirming subliminal messages, such as “You are a good person.” –B. People in the “bad” condition were presented with self-defacing subliminal messages, such as “No one likes you.”

Answering the Question One way of addressing the question is whether the self-esteem of people in the Condition A is higher than that of people in Condition B. (As measured after hearing the recording.)

Everyone has a unique self-esteem score, so we average the scores (i.e., the composite scores) for people in Condition A and separately average the scores for people in Condition B. We want two statistics: (a) the mean, which tells us the average self-esteem value for a person in Condition X, and (b) the standard deviation (SD), which tells us the amount of variability there is around the mean in that condition.

Mean Difference between conditions: –(Mean of Group A – Mean of Group B) –If positive, then Group A > Group B –If negative, then Group A < Group B –If zero, then no difference between conditions.

Cohen’s d If we divide the mean difference by the average SD of the two groups, we obtain a standardized mean difference or Cohen’s d. Pooled standard deviation

Cohen’s d expresses the difference between groups relative to the average standard deviation of the scores.

Another Way – For Wed. We could also ask about the amount of change that takes place in self-esteem scores from Time 1 (before the recording) to Time 2 (after the recording). Create a composite for the Time 1 scores. Create a new variable in SPSS that represents the Time 2 composite – Time 2 composite scores.