Download presentation
Presentation is loading. Please wait.
Published byKade Bayse Modified over 10 years ago
1
Reliability and Validity 9/5/2013
2
Readings Chapter 3 Proposing Explanations, Framing Hypotheses, and Making Comparisons (Pollock) (pp.48-58) Chapter 1 Introduction to SPSS (Pollock Workbook)
3
Homework: Due 9/12 Chapter 1 – Question 1 Parts A &B – Question 2
4
About the Homework It must be turned in during class. It cannot be emailed It must appear on the workbook paper (original or a photocopy) You cannot:
5
OPPORTUNITIES TO DISCUSS COURSE CONTENT
6
Office Hours For the Week When – Monday 10-12:00 – Tuesday 8-12 – And by appointment
7
Course Learning Objectives 1.students will achieve competency in conducting statistical data analysis using the SPSS software program. 2.Students will learn the basics of research design and be able to critically analyze the advantages and disadvantages of different types of design.
8
RELIABILITY AND VALIDITY
9
Measurement Validity A measure is valid if it measures what it is supposed to measure The measure and the concept correspond
10
Operational Validity The measure does what it says This can be difficult to establish
11
Face Validity The simplest way to seek validity The Measure looks good on its face We ask People, use the literature Problems?
12
Content Validity Using several measures of a concept to get at the whole concept Good for multi- dimensional concepts (e.g. political participation)
13
St. Edward’s Admissions $50 Application fee High School Transcript SAT or ACT Essay Recommendation Form
14
Trust in Government Trust the Federal Government Is the Government Run for the Benefit of All Do People in Government Waste Tax Money Are Government Officials Crooked
15
Freedom House Index 27 Questions A.Electoral process B.Political pluralism & participation C.Functioning of government D.Freedom of expression & belief E.Associational & organizational rights F.Rule of law G.Personal autonomy and individual rights
16
The Misery Index
17
LEED Building Leadership in Energy and Environmental Design
18
Predictive Validity Using a measure to predict a future outcome This is very difficult in the social sciences
19
The NFL Combines 40-yard dash Bench press Vertical jump Broad jump 3 cone drill Shuttle run
20
Newsweek from 1978
21
The LSAT’s The LSAT is designed to measure skills that are considered essential for success in law school The LSAT is a strong predictor of first-year law school grades What doesn’t it measure?
22
RELIABILITY
23
Measurement Reliability A measurement will provide the same results upon repeated testsrepeated The more consistent the results… the more reliable the measure
24
Random Error Outside of the control of the researcher – Outlier case – People’s feelings – weather Large sample sizes reduce this
25
Bad Weather and Turnout
26
Non-Random Error Systemic Researcher Error – Poor design – Lazy administration – Intentional error – Small samples – carelessness This will distort the measure of a concept
27
Non-Random Error
28
Ensuring Reliability Good Definitions and unambiguous questions Clear Directions Making results and information available to other researchers
29
Methods for ensuring Reliability Alternative forms technique Test-Retest
30
A measure can be reliable without being valid, but a measure cannot be valid without being reliable!
31
INDEXES AND SCALES A way of getting content validity
32
Why create a scale/index? To form a composite measure of a complex phenomenon by using two or more items Get at all facets Simplify our data
33
Examples GPA
34
Likert Scale A common way of creating a scale Advantages Disadvantages
35
Guttman Scaling Employs a series of items to produce a score for respondents Ordering questions that become harder to agree with Advantages and disadvantages
36
Guttman Scale
37
SPSS Statistical Package for the Social Sciences
38
What is a statistical package Popular Versions – SPSS – SAS – R – Stata
39
Getting SPSS Don’t Purchase a student version – Limited functions – Limited variables Searching the internet for a “free version” – You might get a virus – The Russians will steal your identity (exception fallacy). Do Use it on the machines on campus- free! Consider purchasing a 6- month license (52.00 + 4.99 download fee)purchasing
40
How to Open Data files Data Files on the Pollack CD GSS2008.SAV- the 2008 General Social Survey Dataset – n=2023 – 301 variables NES2008.SAV- the National Election Study from 2008. n=2323 – 302 variables STATES.SAV- aggregate level data for the 50 States. N=50 – 82 Variables WORLD.SAV- aggregate level data for the nations of the world. n=191 – 69 Variables
41
SPSS uses 2 windows Data Editor Window – is used to define and enter your data and to perform statistical procedures. – very spread-sheet like –.sav extension The Output Window – this is where results of statistical tests appear – This opens when you run your first test –.spv extension
42
HOW SPSS WORKS
43
It is like a spreadsheet In Variable View – You define your parameters – Give variables names – Operationalize variables We will not do a lot of this
44
Names and Labels Name how the label appears at the top of the column (like the first row in excel) you cant use dashes, special characters or start with numbers These should represent the variable Labels A longer definition of the variable These describe the actual variable
45
Value Labels This shows how variables are operationalized Value= the numeric value given to a category Label= the attribute of the concept
46
In Data View You type in raw data It looks very much like Excel Rows= cases Columns= Variables
47
How Things are Displayed Edit Options Display names Alphabetical
48
Variables I Like Values and Labels
49
Exiting SPSS If you changed the actual dataset you must save it If you ran any statistics, you must save these as well
Similar presentations
© 2025 SlidePlayer.com. Inc.
All rights reserved.