1. 9/3/20151 Data in the Classroom CSU Fresno November 1, 2010

2. 9/3/20152 Presenters  John Korey Cal Poly Pomona, Political Science Cal Poly Pomona, Political Science jlkorey@csupomona.edu jlkorey@csupomona.edu jlkorey@csupomona.edu  Ed Nelson CSU Fresno, Sociology CSU Fresno, Sociology ednelson@csufresno.edu ednelson@csufresno.edu ednelson@csufresno.edu

3. 9/3/20153 Workshop Agenda  Introductions (Ed Nelson)  SSRIC (Ed)  Data for this workshop (John Korey)  Issues and examples Experimental design (John) Experimental design (John) Sampling and Statistical Inference (Ed) Sampling and Statistical Inference (Ed) Causality and contingency tables (Ed and John) Causality and contingency tables (Ed and John) Fun with graphics (John) Fun with graphics (John) Change over time (John) Change over time (John)  Where can we get the data? (John)  What are we doing this year at Fresno State? (Ed)  Evaluations

4. 9/3/20154 SSRIC Social Science Research & Instructional Council http://www.ssric.org http://www.ssric.org

5. 9/3/20155 The Council  Oldest CSU affinity group -- founded in 1972  Each campus has a representative  Works to provide access to data  Promotes use of data analysis in research and teaching

6. 9/3/20156 The Council  Annual student research conference on April 29 at San Jose State University  Sponsors attendance at the ICPSR summer workshops in Ann Arbor, Michigan http://www.ssric.org/participate/icpsr_summ er http://www.ssric.org/participate/icpsr_summ er http://www.ssric.org/participate/icpsr_summ er http://www.ssric.org/participate/icpsr_summ er  Works with the Field Institute -- selects faculty fellow (12 questions) – proposal due April 15

7. Datasets for This Workshop  Based on SPSS for Windows 16.0: A Basic Tutorial (http://www.ssric.org/trd/spss16) http://www.ssric.org/trd/spss16 General Social Survey (GSS) 2006 Subset General Social Survey (GSS) 2006 Subset  Based on Introduction to Research Methods (http://www.csupomona.edu/~jlkorey/POWERMUTT/i ndex.html) http://www.csupomona.edu/~jlkorey/POWERMUTT/i ndex.htmlhttp://www.csupomona.edu/~jlkorey/POWERMUTT/i ndex.html American National Election Study (ANES) 2004 Subset American National Election Study (ANES) 2004 Subset GSS Cumulative File Subset GSS Cumulative File Subset ANES 2000-2002-2004 Panel Study Subset ANES 2000-2002-2004 Panel Study Subset U.S. Senate U.S. Senate 9/3/20157

8. 8 Issues and Examples Experimental design Experimental design Sampling and statistical inference Sampling and statistical inference Causality and contingency tables Causality and contingency tables Fun with graphics Fun with graphics Change over time Change over time

9. 9/3/20159 Experimental Design

10. 9/3/201510 Design Requirements  Experiments Random assignment to groups Random assignment to groups Manipulation by experimenter of independent (predictor) variable Manipulation by experimenter of independent (predictor) variable  Quasi-experiments

11. 9/3/201511 Types of Experiments  Laboratory  Field

12. 9/3/201512 Laboratory Experiment: Prisoner’s Dilemma HOMICIDE DIVISION INTERROGATION ROOM A HOMICIDE DIVISION INTERROGATION ROOM B

13. 9/3/201513 Laboratory Experiment: Prisoner’s Dilemma INTERROGATION IN PROGRESS DO NOT ENTER

14. 9/3/201514 Laboratory Experiment: Prisoner’s Dilemma JACK’S BAIL BONDS “I’ll get you out if it takes 20 years.” 909/869-4619 24/7

15. 9/3/201515 Laboratory Experiment: Prisoner’s Dilemma Outcomes KEY: A'S OUTCOME B'S OUTCOME A TALKSA DOESN'T TALK B TALKS10 YEARS DEATH 1 YEAR B DOESN’T TALK 1 YEAR DEATHWALK

16. 9/3/201516 Field Experiments Gosnell (1927) Gerber and Green (2000)

17. 9/3/201517 Resources  The Center for Experimental Social Science The Center for Experimental Social Science The Center for Experimental Social Science

18. 9/3/201518 Experimental Design in Survey Research  Telephone vs. face to face (2000 ANES)  Question wording: Do you favor or oppose doing away with the DEATH tax? Do you favor or oppose doing away with the DEATH tax? Do you favor or oppose doing away with the ESTATE tax? Do you favor or oppose doing away with the ESTATE tax?

19. 9/3/201519 House

20. 9/3/201520 Estate http://en.wikipedia.org/wiki/File:Ashford_castle.jpg

21. 9/3/201521 Results (2002 ANES)  Favor abolishing “death tax”: 74.3%  Favor abolishing “estate tax”: 71.5% p = n.s.

22. 9/3/201522 Sampling and Statistical Inference

23. 9/3/201523 What do we want to make sure our students understand?   Populations and samples   Parameters and statistics   Sampling variability   Margin of error   Confidence intervals and confidence levels

24. 9/3/201524 Basic principle   Samples vary   What factors influence sampling variability? Size of sample Population variability How sample was selected

25. 9/3/201525 Using Simulations to Teach Statistical Inference   Draw repeated random samples   Compute sample statistic   Construct chart showing the distribution of these sample statistics   Demonstration – see http://constats.atech.tufts.edu http://constats.atech.tufts.edu

26. 9/3/201526 Estimators and Estimates   An estimator is the method and an estimate is the numerical result   Demonstration – see http://inspire.stat.ucla.edu/unit_09/teaching_t ips.php http://inspire.stat.ucla.edu/unit_09/teaching_t ips.php

27. 9/3/201527 Resources -- Exercises   Rolling dice and flipping coins – see http://www.causeweb.org/repository/StarLibr ary/activities/andrews_2003/ http://www.causeweb.org/repository/StarLibr ary/activities/andrews_2003/   M&M’s – see http://www.ropercenter.uconn.edu/education/ assignments/polling_basics.pdf http://www.ropercenter.uconn.edu/education/ assignments/polling_basics.pdf   Drawing cards (Aces to Kings) – Xuanning Fu (CSU Fresno)

28. 9/3/201528 Resources – Web Sites   Roper Center -- Fundamentals of polling: http://www.ropercenter.uconn.edu/education/ polling_fundamentals.html http://www.ropercenter.uconn.edu/education/ polling_fundamentals.html   American Association for Public Opinion Research – more on polling -- http://www.aapor.org/Poll_andamp_Survey_F AQs.htm http://www.aapor.org/Poll_andamp_Survey_F AQs.htm   Sample size calculator -- http://www.surveysystem.com/sscalc.htm http://www.surveysystem.com/sscalc.htm

29. 9/3/201529 Causality and Contingency Tables

30. 9/3/201530 What do we need to do to establish cause and effect?  Statistical relationship  Causal ordering  Eliminate alternative explanations

31. 9/3/201531 Example  Religiosity and how to regulate the distribution of pornography – data set – gss06_subset_for_classes_modified2.sav RELITEN – how religious the respondent is RELITEN – how religious the respondent is PORNLAW – how the respondent feels about regulating the distribution of pornography PORNLAW – how the respondent feels about regulating the distribution of pornography

32. 9/3/201532 Spuriousness  Are there any alternative explanations (other than the causal one) for the relationship?  Can we think of any alternative explanations for RELITEN and PORNLAW?  Gender might account for this relationship. Women are more religious than men and also more likely to want to restrict the distribution of pornography  In other words, the relationship between X and Y might be spurious. So what we need to do is to test for spuriousness

33. 9/3/201533 Testing for Spuriousness  Independent variable (X) is RELITEN  Dependent variable (Y) is PORNLAW  Control variable (C) is SEX

34. 9/3/201534 Conclusions  We found out that the relationship of RELITEN and PORNLAW was not spurious when we controlled for SEX  But does that mean that we can conclude that the relationship is never spurious?  What does this say about proving causality?

35. 9/3/201535 Applying this to the Classroom  Start with examples that make sense to students  Move to examples with real data that students can run  Generalize to issues of testing causality Can show that a relationship is not causal (i.e., it’s spurious) Can show that a relationship is not causal (i.e., it’s spurious) Can never prove that a relationship is causal. Can never prove that a relationship is causal.

36. 9/3/201536 Example: Specification  Open General Social Survey Subset  Does level of education influence the relationship between political views and party identification?

37. 9/3/201537 Specification (continued)  From Menu bar, go to: Analyze  Descriptive Statistics  Crosstabs Dependent variable (first box): partyid Independent variable (second box): polviews Control variable: (third box): degree Statistics: Kendall’s tau b Cells: Column percentages

38. 9/3/201538 Specification (continued)  Look at pattern of Kendall’s tau b statistics

39. 9/3/201539 Example: Reactivity  We know that the race of the interviewer in face-to-face interviews affects what people tell us about race  We know that the perceived race of the interviewer in telephone interviews also influences what people tell us  What about the gender of the interviewer in face-to-face interviews?

40. 9/3/201540 ANES Example  Open anes04s  We’ll going to use three variables GENDER – gender of respondent GENDER – gender of respondent INTGENPO – gender of interviewer INTGENPO – gender of interviewer WORKMOM – do you agree or disagree [that a] working mother can establish just as warm and secure a relationship with her children as a mother who does not work? WORKMOM – do you agree or disagree [that a] working mother can establish just as warm and secure a relationship with her children as a mother who does not work?  Let’s start by using the gender of the interviewer (INTGENPO) as our independent variable and WORKMOM as our dependent variable  Let’s start by using the gender of the interviewer (INTGENPO) as our independent variable and WORKMOM as our dependent variable

41. 9/3/201541 ANES Example Continued  What did we discover? Respondents interviewed by women are more likely to agree that working mothers can have a warm relationship with their children  Now let’s see if this is true for both male and female respondents. Let’s control for GENDER – gender of the respondent  We discover that it is true for both men and women. It appears that the gender of the interviewer does influence what people tell us about working mothers and their children

42. 9/3/201542 ANES Example Implications  Since about 75% of the interviewers in this survey were women, this has some serious implications.  This suggests that we will overestimate the percent of people that feel that working mothers can have a warm relationship with their children

43. 9/3/201543 Fun with Graphics

44. 9/3/201544 Box and Whiskers Plots  Open senate file (senate_mod.sav)  Compare acu and dwnom scores 1. Graphs  Legacy Dialogs  Boxplots  Clustered  Summarize by Separate Variables  Define 2. 1st box: acu, dwnom; 2 nd box: party; 3 rd box: name; OK

45. 9/3/201545 Box and Whiskers Plots (continued)  Convert acu and dwnom to Z scores 1. Analyze  Descriptive Statistics  Descriptives 2. Move acu and dwnom to right window 3. Check Save standardized values as variables

46. 9/3/201546 Box and Whiskers Plots (continued)  Compare Zacu and Zdwnom scores 1. Graphs  Legacy Dialogs  Boxplots  Clustered  Summarize by Separate Variables  Define 2. 1st box: Zacu, Zdwnom; 2 nd and 3 rd boxes remain the same; OK

47. 9/3/201547 Sample Size and the “Margin of (Sampling) Error” http://www.surveysystem.com/sscalc.htm

48. 9/3/201548 Just the Facts http://pollingreport.com/guns.htm

49. 9/3/201549 Poll Aggregators http://www.pollster.com/polls/

50. Do It Yourself Prognostication http://uselectionatlas.org/PRED/ 9/3/201550

51. 9/3/201551 Resources  Examples of Assignments (Roper Center) Examples of Assignments Examples of Assignments  Polling 101: Fundamentals of Polling (Roper Center) Polling 101: Fundamentals of Polling 101: Fundamentals of Polling  Polling 201: Analyzing Surveys (Roper Center) Polling 201: Analyzing Surveys Polling 201: Analyzing Surveys  Polling for Dummies Polling for Dummies Polling for Dummies  Sample size calculator (Creative Research Systems) Sample size calculator Sample size calculator  Sampling Distributions (Tufts) Sampling Distributions Sampling Distributions  Polling and Survey FAQs (AAPOR) Polling and Survey FAQs Polling and Survey FAQs

52. 9/3/201552 Change Over Time

53. 9/3/201553 Objectives To explain:  Trend and cohort analysis (gsscums.sav)  Panel studies (anespanl.sav)

54. 9/3/201554 Age Cohorts  GI Generation (born 1927 or earlier)  Silent Generation (1928-1945)  Baby Boomers (1946-1964)  Generation X (1965-1981)  Generation Y (1982 or later)

55. 9/3/201555 Procedure  SPSS line charts

56. 9/3/201556 Dependent Variables  Values recoded into two categories (0 and 100) as nearly equal in size as possible.  Example: Confidence in press is recoded as 100 (a lot or only some) and 0 (hardly any or none).  The resulting line graph can be interpreted as the percent of respondents coded as 100, that is, having at least some confidence in the press.

57. 9/3/201557 Trend Analysis: Daily Newspaper Readership (Commands)  Open gsscums.sav  Click on Graphs -> Legacy Dialogs -> Interactive -> Line  Move NEWS to first window on right, and YEAR to second window. Click on OK

58. 9/3/201558 Trend Analysis: Daily Newspaper Readership (Results)

59. 9/3/201559 Cohort Analysis  To illustrate: Generational replacement Generational replacement Life cycle patterns Life cycle patterns Across the board change Across the board change

60. 9/3/201560 Cohort Analysis: Daily Newspaper Readership (Commands)  Open gsscums.sav  Click on Graphs -> Legacy Dialogs -> Interactive -> Line  Move NEWS to first window on right, YEAR to second window, and COHORT to third window. Click on OK

61. 9/3/201561 Cohort Analysis: Daily Newspaper Readership (Results)

62. 9/3/201562 More Cohort Analysis Repeat above commands (first without, then with, COHORT), but instead of NEWS, use TVHOURS (over 2 hours per day watching TV), then CONPRESS (at least some confidence in the press)

63. 9/3/201563 Even More Cohort Analysis Repeat above, but try the following:  GRASS (favor legalization of marijuana)  RACMAR (oppose interracial marriage)  TRUST (think most people can be trusted)

64. 9/3/201564 Panel Studies  Open anespanl.sav  Did respondents in 2004 recall their 2000 vote differently than they had in 2000?  Click on Analyze -> Descriptive Statistics -> Frequencies  Obtain frequency distributions for P200004 and P200000.

65. 9/3/201565 Panel Studies  Did the relationship between party identification and feelings about Ralph Nader change between 2000 (pre-election) and 2004?  Click on Analyze -> Compare Means -> Means.  Move NADR00PR and NADR04 to first window on right, and PTYID300 to second window. Click on OK.

66. 9/3/201566 Where Can We Get Data? Data resources on or linked from the SSRIC website: http://www.ssric.org/data

67. 9/3/201567 Social Science Databases  The California State University subscribes to three data bases to support teaching and research  Data bases Inter-university Consortium for Political and Social Research (ICPSR) at the University of Michigan Inter-university Consortium for Political and Social Research (ICPSR) at the University of Michigan Field Poll in San Francisco Field Poll in San Francisco Roper Center for Public Opinion Research at the University of Connecticut Roper Center for Public Opinion Research at the University of Connecticut General Social Survey and American National Election Studies are available through these databases General Social Survey and American National Election Studies are available through these databases These are available to campuses by annual subscription These are available to campuses by annual subscription

68. 9/3/201568 Proxy Servers  On-campus access to data bases is IP authenticated  Off-campus access to ICPSR and Roper through your campus’ proxy server  For ICPSR, account only needs to be authenticated from on campus or via proxy server every six months; otherwise, can be accessed from anywhere.  Off-campus access not available for Field data  Another alternative: set up a VPN on your home computer

69. 9/3/201569 Where Do We Get the Data? SSRIC: http://www.ssric.org/data SSRIC: http://www.ssric.org/datahttp://www.ssric.org/data Pew: http://people-press.org/dataarchive/ Pew: http://people-press.org/dataarchive/http://people-press.org/dataarchive/ PPIC: http://www.ppic.org/main/datadepot.asp PPIC: http://www.ppic.org/main/datadepot.asp http://www.ppic.org/main/datadepot.asp Berkeley’s SDA archive: http://sda.berkeley.edu/archive.htm Berkeley’s SDA archive: http://sda.berkeley.edu/archive.htm http://sda.berkeley.edu/archive.htm ICPSR: http://www.icpsr.org ICPSR: http://www.icpsr.orghttp://www.icpsr.org Roper: http://www.ropercenter.uconn.edu Roper: http://www.ropercenter.uconn.eduhttp://www.ropercenter.uconn.edu Field Field Public : ftp://128.32.165.222:2121/ (download spss files) ftp://128.32.165.222:2121/ CSU and UC only ( analyze online): http://ucdata.berkeley.edu/data_record.p hp?recid=3#analyze http://ucdata.berkeley.edu/data_record.p hp?recid=3#analyze http://ucdata.berkeley.edu/data_record.p hp?recid=3#analyze

70. 9/3/201570 What are we doing this year at Fresno State?   Workshops for faculty and staff Teaching with Data (September 23) Data in the classroom (November 1 with special guest presenter John Korey, Political Science, CSU Pomona) Online statistical packages (SDA) (early spring) SPSS (introductory and intermediate) (late spring)   Encourage students to present their research at student research conferences (SRC) SSRIC’s SRC in San Jose on April 29 Santa Clara University’s Anthropology and Sociology SRC in April CSU’s Student Research Competition in Fresno on May 6-7   Presentations at the department level   One-on-one consultations with faculty   Surveys to get faculty’s input and feelings

71. 9/3/201571 Evaluations