Research Supported by: National Science Foundation, SES—0922714 Cultural Cognition Lab, Yale Law School www.culturalcognition.net “Motivated Numeracy”:

Slides:



Advertisements
Similar presentations
Study Design 1,500 adults drawn from nationally representative on-line panel Commonwealth v. Berkowitz: Alleged rape of female college student by male.
Advertisements

Watch in slide show mode to observe (modest) animation.
Is Ideologically Motivated Reasoning Rational? And Do Only Conservatives Engage In It?!
Cognitive Illiberalism
Decision-relevant Science: How Do People Think About It?
Watch in slide show mode to observe (modest) animation. comments questions: papers, etc:
Watch in slide show mode to observe (modest) animation. comments questions: papers,etc:
Dan M. Kahan Yale University What Should Science Communicators Communicate About Sea Level Rise?
Watch in slide show mode to observe (modest) animation. Download paper here.here.
Watch in slide show mode to observe (modest) animation. comments questions: papers, etc:
Watch in slide show mode to observe (modest) animation.
Watch in slide show mode to observe (modest) animation.
Watch in slide show mode to observe (modest) animation. comments questions: papers,etc:
Dan M. Kahan Yale University & many others Thinking Scientifically About Climate Science Communication.
Watch in slide show mode to observe (modest) animation. comments questions: papers,etc:
LINEAR REGRESSION: Evaluating Regression Models Overview Assumptions for Linear Regression Evaluating a Regression Model.
LINEAR REGRESSION: Evaluating Regression Models. Overview Assumptions for Linear Regression Evaluating a Regression Model.
Watch in slide show mode to observe (modest) animation. comments questions: papers, etc:
Watch in slide show mode to observe (modest) animation. Download paper here.here.
One Theory to Rule Them All: The Cultural Cognitive Approach to Public Opinion on Everything from Gun Control to Climate Change John Gastil Univ. of Washington.
PY 427 Statistics 1Fall 2006 Kin Ching Kong, Ph.D Lecture 6 Chicago School of Professional Psychology.
Educational Research by John W. Creswell. Copyright © 2002 by Pearson Education. All rights reserved. Slide 1 Chapter 8 Analyzing and Interpreting Quantitative.
Today Concepts underlying inferential statistics
Watch in slide show mode to observe (modest) animation. comments questions: papers,etc:
Dan M. Kahan Yale University & many others Thinking Scientifically About Climate Science Communication.
Watch in slide show mode to observe (modest) animation. comments questions: papers, etc:
Watch in slide show mode to observe (modest) animation. comments questions: papers,etc:
What Is “Cultural Cognition”? I’ll Show You!
Watch in slide show mode to observe (modest) animation. comments questions: papers, etc:
Watch in slide show mode to observe (modest) animation. comments questions: papers, etc:
Watch in slide show mode to observe (modest) animation. comments questions: papers, etc:
Watch in slide show mode to observe (modest) animation. comments questions: papers, etc:
Research Process Parts of the research study Parts of the research study Aim: purpose of the study Aim: purpose of the study Target population: group whose.
Informing Public Perceptions of Risk and Other Legally Consequential Facts www. culturalcognition.net Dan M. Kahan Yale University & many others.
Watch in slide show mode to observe (modest) animation. comments questions: papers, etc:
Chapter 4 Linear Regression 1. Introduction Managerial decisions are often based on the relationship between two or more variables. For example, after.
Watch in slide show mode to observe (modest) animation. papers,etc:
Watch in slide show mode to observe (modest) animation. comments questions: papers, etc:
Watch in slide show mode to observe (modest) animation. comments questions: papers, etc:
1 Chapter 8 Introduction to Hypothesis Testing. 2 Name of the game… Hypothesis testing Statistical method that uses sample data to evaluate a hypothesis.
Prelimary Draft paper posted at Cultural Identity Strongly Influences Data Interpretation.
Dan M. Kahan Yale University & 10^3 others Two science communication puzzles...
© 2006 by The McGraw-Hill Companies, Inc. All rights reserved. 1 Chapter 12 Testing for Relationships Tests of linear relationships –Correlation 2 continuous.
Watch in slide show mode to observe (modest) animation. Download paper here.here.
“Ideology” or “Situation Sense”? An Experimental Investigation of Motivated Reasoning and Professional Judgment.
The climate-science literacy measurement problem—and how to fix it Dan M. Kahan Yale University.
Www. culturalcognition.net Lab Meeting #
Shifting the Worldview How Values Shape What We Hear Kyle Nolan and Max Boyle.
Watch in slide show mode to observe (modest) animation. comments questions: papers, etc:
Watch in slide show mode to observe (modest) animation. Download paper here.here.
Educational Research Inferential Statistics Chapter th Chapter 12- 8th Gay and Airasian.
Chapter 11 REGRESSION Multiple Regression  Uses  Explanation  Prediction.
Dan M. Kahan Yale University & many x 10 3 others WTF?! The “ ‘According to climate scientists,’...” paradox.
Watch in slide show mode to observe (modest) animation.
Watch in slide show mode to observe (modest) animation.
Dissensus on Scientific Consensus: Who Perceives What and Why
Watch in slide show mode to observe (modest) animation.
Watch in slide show mode to observe (modest) animation.
Watch in slide show mode to observe (modest) animation.
Motivated System 2 Reasoning and Science Curiosity:
Watch in slide show mode to observe (modest) animation.
Can science films make a difference?
Culturally Contested Facts:
On the Sources of Ordinary Science Intelligence and Ignorance
Regression Diagnostics
“Ideology” or “Situation Sense”?
Watch in slide show mode to observe (modest) animation.
Chapter 6 Making Sense of Statistical Significance: Decision Errors, Effect Size and Statistical Power Part 1: Sept. 18, 2014.
Watch in slide show mode to observe (modest) animation.
Can Environmental Education have a Significant Impact on a Person’s Risk Perception of Environmental Issues?
Presentation transcript:

Research Supported by: National Science Foundation, SES— Cultural Cognition Lab, Yale Law School “Motivated Numeracy”: What’s the Point?

I. Two theories II. Three studies III. One synthesis The science communication problem

Two theories Public irrationality thesis (“PIT”) Cultural cognition thesis (“CCT”)

Two theories Public irrationality thesis (“PIT”) Cultural cognition thesis (“CCT”)

Hierarchy Egalitarianism Abortion procedure Individualism Communitarianism Environment: climate, nuclear Guns/Gun Control HPV Vaccination Gays military/gay parenting Environment: climate, nuclear hierarchical communitarians egalitarian individualists Cultural Cognition Worldviews egalitarian communitarians Risk Perception Key Low Risk High Risk cats/annoying varmints hierarchical individualists

Two theories Public irrationality thesis (“PIT”) Cultural cognition thesis (“CCT”)

I. Two theories II. Three studies III. One synthesis The science communication problem

Three studies

Perceived risk Science comprehension Low High perceived risk (z-score) “How much risk do you believe climate change poses to human health, safety, or prosperity?” Low High Science comprehension PIT PredictionActual Response Greater Lesser Greater Lesser U.S. general population survey, N = 1,500. Scale 0 (“no risk at all”) to 10 (“extreme risk”), M = 5.7, SD = 3.4. CIs reflect 0.95 level of confidence.

Perceived risk Science comprehension Low High perceived risk (z-score) “How much risk do you believe climate change poses to human health, safety, or prosperity?” Low High Science comprehension PIT PredictionActual Response Greater Lesser Greater Lesser U.S. general population survey, N = 1,500. Scale 0 (“no risk at all”) to 10 (“extreme risk”), M = 5.7, SD = 3.4. CIs reflect 0.95 level of confidence.

Hierarchy Egalitarianism Risk Perception Key Low Risk High Risk Individualism Communitarianism Environment: climate, nuclear Cultural Cognition Worldviews

Low High perceived risk (z-score) “How much risk do you believe climate change poses to human health, safety, or prosperity?” Science comprehension PIT variance Greater Lesser U.S. general population survey, N = 1,500. Scale 0 (“no risk at all”) to 10 (“extreme risk”), M = 5.7, SD = 3.4. CIs reflect 0.95 level of confidence. perceived risk (z-score) Greater Lesser CCT variance Hiearch Individualist Egalitarian Communitaran

Low High perceived risk (z-score) “How much risk do you believe climate change poses to human health, safety, or prosperity?” Science comprehension PIT variance Greater Lesser U.S. general population survey, N = 1,500. Scale 0 (“no risk at all”) to 10 (“extreme risk”), M = 5.7, SD = 3.4. CIs reflect 0.95 level of confidence. perceived risk (z-score) Greater Lesser CCT variance Hiearch Individualist Egalitarian Communitaran What is relationship of PIT & CIT

Low High perceived risk (z-score) “How much risk do you believe climate change poses to human health, safety, or prosperity?” Science comprehension PIT variance Greater Lesser U.S. general population survey, N = 1,500. Scale 0 (“no risk at all”) to 10 (“extreme risk”), M = 5.7, SD = 3.4. CIs reflect 0.95 level of confidence. perceived risk (z-score) Greater Lesser CCT variance Hiearch Individualist Egalitarian Communitaran PIT prediction: Culture as heuristic substitute

Low High perceived risk (z-score) “How much risk do you believe climate change poses to human health, safety, or prosperity?” Science comprehension PIT variance Greater Lesser U.S. general population survey, N = 1,500. Scale 0 (“no risk at all”) to 10 (“extreme risk”), M = 5.7, SD = 3.4. CIs reflect 0.95 level of confidence. perceived risk (z-score) Greater Lesser CCT variance Hiearch Individualist Egalitarian Communitaran PIT prediction: Culture as heuristic substitute

Low High perceived risk (z-score) “How much risk do you believe climate change poses to human health, safety, or prosperity?” Science comprehension Lesser U.S. general population survey, N = 1,500. Scale 0 (“no risk at all”) to 10 (“extreme risk”), M = 5.7, SD = 3.4. CIs reflect 0.95 level of confidence. perceived risk (z-score) Greater Lesser PIT Prediction Actual Result Greater Egalitarian Communitarian Hierarchical Individualist Low High Science comprehension

Low High perceived risk (z-score) “How much risk do you believe climate change poses to human health, safety, or prosperity?” Science comprehension Lesser U.S. general population survey, N = 1,500. Scale 0 (“no risk at all”) to 10 (“extreme risk”), M = 5.7, SD = 3.4. CIs reflect 0.95 level of confidence. perceived risk (z-score) Greater Lesser PIT Prediction Actual Result Greater Egalitarian Communitarian Hierarchical Individualist High Sci lit/numeracy Egal Comm Low Sci/lit numeracy Egal Comm Low High Science comprehension

Low High perceived risk (z-score) “How much risk do you believe climate change poses to human health, safety, or prosperity?” Science comprehension Lesser U.S. general population survey, N = 1,500. Scale 0 (“no risk at all”) to 10 (“extreme risk”), M = 5.7, SD = 3.4. CIs reflect 0.95 level of confidence. perceived risk (z-score) Greater Lesser PIT Prediction Actual Result Greater Egalitarian Communitarian Hierarchical Individualist High Sci lit/numeracy Egal Comm Low Sci/lit numeracy Egal Comm Low High Science comprehension Low Sci lit/num. Hierarc Individ High Sci lit/numeracy Hierarch Individ

Low High perceived risk (z-score) “How much risk do you believe climate change poses to human health, safety, or prosperity?” Science comprehension Lesser U.S. general population survey, N = 1,500. Scale 0 (“no risk at all”) to 10 (“extreme risk”), M = 5.7, SD = 3.4. CIs reflect 0.95 level of confidence. perceived risk (z-score) Greater Lesser PIT Prediction Actual Result Greater Egalitarian Communitarian Hierarchical Individualist High Sci lit/numeracy Egal Comm Low Sci/lit numeracy Egal Comm Low High Science comprehension Low Sci lit/num. Hierarc Individ High Sci lit/numeracy Hierarch Individ High Sci lit/numeracy mean Low Sci lit/numeracy sample mean POLARIZATION INCREASES as science comprehension increases

Three studies

Kahan, D.M. Ideology, Motivated Reasoning, and Cognitive Reflection. Judgment and Decision Making 8, (2013).

“Skin cream experiment”

Two conditions

Correct interpretation of data rash decreases rash increases Lowess smoother superimposed on raw data. correct incorrect Numeracy score

numeracy score at & above which subjects can be expected to correctly interpret data. Numeracy

“Gun ban experiment”

Four conditions

Correct interpretation of data Gun ban skin treatment

Correct interpretation of data skin treatment Gun ban

Numeracy Conserv_Repub is standardized sum of standardized responses to 5-point liberal-conservative ideology and 7-point party-self-identification measures.

Correct interpretation of data Liberal Democrats (< 0 on Conservrepub) Conserv Republicans (> 0 on Conservrepub) skin treatment Gun ban

Correct interpretation of data Liberal Democrats (< 0 on Conservrepub) Conserv Republicans (> 0 on Conservrepub) skin treatment Gun ban

N = Outcome variable is “Correct” (0 = incorrect interpretation of data, 1 = correct interpretation). Predictor estimates are logit coefficients with z-test statistic indicated parenthetically. Experimental assignment predictors— rash_decrease, rash_increase, and crime_increase—are dummy variables (0 = unassigned, 1 = assigned—with assignment to “crime decreases” as the comparison condition. Z_numeracy and Conserv_Repub are centered at 0 for ease of interpretation. Bolded typeface indicates predictor coefficient is significant at p < Best fitting regression model for experiment results rash_decrease0.40(1.57) rash increase0.06(0.22) crime increase1.07(4.02) z_numeracy-0.01(-0.05) z_numeracy_x_rash_decrease0.55(2.29) z_numeracy_x_rash_increase0.23(1.05) z_numeracy_x_crime_increase0.46(2.01) z_numeracy20.31(2.46) z_numeracy2_x_rash_decrease0.02(0.14) z_numeracy2_x_rash_increase-0.07(-0.39) z_numeracy2_x_crime_increase-0.31(-1.75) Conserv_Repub-0.64(-3.95) Conserv_Repub_x_rash_decrease0.56(2.64) Conserv_Repub_x_rash_increase1.28(6.02) Conserv_Repub_x_crime_increase0.63(2.82) z_numeracy_x_Conserv_repub-0.33(-1.89) z_nuneracy_x_Conserv_Repub_x_rash_decrease0.33(1.40) z_nuneracy_x__x_rash_increase0.54(2.17) z_nuneracy_x__x_crime_increase0.26(1.08) _constant-0.96(-4.70)

probabilility of correct interpretation of data rash decreases rash increases rash decreases rash increases rash decreases rash increases rash decreases rash increases crime increases crime decreases crime increases crime decreases crime increases 0%10%20% 30% 40% 50%60%70% 80%90%100% crime decreases crime increases probabilility of correct interpretation of data High numeracyLow numeracy high numeracy = 7 correct low numeracy = 3 correct skin treatment Gun ban Liberal Democrat (-1 SD on Conservrepub) Conserv Republican (+1 SD on Conservrepub)

probabilility of correct interpretation of data 0%10%20% 30% 40% 50%60%70% 80%90%100% probabilility of correct interpretation of data Gun ban Avg. “polarization” on crime data for high numeracy partisans 46% (± 17%) Avg. “polarization” on crime data for low numeracy partisans 25% (± 9%) crime increases crime decreases crime increases crime decreases crime increases crime decreases crime increases High numeracyLow numeracy high numeracy = 7 correct low numeracy = 3 correct Liberal Democrat (-1 SD on Conservrepub) Conserv Republican (+1 SD on Conservrepub)

High numeracyLow numeracy EC rash increases HI crime decrease HI crime increase EC crime decrease EC crime increase HI crime decrease HI crime increase EC crime decrease EC crime increase HI rash increases HI rash decreases probabilility of correct interpretation of data EC rash decreases EC rash increases HI rash increases HI rash decreases skin treatment high numeracy = 7 correct low numeracy = 3 correct Egalitarian communitarian (-1 SD on Hfac & Ifac) Hierarch individid (+1 SD on Hfac & Ifac) Gun ban

“How much risk do you believe climate change poses to human health, safety, or prosperity?”

I. Two theories II. Three studies III. One synthesis The science communication problem

A.The tragedy of the science communication commons B.The pathology of antagonistic meanings C.The science communication environment as a collective good One synthesis

The science communication problem

Not too little rationality, but too much.

The science communication problem Not too little rationality, but too much.

A.The tragedy of the science communication commons B.The pathology of antagonistic meanings C.The science communication environment as a collective good One synthesis

The science communication problem

The science communication problem is not normal

Normal

Pathological

A.The tragedy of the science communication commons B.The pathology of antagonistic meanings C.The science communication environment as a collective good One synthesis

“Scicomm# enviornment Protection”

“Mitigation”: Avoiding, detoxifying

“Scicomm# enviornment Protection” “Mitigation”: Avoiding, detoxifying “Adaptation”: Fortifying reason

I. Two theories II. Three studies III. One synthesis The science communication problem

Dan M. Kahan Yale Law School Donald Braman George Washington University John Gastil University of Washington Geoffrey Cohen Stanford University Paul Slovic University of Oregon Ellen Peters Ohio State University Hank Jenkins-Smith University of Oklahoma David Hoffman Temple Law School Gregory Mandel Temple Law School Maggie Wittlin Cultural Cognition Project Lab Lisa Larrimore-Ouelette Cultural Cognition Project Lab Danieli Evans Cultural Cognition Project Lab June Carbone Univ. Missouri-Kansas City Michael Jones Virginia Tech University Naomi Cahn George Washington University Jeffrey Rachlinksi Cornell Law School John Byrnes Cultural Cognition Project Lab John Monahan University of Virginia

www. culturalcognition.net “I am you!”