Past research in decision making has shown that when solving certain types of probability estimation problems, groups tend to exacerbate errors commonly.

Slides:



Advertisements
Similar presentations
1 Intuitive Irrationality: Reasons for Unreason. 2 Epistemology Branch of philosophy focused on how people acquire knowledge about the world Descriptive.
Advertisements

CmpE 104 SOFTWARE STATISTICAL TOOLS & METHODS MEASURING & ESTIMATING SOFTWARE SIZE AND RESOURCE & SCHEDULE ESTIMATING.
Research Methods in Psychology Complex Designs.  Experiments that involve two or more independent variables studies simultaneously at least one dependent.
Promoting Conceptual Change through Cognitive Conflict Beverly L. Wood Department of Mathematics, University of Virginia Wendi E. Dass Department of Mathematics,
Statistical Issues in Research Planning and Evaluation
1 Addressing Students’ Misconceptions about Probability Leonid Khazanov.
Realism in Assessment of Effort Estimation Uncertainty: It Matters How You Ask By Magne Jorgensen IEEE Transactions on Software Engineering Vol. 30, No.
Chapter 10: Hypothesis Testing
Fallacies in Probability Judgment Yuval Shahar M.D., Ph.D. Judgment and Decision Making in Information Systems.
EPIDEMIOLOGY AND BIOSTATISTICS DEPT Esimating Population Value with Hypothesis Testing.
Approximations and Errors
Heuristics and Biases. Normative Model Bayes rule tells you how you should reason with probabilities – it is a normative model But do people reason like.
Cognitive Processes PSY 334 Chapter 10 – Reasoning & Decision-Making August 21, 2003.
Heuristics & Biases. Bayes Rule Prior Beliefs Evidence Posterior Probability.
Determining the Size of
Relationships Among Variables
Experiments and Observational Studies.  A study at a high school in California compared academic performance of music students with that of non-music.
Elec471 Embedded Computer Systems Chapter 4, Probability and Statistics By Prof. Tim Johnson, PE Wentworth Institute of Technology Boston, MA Theory and.
8/15/2015Slide 1 The only legitimate mathematical operation that we can use with a variable that we treat as categorical is to count the number of cases.
1 Psych 5500/6500 Statistics and Parameters Fall, 2008.
Aaker, Kumar, Day Ninth Edition Instructor’s Presentation Slides
Inference in practice BPS chapter 16 © 2006 W.H. Freeman and Company.
Students’ Understanding of Human Nature: An Analogical Approach R. BROCK FROST AND ERIC AMSEL Weber State University Introduction University students enter.
Chapter 4 Gathering data
Chapter 2 Data Handling.
HAWKES LEARNING SYSTEMS Students Matter. Success Counts. Copyright © 2013 by Hawkes Learning Systems/Quant Systems, Inc. All rights reserved. Section 10.1.
Good thinking or gut feeling
Approach Participants controlled a UAV, flying over the Bagram Air Force Base, and were tasked with the goal of reaching a designated target. Success was.
Lecture 12 Statistical Inference (Estimation) Point and Interval estimation By Aziza Munir.
Example 10.1 Experimenting with a New Pizza Style at the Pepperoni Pizza Restaurant Concepts in Hypothesis Testing.
1/20 Remco Chang (Computer Science) Paul Han (Tufts Medical / Maine Medical) Holly Taylor (Psychology) Improving Health Risk Communication: Designing Visualizations.
Individual Preferences for Uncertainty: An Ironically Pleasurable Stimulus Bankert, M., VanNess, K., Hord, E., Pena, S., Keith, V., Urecki, C., & Buchholz,
Maximum Likelihood Estimator of Proportion Let {s 1,s 2,…,s n } be a set of independent outcomes from a Bernoulli experiment with unknown probability.
Chapter 5: Conceptual Framework for Accounting and Reporting, and Accounting Standards.
Copyright © 2009 Pearson Education, Inc LEARNING GOAL Interpret and carry out hypothesis tests for independence of variables with data organized.
1 of 45 How Many Samples do I Need? Part 1 Presenter: Sebastian Tindall 60 minutes (15 minute 1st Afternoon Break) DQO Training Course Day 1 Module 4.
MECN 3500 Inter - Bayamon Lecture 3 Numerical Methods for Engineering MECN 3500 Professor: Dr. Omar E. Meza Castillo
Gile Sampling1 Sampling. Fundamental principles. Daniel Gile
Statistical Hypotheses & Hypothesis Testing. Statistical Hypotheses There are two types of statistical hypotheses. Null Hypothesis The null hypothesis,
Lecture 16 Section 8.1 Objectives: Testing Statistical Hypotheses − Stating hypotheses statements − Type I and II errors − Conducting a hypothesis test.
From Bad to Worse: Variations in Judgments of Associative Memory Erin Buchanan, Ph.D., Missouri State University Abstract Four groups were tested in variations.
Chapter 221 What Is a Test of Significance?. Chapter 222 Thought Question 1 The defendant in a court case is either guilty or innocent. Which of these.
Chapter 5: Making Decisions
Uncertainty Management in Rule-based Expert Systems
Information Technology and Decision Making Information Technology and Decision Making Example 10.1 Experimenting with a New Pizza Style at the Pepperoni.
The Psychology of Prediction and Uncertainty Jason Baer.
© Copyright McGraw-Hill 2004
Statistical Techniques
Early Identification of Introductory Major's Biology Students for Inclusion in an Academic Support Program BETHANY V. BOWLING and E. DAVID THOMPSON Department.
Chi-Square Analyses.
Outline of Today’s Discussion 1.The Chi-Square Test of Independence 2.The Chi-Square Test of Goodness of Fit.
The Influence of Suggestion on Subjective Preferences By Sean Oh, Joshua Marcuse, and David Atterbury Math 5: Chance.
MODULE 9 MANAGERS AS DECISION MAKERS “Decide first, then act” How do managers use information to make decisions and solve problems? What are the steps.
A. Judgment Heuristics Definition: Rule of thumb; quick decision guide When are heuristics used? - When making intuitive judgments about relative likelihoods.
Inferential Statistics Assoc. Prof. Dr. Şehnaz Şahinkarakaş.
© 2010 Pearson Prentice Hall. All rights reserved Chapter Hypothesis Tests Regarding a Parameter 10.
Copyright © 2009 Pearson Education, Inc LEARNING GOAL Interpret and carry out hypothesis tests for independence of variables with data organized.
The Representativeness Heuristic then: Risk Attitude and Framing Effects Psychology 355: Cognitive Psychology Instructor: John Miyamoto 6/1/2016: Lecture.
1 מקורות החשיבה המדעית/מתימטית ( ) אורי לירון שיעור ראשון – חידות, מֶטָה-חידות, תהיות, וסתם שאלות מעצבנות.
Antecedents and Consequences of Unsolicited vs
Acknowledgement: Khem Gyawali
Solomon Asch’s 1951 conformity experiment
Behavioral Economics.
Unit 5: Hypothesis Testing
Visiting human errors in IR systems from decision making perspective
PROM/SE Ohio Mathematics Associates Institute Spring 2005
Evidence for gender bias in interpreting online professor ratings
Psychology (A) old spec 2017
Variations on Aschs Research
Significance Tests: The Basics
Presentation transcript:

Past research in decision making has shown that when solving certain types of probability estimation problems, groups tend to exacerbate errors commonly found at the individual level (e.g., Tindale, Smith, Thomas, Filkins, & Sheffey, 1996, Tversky & Kahneman, 1974). These errors are due to group members' reliance on shared task representations to reach the final decision for the group. In other words, members of the group share the same idea for how to best solve a given problem. In most cases, these shared task representations lead individuals and groups to the correct answer, but for certain problems this intuitive logic is actually incorrect. Social information processing favors group members who make errors in these problem domains since their incorrect logic seems to make sense to other members of the group. The current study used the judge-advisor system paradigm (e.g., Sniezek & Buckley, 1995) to provide participants with information from others to investigate whether having feedback from others would reduce errors in a conjunctive probability task at the individual level. Conjunctive Problem: Description 1 Jeff is 32 years old. He is very intelligent and takes most things in life pretty seriously. In college he majored in engineering and mathematics. Jeff is somewhat of a loner and lives by himself in a comfortable condominium. In spaces provided at the right of each statement, please estimate the probability (from 0% = absolutely cannot be true to 100% = absolutely must be true) that each of the statements about Jeff below is true. Then, please rate how confident you are in your probability estimate by circling the number on the scale provided that best represents your level of confidence. The Likely-Unlikely Conjunctive Estimate (LU) Jeff is employed in the information technology field. (Likely advice: 80, 70)‏ Jeff is the social director of his condominium association. (Unlikely advice: 20, 30)‏ Jeff is employed in the information technology field and is the social director of his condominium association. (Likely-Unlikely advice: both correct = 15, 20; both incorrect = 55, 50; one correct and one incorrect = 15, 50)‏ Correct Justification: Since people who are social directors and information technicians are a subset of all social directors, my estimate is somewhat below what I gave for social director. Incorrect Justification: Since it's very likely that Jeff is an information technician, but very unlikely that he is a social director, my estimate was closer to what I said for information technician. Kahneman, D., Slovic, P., & Tversky, A. (Eds.) (1982). Judgment under uncertainty: Heuristics and biases. Cambridge, MA: Cambridge University Press. Sniezek, J. A., & Buckley, T. (1995) Cueing and cognitive conflict in judge-advisor decision making. Organizational Behavior and Human Decision Processes 62, 159–174. Tindale, R. S., Smith, C. M., Thomas, L. S., Filkins, J., & Sheffey, S. (1996). Shared representations and assymetric social influence processes in small groups. In E. Witte, & J. Davis (Eds.) Understanding Group Behavior: Consensual Action by Small Groups (Vol.1, pp ). Mahwah, NJ: Lawrence Earlbaum Associates. Overall, receiving consistent correct advice from others improved performance regardless of whether or not rationales were provided. However, the effect appears mainly due to conformity. Analysis of correctness of logic produced results inconsistent with those for correctness of estimates. Specifically, a correct logic was not shown to increase the likelihood of a correct estimate. Thus, it appears that participants merely repeated the logic suggested by advisors but did not take it into account upon making their own estimates. Taken together, these findings indicate that correct advice can improve performance, but any improvement seems to be the result of conformity as opposed to understanding or learning from the advice provided by others. The conjunctive fallacy is one type of error that individuals tend to make when estimating the probability of two events occurring simultaneously. The error is even greater at the group level. This error is committed when the problem solver believes that the probability of events A and B occurring at the same time is higher than the probability of either event A or B occurring alone. However, the probability of any two events occurring simultaneously must be less than the probability of the event which is the least likely of the two to occur. Thus, the probability of events A and B occurring at the same time must be less than or equal to the probability of the less likely event. The conjunctive fallacy has been previously studied using the “Linda the bank teller” problem. The current study utilized a similar task. INTRODUCTION THE CONJUNCTIVE FALLACY DESIGN AND METHOD ANALYSIS AND RESULTS CONCLUSIONS REFERENCES CONJUNCTIVE PROBABILITY ESTIMATION IN A JUDGE-ADVISOR PARADIGM Rebecca Starkel, Elizabeth Jacobs, Lindsay Nichols, Maura Tobin, & Scott Tindale Loyola University Chicago Chi-square analyses were conducted to compare correctness of estimates against the control group. In comparison with the control, significant differences emerged for various types of conjunctive estimates in various conditions. For LL, 2LU, and 2LL, having 2 correct advisors led to significantly higher percentages of correct estimates among participants. For 2UU, one correct advisor offering rationale led to a significantly higher percentage of correct estimates. For LU and UU, having 2 incorrect advisors led to significantly lower estimates. Additionally, chi-square analyses were conducted to compare correctness of logic against the control group. In comparison with the control significant differences emerged for several types of conjunctive estimates. When participants had 2 incorrect advisors, a significantly lower percentage of participants offered a correct logic for LU. When participants had 2 correct advisors offering rationale, a significantly higher percentage of participants offered a correct logic for LL, and with only one correct advisor offering rationale, a significantly higher percentage of participants offered a correct logic for LU2. When participants had 2 incorrect advisors but no rationale, a significantly higher percentage of participants offered a correct logic UU, 2LL, and 2UU. RESEARCH QUESTIONS Certain estimations are prone to the conjunctive fallacy and have been shown to be exacerbated at the group level. The current study was designed to determine whether receiving advice for making these types of estimations would improve performance at the individual level. Questions posed included: Will correct advice improve performance? Does correct advice need to be consistent in order to be effective? Will correct advice be enough, or will some type of rationalization or justification be needed? EXAMPLE MATERIALS Correctness of Estimates (Versus Control, p<.05) Correctness of Logic (Versus Control, p<.05) Design Judge-Advisor paradigm 2 (information provided: estimate only vs. estimate + justification) X 3 (advisor correctness: both correct vs. both incorrect vs. one correct and one incorrect). Separate control group which received no information from advisors Method 391 Psychology 101 students at LUC arrived at the computer lab 2 conjunctive problems -students read descriptions of 2 individuals and were asked to estimate the probability of various statements being true for each individual 2 sets of estimates -1 st problem : received information from 2 advisors before making own estimates (with advice)‏ -2 nd problem: received no information from advisors before making own estimates (without advice) Without Rationale 2 incorrect LU 2 incorrect + rationale LL 2 incorrect UU 2 incorrect 2LU 2 correct + rationale 2LL 2 incorrect 2UU Both incorrect (rationale) 2 correct LL 2 incorrect LU 2 incorrect UU 2 correct 2LL Both incorrect (rationale) 1 correct 1incorrect 2UU Both incorrect (rationale) RESULTS CONTINUED... Conjunctive Estimate Abbreviations LUFirst likely-unlikely, Problem 1 LL Likely-likely UUUnlikely-unlikely LU2Second likely-unlikely 2LUFirst likely-unlikely Problem 2 2LLLikely-likely 2UUUnlikely-unlikely 2LU2Second likely-unlikely Problem 2Problem 1 Problem 2 2 incorrect UU