Falk Lieder1, Zi L. Sim1, Jane C. Hu, Thomas L

Slides:



Advertisements
Similar presentations
Critical Reading Strategies: Overview of Research Process
Advertisements

Elena Popa.  Children’s causal learning and evidence.  Causation, intervention, and Bayes nets.  The conditional intervention principle and Woodward’s.
Estimation and Reporting of Heterogeneity of Treatment Effects in Observational Comparative Effectiveness Research Prepared for: Agency for Healthcare.
Causes and coincidences Tom Griffiths Cognitive and Linguistic Sciences Brown University.
STAT E100 Exam 2 Review.
Exploring subjective probability distributions using Bayesian statistics Tom Griffiths Department of Psychology Cognitive Science Program University of.
Level 1 and Level 2 Auditory Perspective-taking in 3- and 4- Year -Olds Abstract Presented at the Psychology Undergraduate Research Conference, Atlanta,
The Characteristics of an Experimental Hypothesis
Answers to Group Questions Brownell, Svetlova, & Nichols (2009)
Single-Factor Experimental Designs
Cognitive Modeling / University of Groningen / / Artificial Intelligence |RENSSELAER| Cognitive Science CogWorks Laboratories › Christian P. Janssen ›
Unpacking the Elements of Scientific Reasoning Keisha Varma, Patricia Ross, Frances Lawrenz, Gill Roehrig, Douglas Huffman, Leah McGuire, Ying-Chih Chen,
Buying and Selling Prices under Risk, Ambiguity and Conflict Michael Smithson The Australian National University Paul D. Campbell Australian Bureau of.
1 Cross-language evidence for three factors in speech perception Sandra Anacleto uOttawa.
Past research in decision making has shown that when solving certain types of probability estimation problems, groups tend to exacerbate errors commonly.
Human and Optimal Exploration and Exploitation in Bandit Problems Department of Cognitive Sciences, University of California. A Bayesian analysis of human.
A Dirty Word or a Dirty World? Framing, Politics, and Query Theory David J. Hardisty, Eric J. Johnson & Elke U. Weber Columbia University Method Abstract.
Development of Basic Indices of Attention to Nonsocial Events Across Infancy: Effects of Unimodal versus Bimodal Stimulation Lorraine E. Bahrick, James.
The Practice of Statistics, 5th Edition Starnes, Tabor, Yates, Moore Bedford Freeman Worth Publishers CHAPTER 11 Inference for Distributions of Categorical.
Conducting a research project. Clarify Aims and Research Questions Conduct Literature Review Describe methodology Design Research Collect DataAnalyse.
Contact Info: Improving Decision Making: The use of simple heuristics Dr. Guillermo Campitelli Cognition Research Group Edith.
Gender differences in reading from a cross-cultural perspective- the contribution of gender equality David Reilly, School of Applied Psychology, Griffith.
TMA04 - Writing the DE100 Project Report Discussion Section
PSY 626: Bayesian Statistics for Psychological Science
Hypothesis Tests l Chapter 7 l 7.1 Developing Null and Alternative
Alison Burros, Kallie MacKay, Jennifer Hwee, & Dr. Mei-Ching Lien
Outline.
An Overview of Statistical Inference – Learning from Data
Figure 5: Change in Blackjack Posterior Distributions over Time.
Exploratory Factor Analysis Participants, Procedures, & Measures
This research was funded by a small grant from the EPS society.
Section 2: Science as a Process
TMA04 - Writing the DE100 Project Report Discussion Section
Alison Burros, Nathan Herdener, & Mei-Ching Lien
CHAPTER 11 Inference for Distributions of Categorical Data
“Instead of trying to produce a programme to simulate the adult mind, why not rather try to produce one which simulates the child's?” Alan Turing, 1950.
What is development? Domains of development
An Overview of Statistical Inference – Learning from Data
Teaching and Educational Psychology
Processes of Mental Contrasting: Linking Future with Reality
Inferential Statistics
% Positive/Neutral Attributions
Office of Education Improvement and Innovation
PSY 626: Bayesian Statistics for Psychological Science
Method Separate subheadings for participants, materials, and procedure (3 marks in total) Participants (1 mark) Include all info provided in the assignment.
Processes of Mental Contrasting: Linking Future with Reality
Starter Imagine - you did not do as well as you wanted to in a biology test, but your teacher praises you for working hard and trying your best. You feel.
Children’s Evaluation of the Certainty of Inferences by Self and Other
Revealing priors on category structures through iterated learning
In pairs complete the Agony Aunt task
CHAPTER 11 Inference for Distributions of Categorical Data
How Do The Principle Psychological Perspectives Explain the Development of Individuals? Today: How do Piaget, Donaldson, Vygotsky, Bruner, Miller, Beck.
David Kellen, Henrik Singmann, Sharon Chen, and Samuel Winiger
Young Children’s Reasoning about Gender: Stereotypes or Essences?
Cerdá M, Wall M, Feng T, et al
CHAPTER 11 Inference for Distributions of Categorical Data
CHAPTER 11 Inference for Distributions of Categorical Data
CHAPTER 11 Inference for Distributions of Categorical Data
CHAPTER 11 Inference for Distributions of Categorical Data
CHAPTER 11 Inference for Distributions of Categorical Data
CHAPTER 11 Inference for Distributions of Categorical Data
CHAPTER 11 Inference for Distributions of Categorical Data
By Medha Tare & Susan A. Gelman
Chapter 7: Demographic and Socioeconomic Factors of Investors
Managerial Decision Making and Evaluating Research
Chapter 4 Summary.
CHAPTER 11 Inference for Distributions of Categorical Data
Inferential testing.
How do we think, feel, and behave towards children
LEARNER-CENTERED PSYCHOLOGICAL PRINCIPLES. The American Psychological Association put together the Leaner-Centered Psychological Principles. These psychological.
Presentation transcript:

Learning from others: Adult and child strategies in assessing conflicting ratings Falk Lieder1, Zi L. Sim1, Jane C. Hu, Thomas L. Griffiths, and Fei Xu University of California, Berkeley 1These authors contributed equally. Introduction Learning from others is critical for beliefs that are neither true nor false (e.g. cultural practices, supernatural concepts, and preferences). For these beliefs, we are likely to encounter conflicting testimonies. How do we determine whom to believe? Previous research has shown that both adults and children consider consensus information, often relying on majority opinion when learning from others’ testimonies (Benedicktus et al., 2010; Corriveau et al., 2009). However, the mechanism underlying how learners determine consensus remains unclear. What factors do learners take into account, and how do they do so? Two prominent factors in the evaluation of multiple testimonies are overall valence, and the number of testimonials. Making a decision requires weighing both of these factors, but previous studies have only focused on overall valence, or had the two factors confounded in their experimental design. We thus examine how children and adults reconcile conflicts between these two sources of information. We also investigate whether children use different learning strategies than adults. A difference between child and adult strategies for social learning would suggest that cognitive development includes discovering cognitive strategies, and not just acquiring knowledge and representations. Materials and Methods Experiment 1: Compared children and adults 66 4- to 7-year-olds, and 300 adults Participants were presented with 18 pairs of ratings, and asked to choose which option they thought was better. Trials were designed to be maximally discriminative between pairs of strategies. Experiment 2: Evaluated the 5 earlier strategies against 4 alternative models for 160 adults: 1. Difference: choose the option for which the surplus of positive ratings is largest 2. Count- : choose the option with fewer negative ratings 3. Some Positive: choose the only option with positive ratings, else choose at random 4. No Negative: choose the option with no negative ratings, else choose at random Results of Experiment 2 77.5% of adults used the Bayesian sampling strategy with a neutral prior. We can be more than 99% confident that it is the most frequently used strategy among adults. Re-analysis of the data under the assumption that each person might use multiple strategies led to the same conclusions. Example trial for distinguishing Count+ from Bayesian inference & ratio strategy Social Learning Strategies To characterize how we learn from other people’s ratings, we formalize five social learning strategies using probabilistic models, and determine which model best explains each group’s choices. Below, ni, + and ni, - are respectively the number of positive and negative ratings for option i, and w is the Weber fraction. 1. Count+: Under this strategy, the probability of choosing the 1st option is determined by the perceived difference in the number of positive ratings: 2. Ratio: Under this strategy, the choice probability is determined by the perceived difference in the proportions of positive ratings (r1 – r2): 3. Bayesian inference with an optimistic prior 4. Bayesian inference with a neutral prior From a Bayesian perspective, the goal is to infer whether the probability of a positive experience is higher for option 1 than for option 2 (μ1 > μ2). This inference integrates the ratings with prior knowledge about the prevalence of positive ratings (). According to the optimistic prior, most ratings are positive, whereas the neutral prior is agnostic about this. According to the sampling hypothesis (Bonawitz et al., 2014; Denison et al., 2013), the probability of choosing the 1st option is: 5. Random: This strategy chooses both options with equal probability: Results of Experiment 1 Adults were more likely than children to choose according to Bayesian inference (neutral prior), p < .0001. This strategy was most common for adults. Children were more likely than adults to use the counting positives strategy (Count+), p < .03. Among children, Bayesian inference and Count+ were about equally common. Conclusions Both adults and children need to learn from the testimony of others, but they may use different strategies to make sense of them. The choices of adults was consistent with Bayesian inference, while children seem to rely more often on simpler heuristics. The current results suggest that cognitive strategies for reasoning under uncertainty or the mechanism by which the strategies are selected develop during childhood. The transition to a strategy that approximates Bayesian inference is incomplete at age 6. Our results also indicate that children use multiple specialized strategies across different domains, rather than relying on a single, universal strategy. In causal inference tasks (e.g. Denison et al., 2013), children reason in ways consistent with Bayesian inference, but they appear not to do so in our social learning task. Findings are consistent with the overlapping waves theory (Siegler, 1996), illustrating that cognitive development is not limited to the acquisition of knowledge and representations, but also includes discovering cognitive strategies and learning when to use them. Literature Cited Benedicktus, R. L., Brady, M. K., Darke, P. R., & Voorhees, C. M. (2010). Conveying Trustworthiness to Online Consumers: Reactions to Consensus, Physical Store Presence, Brand Familiarity, and Generalized Suspicion. Journal of Retailing, 86(4), 310–323. Corriveau, K. H., Fusaro, M., & Harris, P. L. (2009). Going with the flow preschoolers prefer nondissenters as informants. Psychological Science, 20(3), 372–377. Bonawitz, E., Denison, S., Griffiths, T. L., & Gopnik, A. (2014). Probabilistic models, learning algorithms, and response variability: sampling in cognitive development. Trends in Cognitive Sciences, 18(10), 497–500. Denison, S., Bonawitz, E., Gopnik, A., & Griffiths, T. L. (2013). Rational variability in children’s causal inferences: The sampling hypothesis. Cognition, 126(2), 285–300. Siegler, R. S. (1996). Emerging Minds: The process of change in children’s thinking. New York: Oxford University Press. Acknowledgments We thank Meg Bishop, Shirley Chen, Justine Hoch, Chelsea Tuomi, Anamita Guha, Stephanie Jones, Gabi Espinoza, and the Berkeley Early Learning Lab (BELL) for their help in recruitment and collecting the children’s data. We also thank the parents and children for their participation. This work has been submitted to the 37th Annual Meeting of the Cognitive Science Society. For further information: zi@berkeley.edu