Using reinforcement-based models of transitive inference

Slides:



Advertisements
Similar presentations
Can birds transfer knowledge of a spatially ordered list to a hierarchically ordered one?
Advertisements

Running a model's adjoint to obtain derivatives, while more efficient and accurate than other methods, such as the finite difference method, is a computationally.
Modelling the Virtual Machine in Simple Rating and Categorization Tasks Simon Dennis School of Psychology University of Adelaide.
The Scientific Method. Consumer Reporting Magazine Helping consumers make smart choices! To Robert R. Lazar Middle School: We here at Consumer Reporting.
Neuropathology and Cognitive Scores Workgroup The role of vascular and Alzheimer’s Disease pathology in differential cognitive impairment among older adults.
Understanding Number Discriminate –based on number and nothing else Categorize –generalize across situations –label Conceptualize –serial learning (1,
Ab initio gene prediction Genome 559, Winter 2011.
Certainty Equivalent and Stochastic Preferences June 2006 FUR 2006, Rome Pavlo Blavatskyy Wolfgang Köhler IEW, University of Zürich.
Distributed Microsystems Laboratory: Developing Microsystems that Make Sense Sensor Validation Techniques Sponsoring Agency: Center for Process Analytical.
We have shown that: To see what this means in the long run let α=.001 and graph p:
Assessing cognitive models What is the aim of cognitive modelling? To try and reproduce, using equations or similar, the mechanism that people are using.
Learning HMM parameters Sushmita Roy BMI/CS 576 Oct 21 st, 2014.
Measures of Working Memory Memory The term memory is typically used to describe our ability to accurately recount experiences which occurred to us in.
Discrimination-Shift Problems Background This type of task has been used to compare concept learning across species as well as across a broad range of.
Type your project title here Your name Your teacher’s name Your school
Time Series Data Analysis - II
Agenda for Wednesday Dec 3 rd Notebook set-up Pre-test Learning Targets Scientific Method.
Chapter 5 - Part Sequential Circuit Design Design Procedure  Specification  Formulation - Obtain a state diagram or state table  State Assignment.
Timing Trials An investigation arising out of the Assignment CS32310 – Nov 2013 H Holstein 1.
Information Coding in noisy channel error protection:-- improve tolerance of errors error detection: --- indicate occurrence of errors. Source.
Time Series Data Analysis - I Yaji Sripada. Dept. of Computing Science, University of Aberdeen2 In this lecture you learn What are Time Series? How to.
Implicit Relational Learning in a Multiple-Object Tracking Task: Do People Really Track the Objects? Tiffany Williams and Olga Lazareva (Department of.
Sequential Expected Utility Theory: Sequential Sampling in Economic Decision Making under Risk Andrea Isoni Andrea Isoni (Warwick) Graham Loomes Graham.
The Problem page, Coherence, ideology How an ideological message is conveyed through language, and particularly through the following aspects of textual.
1 Chapter Two: Sampling Methods §know the reasons of sampling §use the table of random numbers §perform Simple Random, Systematic, Stratified, Cluster,
We obtained breast cancer tissues from the Breast Cancer Biospecimen Repository of Fred Hutchinson Cancer Research Center. We performed two rounds of next-gen.
MY COLLEGE AND CAREER PLANS NAME TEACHER DATE
The Scientific Method. Consumer Reporting Magazine Helping consumers make smart choices! To Heritage Middle School Students: We here at Consumer Reporting.
Improving Loss Resilience with Multi- Radio Diversity in Wireless Networks by Allen Miu, Hari Balakrishnan and C.E. Koksal Appeared in ACM MOBICOM 2005,
PAPERING THE SKIES WITH THE SCIENTIFIC METHOD. Your task: PURPOSE: Create an experiment to demonstrate the scientific method using a simple classic paper.
Chapter 7 Measuring of data Reliability of measuring instruments The reliability* of instrument is the consistency with which it measures the target attribute.
Understanding Quantitative Research Design
Hidden Markov Model Parameter Estimation BMI/CS 576 Colin Dewey Fall 2015.
DRAWING INFERENCES FROM DATA THE CHI SQUARE TEST.
PMT time offset calibration (not completed) R.Sawada 27/Dec/2007.
Dani Vainstein1 VBScript Session 5. Dani Vainstein2 What we learn last session? Branching Branching using If … Then … Else statement. Branching using.
Copyright © 2009 Pearson Education, Inc. Chapter 11 Understanding Randomness.
COMPUTE INVERSE KINEMATICS IN A ROBOTIC ARM BY USING FUZZY LOGIC Subject: Robotics Applications Student: Bui Huy Tien Student ID: M961Y204.
Does the brain compute confidence estimates about decisions?
Hypothesis Tests l Chapter 7 l 7.1 Developing Null and Alternative
Robert Anderson SAS JMP
Original analyses All ROIs
San Diego May 22, 2013 Giovanni Saponaro Giampiero Salvi
The Validity of Astrology.
Update on Single-beam Tuning of the CLIC 3 TeV Traditional Lattice
Effects of Targeted Troubleshooting Activities on
Your homework question Due next Thursday
Module 1: Investigation 3 Creating Circular Rose Patterns
Meredith A. Henry, M.S. Department of Psychology
Research methods Lesson 2.
Eliminating Reproductive Risk Factors and Reaping Female Education and Work Benefits: A Constructed Cohort Analysis of 50 Developing Countries Qingfeng.
How to handle missing data values
Tuesday, October 11, 2016 Warm-up
Ab initio gene prediction
COMPLEX LEARNING TASKS (Part B)
1.1 Reaction Rates Investigation
DEVELOPMENTAL LEARNING AND TARGETED TEACHING
Identifying Confusion from Eye-Tracking Data
New Face-Name Paradigm for Patients with Mild Alzheimer’s Disease
Choice Certainty Is Informed by Both Evidence and Decision Time
Lesson Using Studies Wisely.
Boltzmann Machine (BM) (§6.4)
Joshua I. Sanders, Balázs Hangya, Adam Kepecs  Neuron 
Adaptive multi-voxel representation of stimuli, rules and responses
Inferential Statistics
Wael F Asaad, Gregor Rainer, Earl K Miller  Neuron 
Lecture Slides Elementary Statistics Twelfth Edition
Fig. 1 Experimental and analytic procedure.
Reward associations do not explain transitive inference performance in monkeys by Greg Jensen, Yelda Alkan, Vincent P. Ferrera, and Herbert S. Terrace.
The Research Process & Surveys, Samples, and Populations
Presentation transcript:

Using reinforcement-based models of transitive inference to simulate primate data Clara Bergene, Olga F. Lazareva (Drake University), Regina Paxton Gazes (Zoo Atlanta), Robert Hampton (Emory University) Background Transitive inference is the ability to deduce that if A > B, and B > C, then A > C Example of deductive reasoning In nonverbal tasks, can be explained by appealing to reinforcement history Reinforcement-based models (Wynne, Siemann-Delius) have been used to accurately predict pigeons’ performance on the tasks Less is known about the ability of reinforcement-based model to predict primate data Our goal Test predictive ability of Siemann-Delius and Wynne models using primate data for seven-item series with backward training and list linking training Simulation details Used both Wynne model and Siemann-Delius model (only Siemann-Delius presented) Selected a combination of free parameters that produced best fit for training data Used these parameters and accrued associative values to predict testing performance on subject-by-subject basis List linking training F+ G-, E+ F-, D+ E-, C+ D-, B+ C-, A+ B- M+ N-, L+ M-, K+ L-, J+ K-, I+ J-, H+ I- Linking pair: G+ H- Tested using within-list pairs (e.g., BD or IM) and between-list pairs (e.g., BI) Data collected at Hampton’s lab (Emory University) 12 adult rhesus macaques (Macaca mulatta) Seven-item sequential backward training F+ G-, E+ F-, D+ E-, C+ D-, B+ C-, A+ B- Tested using all novel pairs Training details Results: List Linking Captures the difference between end-anchor pairs and inner pairs Correctly predicts between-list pairs and within-list pairs for List 1 (A…G) Does not predict within-list pairs for List 2 (H…M) Possibly due to list linking procedure Results: Sequential backward training (averaged across A…G list and H…M list) Captures difference between the end-anchor and the inner pairs Predicts opposite to symbolic distance effect Possibly due to the lack of correction trials or to the backward order of presentation Sequential backward training with mock correction trials List linking, mock List 2 training only Randomly added 1-3 correction trials after each incorrect choice and repeated simulations Results similar to initial simulations Run simulations using List 2 training sequence without list linking procedure, and only with initial training Predicts better performance, but still well below monkeys’ performance Low performance in List 2 cannot be attributed to list linking procedure alone Conclusions Associative models can fit sequential backward training data obtained with pigeons, but not with primates Possibly due to quicker learning in primates In list linking, the models provide a good fit for between-list pairs that were assumed to be challenging They do not, however, predict performance in within-list pairs for List 2 (H…M) This failure cannot be attributed solely to list linking procedure Pattern of results suggests contribution from associative values augmented by another process Sequential backward training in mock forward order Coded the data in reversed order (F+ G- as A+ B-, and so on) and repeated simulations Does not predict any difference between end-anchor pairs and inner pairs Correctly predicts the direction of symbolic distance effect Backward order of presentation in primates appears to provide a good control for reinforcement history Acknowledgments This research was supported by the A&S Drake University Faculty Development Research grant to OFL