Modeling Speed-Accuracy Tradeoffs in Recognition Darryl W. Schneider John R. Anderson Carnegie Mellon University.

Slides:



Advertisements
Similar presentations
C81MPR Practical Methods (Lab 2) Jonathan Stirk & Danielle Ropar.
Advertisements

Thought and Language (PS) Discuss with your partner. Someone leaves a beautiful puppy at your door. You don’t like animals, but you know it would.
Bayesian Inference for Signal Detection Models of Recognition Memory Michael Lee Department of Cognitive Sciences University California Irvine
The Impact of Criterion Noise in Signal Detection Theory: An Evaluation across Recognition Memory Tasks Julie Linzer David Kellen Henrik Singmann Karl.
© 2001 Dr. Laura Snodgrass, Ph.D.1 Mental Chronometry Measuring the duration of mental events with reaction time studies.
Phonetic Similarity Effects in Masked Priming Marja-Liisa Mailend 1, Edwin Maas 1, & Kenneth I. Forster 2 1 Department of Speech, Language, and Hearing.
Inductive reasoning and implicit memory: evidence from intact and impaired memory systems Authors: Luisa Girelli, Carlo Semenza and Margarete Delazer.
Hansjörg Neth Stephen J. Payne School of Psychology, Cardiff University Digital Calculations Digit Addition as Interactive Problem Solving.
1 Modeling the N-back-M-pitch paradigm Ion Juvina*, Michael Qin^, & Christian Lebiere* *Department of Psychology, Carnegie Mellon University ^Naval Submarine.
PS: Introduction to Psycholinguistics Winter Term 2005/06 Instructor: Daniel Wiechmann Office hours: Mon 2-3 pm Phone:
The Timecourse of Morphological Processing: Base and surface frequency effects in speed-accuracy tradeoff designs Jennifer Vannest University of Michigan.
PSYCHOPHYSICS What is Psychophysics? Classical Psychophysics Thresholds Signal Detection Theory Psychophysical Laws.
Avoidance Conditioning Combining Classical and Operant Conditioning Classical and operant conditioning often take place in the same situation. We saw this.
Sequential Hypothesis Testing under Stochastic Deadlines Peter Frazier, Angela Yu Princeton University TexPoint fonts used in EMF. Read the TexPoint manual.
Control processes The kinds of mental processes carried out on a memory 3 main types –Encoding processes –Retention processes –Retrieval processes.
DDMLab – September 27, ACT-R models of training Cleotilde Gonzalez and Brad Best Dynamic Decision Making Laboratory (DDMLab)
PSY 402 Theories of Learning Chapter 8 – Stimulus Control Space and Time in Humans and Animals.
From T. McMillen & P. Holmes, J. Math. Psych. 50: 30-57, MURI Center for Human and Robot Decision Dynamics, Sept 13, Phil Holmes, Jonathan.
Memory & Attention
Theory of Decision Time Dynamics, with Applications to Memory.
An Integrated Model of Decision Making and Visual Attention Philip L. Smith University of Melbourne Collaborators: Roger Ratcliff, Bradley Wolfgang.
Understanding Movement Preparation
Speed/accuracy tradeoff Negative relationship between RT and accuracy the faster you go (RT), the worse your performance (accuracy) when you go really.
Human Control of Systems Tracking Tasks Human Performance Considerations Measuring Tracking & Controlling Performance System Behaviors Representing System.
Methods in Cognitive Neuroscience I. The Emergence of Cognitive Neuroscience Fueled by the development of powerful new imaging instruments and techniques.
1 Quality of Service  Quality of Service  Dropped connections  Unavailable websites  Network outages & Delays  Goal is to reduce user frustration.
Compilation and Instruction ACT-R Post Graduate Summer School 2001 Coolfont Resort ACT-R Home Page: John R. Anderson Psychology.
Reicher (1969): Word Superiority Effect Dr. Timothy Bender Psychology Department Missouri State University Springfield, MO
Sequence of Events in Spatial Cueing Paradigm +. +  time.
Assumptions in cognitive psychology Mental processes mental structures mental representations.
From Bad to Worse: Variations in Judgments of Associative Memory Erin Buchanan, Ph.D., Missouri State University Abstract Four groups were tested in variations.
Cognitive Modeling / University of Groningen / / Artificial Intelligence |RENSSELAER| Cognitive Science CogWorks Laboratories › Christian P. Janssen ›
Episodic Memory (memory for episodes) Encoding Retrieval Encoding x Retrieval interactions Amnesia/Implicit memory Memory for natural settings.
Method: Reaction Time (RT)
The effects of working memory load on negative priming in an N-back task Ewald Neumann Brain-Inspired Cognitive Systems (BICS) July, 2010.
Experimental Psychology PSY 433
QUANTITATIVE MODELS OF MEMORY The value of explicit models –Precision of thinking –Explanatory power –Interval- or ratio-scale predictions –The macho factor.
Cross-task Prediction of Working Memory Performance: Working Memory Capacity as Source Activation Larry Z. Daily, Marsha C. Lovett, and Lynne M. Reder.
Forgetting and Interference in Short-term memory Brown-Peterson Task Proactive Interference (PI) Release from PI Retrieval of info from STM Sternberg (1966)
Operant Conditioning. Learning when an animal or human performs a behavior, and the following consequence increases or decreases the chance that the behavior.
Lexical Decisions -- The Basic Analysis Mean RT as a Function of Trial Type This analysis is based on correct trials only, with practice trials omitted.
Dynamic Decision Making Laboratory Carnegie Mellon University 1 Social and Decision Sciences Department ACT-R models of training Cleotilde Gonzalez and.
REFERENCES Bargh, J. A., Gollwitzer, P. M., Lee-Chai, A., Barndollar, K., & Troetschel, R. (2001). The automated will: Nonconscious activation and pursuit.
Modeling Individual Differences in Working Memory Capacity Larry Z. Daily Marsha C. Lovett Lynne M. Reder Carnegie Mellon University This work supported.
Experimental Psychology PSY 433
USER INTERFACE USER INTERFACE January 5, 2006 Intern 박지현 Information Theoretic Model of HCI : A Comparison of the Hick-Hyman Law and Fitts’ Law Steven.
Result 1: Effect of List Length Result 2: Effect of Probe Position Prediction by perceptual similarity Prediction by physical similarity Subject
Discrete-State Model A Bayesian Discrete-State Model for Working Memory Eda Mızrak 1, Henrik Singmann 2, Ilke Öztekin 1 Koç University 1, University of.
Dynamics of Reward and Stimulus Information in Human Decision Making Juan Gao, Rebecca Tortell & James L. McClelland With inspiration from Bill Newsome.
Limits on Ability to Perform Different Tasks Simultaneously Two basic issues: 1. Task-Specific Resources 2. Task-Independent Resources.
Remembering Can Cause Inhibition Retrieval-Induced Inhibition As Cue Independent Process Veling & Knippenberg, 2004.
How to investigate Perception & Cognition n Ask your subjects (Introspectionism) n Look at S-R patterns (Behaviorism) n Infer mental processes (Cognitive.
Maxlab proprietary information – 5/4/09 – Maximilian Riesenhuber CT2WS at Georgetown: Letting your brain be all that.
Exploring Individual Variability Using ACT-R Christian Schunn George Mason University.
Millisecond Time Interval Estimation in a Dynamic Task Jungaa Moon & John Anderson Carnegie Mellon University.
Psychology and Neurobiology of Decision-Making under Uncertainty Angela Yu March 11, 2010.
Dynamics of Reward Bias Effects in Perceptual Decision Making Jay McClelland & Juan Gao Building on: Newsome and Rorie Holmes and Feng Usher and McClelland.
Semantic Satiation, Lexical Ambiguity, and Semantic Distance
Emilie Zamarripa & Joseph Latimer| Faculty Mentor: Jarrod Hines
Effects of Foreknowledge and Foreperiod on Task-Switching Cost
Chapter 2 Processing Information and Making Decisions
Chapter 8: Hypothesis Testing and Inferential Statistics
A Classical Model of Decision Making: The Drift Diffusion Model of Choice Between Two Alternatives At each time step a small sample of noisy information.
Effective Connectivity between Hippocampus and Ventromedial Prefrontal Cortex Controls Preferential Choices from Memory  Sebastian Gluth, Tobias Sommer,
Stimulus Probabilties--The Basic Analysis
Volume 40, Issue 6, Pages (December 2003)
Resistance in Series and Parallel
Neural Mechanisms of Speed-Accuracy Tradeoff
Warmup The Falcons have won 80% of their games and leading their division. Assume that the result of each game is independent. They have 9 games left.
ACT-R models of training
Presentation transcript:

Modeling Speed-Accuracy Tradeoffs in Recognition Darryl W. Schneider John R. Anderson Carnegie Mellon University

Modeling Behavioral Data With ACT-R Speed-Accuracy Tradeoff Functions Correct and Error RT Distributions Mean RT and Error Rate

Speed-Accuracy Tradeoffs People can trade speed for accuracy when performing a task Speed-accuracy tradeoff functions can be measured using the response signal procedure Typically involves a choice task (e.g., recognition) A stimulus is followed at a variable lag by a signal to respond immediately (e.g., yes/no response as to whether the stimulus was studied) Examine accuracy as a function of lag

Speed-Accuracy Tradeoff Function Intercept (δ) Chance Rate (β) Asymptote (λ)

How can ACT-R produce a speed-accuracy tradeoff function?

ACT-R Model: Long Lag Stimulus encoding Memory retrieval (wait) Signal encoding Response execution Stimulus onset Response Response signal Lag Time available for retrieval Trial time

ACT-R Model: Short Lag Stimulus encoding Memory retrieval Signal encoding Response execution Stimulus onset Response Response signal Lag Trial time Guess Time available for retrieval

Modeling the Speed-Accuracy Tradeoff Accuracy depends on the probability that retrieval finishes in the time available If retrieval finishes, accuracy is perfect If retrieval does not finish, accuracy is lowered due to guessing Retrieval time Calculated with the standard ACT-R equations Activation noise produces a time distribution

Modeling the Speed-Accuracy Tradeoff Time available: External deadline (lag) Internal deadline (failure time) Shorter deadline determines the time available

Modeling Fan Effects on SAT Functions Fan effect: It takes longer to recognize an item as its associative fan increases Associative fan = number of associations with other items in memory ACT-R can already model the fan effect As fan increases, associative activation from the probe to items in memory decreases, resulting in memory retrieval taking longer

Experiments Wickelgren & Corbett (1977) Word pairs and triples Briefly studied Fan 1 vs. Fan 2 Associative recognition: targets vs. rearranged foils Response signal procedure with 8 lags Our Experiment Person-location pairs Well-learned Fan 1 vs. Fan 2 Associative recognition: targets vs. rearranged foils Response signal procedure with 8 lags

Modeling Fan Effects on SAT Functions Wickelgren & Corbett (1977) Briefly studied materials Our Experiment Well-learned materials Internal deadline shorter than external deadline Internal deadline longer than external deadline

Take-Home Message ACT-R can model speed- accuracy tradeoffs in response signal data

Current Directions Modeling nonmonotonic speed-accuracy tradeoff functions Different types of information are retrieved in series and inform the guessing process Modeling reaction time distributions Free-response procedure Guessing is probabilistic and occurs in parallel with retrieval

For More Information Schneider, D. W., & Anderson, J. R. (2012). Modeling fan effects on the time course of associative recognition. Cognitive Psychology, 64, Available on the ACT-R website