Swets et al (1961).

Slides:



Advertisements
Similar presentations
Signal Detection Theory. The classical psychophysicists believed in fixed thresholds Ideally, one would obtain a step-like change from no detection to.
Advertisements

10 / 31 Outline Perception workshop groups Signal detection theory Scheduling meetings.
How well can we learn what the stimulus is by looking at the neural responses? We will discuss two approaches: devise and evaluate explicit algorithms.
Sensation Perception = gathering information from the environment 2 stages: –Sensation = simple sensory experiences and translating physical energy from.
Sensation and Perception - signaldetectiontheory.ppt © 2001 Dr. Laura Snodgrass, Ph.D. Signal Detection Theory No threshold theory BIG IMPROVEMENT –because.
Chapter 2: Bayesian Decision Theory (Part 1) Introduction Bayesian Decision Theory–Continuous Features All materials used in this course were taken from.
Decision making as a model 7. Visual perception as Bayesian decision making.
Baysian Approaches Kun Guo, PhD Reader in Cognitive Neuroscience School of Psychology University of Lincoln Quantitative Methods 2011.
Pattern Classification All materials in these slides were taken from Pattern Classification (2nd ed) by R. O. Duda, P. E. Hart and D. G. Stork, John Wiley.
1 A Presentation of ‘Bayesian Models for Gene Expression With DNA Microarray Data’ by Ibrahim, Chen, and Gray Presentation By Lara DePadilla.
SVCL Automatic detection of object based Region-of-Interest for image compression Sunhyoung Han.
1 / 41 Inference and Computation with Population Codes 13 November 2012 Inference and Computation with Population Codes Alexandre Pouget, Peter Dayan,
Learning Theory Reza Shadmehr logistic regression, iterative re-weighted least squares.
Lecture notes for Stat 231: Pattern Recognition and Machine Learning 3. Bayes Decision Theory: Part II. Prof. A.L. Yuille Stat 231. Fall 2004.
BCS547 Neural Decoding. Population Code Tuning CurvesPattern of activity (r) Direction (deg) Activity
Pattern Classification All materials in these slides were taken from Pattern Classification (2nd ed) by R. O. Duda, P. E. Hart and D. G. Stork, John Wiley.
BCS547 Neural Decoding.
Sensation Perception = gathering information from the environment 2 stages: –Sensation = simple sensory experiences and translating physical energy from.
Bayesian Decision Theory Basic Concepts Discriminant Functions The Normal Density ROC Curves.
ISE Recall the HIP model. ISE Beyond sensing & perceiving …  You are sitting at lunch and hear a familiar ring tone. Is that your.
Spatial Smoothing and Multiple Comparisons Correction for Dummies Alexa Morcom, Matthew Brett Acknowledgements.
Noise and Data Errors Nominal Observation for “1” Nominal Observation for “0” Probability density for “0” with Noise Probability density for “1” with Noise.
Optimal Eye Movement Strategies In Visual Search.
Psy Psychology of Hearing Psychophysics and Detection Theory Neal Viemeister
Signal Detection Theory.
SIGNAL DETECTION THEORY  A situation is described in terms of two states of the world: a signal is present ("Signal") a signal is absent ("Noise")  You.
King Saud University College of Engineering IE – 341: “Human Factors” Spring – 2016 (2 nd Sem H) Chapter 3. Information Input and Processing Part.
Signal Detection Analysis of a Three Alternative Forced Choice Signal Detection Analysis of a Three Alternative Forced Choice in a Stereoacuity Context.
Optimal Decision-Making in Humans & Animals Angela Yu March 05, 2009.
Fuzzy Signal Detection Theory: ROC Analysis of Stimulus and Response Range Effects J.L. Szalma and P.A. Hancock Department of Psychology and Institute.
PATTERN RECOGNITION AND MACHINE LEARNING CHAPTER 1: INTRODUCTION.
Crash course in probability theory and statistics – part 2 Machine Learning, Wed Apr 16, 2008.
Applied statistics Usman Roshan.
Lecture 1.31 Criteria for optimal reception of radio signals.
Bayesian inference in neural networks
Figure 5: Change in Blackjack Posterior Distributions over Time.
Power and p-values Benjamin Neale March 10th, 2016
Applied statistics Usman Roshan.
Signal Detection, Information Theory, and Absolute Judgment
Probability Theory and Parameter Estimation I
A Bayesian account of context-induced orientation illusions
Chapter 3. Information Input and Processing
From: Rat performance on visual detection task modeled with divisive normalization and adaptive decision thresholds Journal of Vision. 2011;11(9):1. doi: /
Figure 1.16 Detecting a stimulus using the signal detection theory (SDT) approach (Part 1) wolfe2e-fig jpg.
Figure Legend: From: The absolute threshold of cone vision
Origins of Signal Detection Theory
Special Topics In Scientific Computing
Information Units of Measurement
Signal Detection Theory
Bayesian inference in neural networks
Maximum Likelihood Find the parameters of a model that best fit the data… Forms the foundation of Bayesian inference Slide 1.
Pattern Classification All materials in these slides were taken from Pattern Classification (2nd ed) by R. O. Duda, P. E. Hart and D. G. Stork, John.
More about Posterior Distributions
Signal Detection Theory
Volume 6, Issue 5, Pages e13 (May 2018)
Human Reward / Stimulus/ Response Signal Experiment: Data and Analysis
Pattern Recognition and Machine Learning
How do we make decisions about uncertain events?
Confidence as Bayesian Probability: From Neural Origins to Behavior
Pattern Classification All materials in these slides were taken from Pattern Classification (2nd ed) by R. O. Duda, P. E. Hart and D. G. Stork, John.
Pattern Classification All materials in these slides were taken from Pattern Classification (2nd ed) by R. O. Duda, P. E. Hart and D. G. Stork, John.
Bayesian vision Nisheeth 14th February 2019.
Signal detection theory
Wellcome Centre for Neuroimaging, UCL, UK.
Introduction to Statistics − Day 4
CS639: Data Management for Data Science
Analysis Assumptions -x m - m + c
Will Penny Wellcome Trust Centre for Neuroimaging,
Mathematical Foundations of BME Reza Shadmehr
Applied Statistics and Probability for Engineers
Presentation transcript:

Swets et al (1961)

Key ideas continuity in stimulus-induced mental states variability in these states sensitivity (d’) role of prior probability and payoffs bias, criterion… Bayesian inference normative/optimal model, ideal observer

Your questions How to get expected ROC given hypothetical underlying distributions? What is the meaning of the ‘spread’ or ‘variance’, and how does this relate to performance? What is ‘beta’ exactly and how does it relate to area under curve? How are ROC curves generated from a rating experiment? How is the prior and/or placement of the criterion determined by the subject? Is learning involved? If so in what way?

More questions When do we stay with a theory even if it isn’t a perfect fit and when do we reject it and seek another theory? How was it that the authors were able to reject the threshold theory even when their own data were and only so-so fit to their own theory? How do we generalize given the large individual differences in studies such as these? How do we distinguish between signals lost in noise and signals that decay before they can be reported?

Plan Go over the basic elements of the theory Generate a hypothetical ROC curve Consider effect of prior and payoff Consider effect of unequal variance Consider the data reported in the experiments

Key Concepts Prior p(SN), p(N) Likelihood fSN(x) = p(x|SN), fN(x) = p(x|N) likelihood ratio = fSN(x)/fN(x) Posterior p(SN|x), p(N|x) Criterion, Beta [Maximizing strategy inherent in model vs. probability matching]

Subliminal Perception? “It may be, therefore, that subliminal perception exists only when a high criterion is incorrectly identified as a limen.”

More questions When do we stay with a theory even if it isn’t a perfect fit and when do we reject it and seek another theory? How was it that the authors were able to reject the threshold theory even when their own data were and only so-so fit to their own theory? How do we generalize given the large individual differences in studies such as these? How do we distinguish between signals lost in noise and signals that decay before they can be reported?