SIGNAL DETECTION THEORY  A situation is described in terms of two states of the world: a signal is present ("Signal") a signal is absent ("Noise")  You.

Slides:



Advertisements
Similar presentations
Detection Chia-Hsin Cheng. Wireless Access Tech. Lab. CCU Wireless Access Tech. Lab. 2 Outlines Detection Theory Simple Binary Hypothesis Tests Bayes.
Advertisements

Signal Detection Theory. The classical psychophysicists believed in fixed thresholds Ideally, one would obtain a step-like change from no detection to.
Chapter 4 Pattern Recognition Concepts: Introduction & ROC Analysis.
10 / 31 Outline Perception workshop groups Signal detection theory Scheduling meetings.
Research methods in sensation and perception (and the princess and the pea)
Stats 95 Experimental Design –Experimental Design & Lady Tasting Tea –Type I and Type II Errors –Null Hypothesis an Research Hypothesis.
Decision Errors and Power
COURSE: JUST 3900 INTRODUCTORY STATISTICS FOR CRIMINAL JUSTICE Instructor: Dr. John J. Kerbs, Associate Professor Joint Ph.D. in Social Work and Sociology.
THE RECEIVER OPERATING CHARACTERISTIC FANTINO SEMINAR APRIL 10, 2013 UCSD STEPHEN LINK 4/10/2013LINK AT THE FANTINO SEMINAR1.
Elicited and Emitted Behavior The Reflex: Elicitation Properties of Elicited Behavior Eliciting Stimuli and Response Probabilities Probabilities or Relative.
Sensation Overview How is perception different from sensation? What is psychophysics? What do sense organs do? How does vision work? How does this compare.
PSYCHOPHYSICS What is Psychophysics? Classical Psychophysics Thresholds Signal Detection Theory Psychophysical Laws.
Sensation Perception = gathering information from the environment 2 stages: –Sensation = simple sensory experiences and translating physical energy from.
Decision making as a model 2. Statistics and decision making.
Sensation and Perception - signaldetectiontheory.ppt © 2001 Dr. Laura Snodgrass, Ph.D. Signal Detection Theory No threshold theory BIG IMPROVEMENT –because.
Introduction to Biomedical Statistics. Signal Detection Theory What do we actually “detect” when we say we’ve detected something?
Virginia Image and Video Analysis Pavement conditions, fighter jets, and psychophysics! a.k.a. “Did you hear that???” Andrea Vaccari.
Introduction to Regression Analysis, Chapter 13,
Short Notes on Theory of Signal Detection Walter Schneider
Psychophysics 3 Research Methods Fall 2010 Tamás Bőhm.
Data Selection In Ad-Hoc Wireless Sensor Networks Olawoye Oyeyele 11/24/2003.
Effects of Warning Validity and Proximity on Responses to Warnings Joachim Meyer, Israel HUMAN FACTORS, Vol. 43, No. 4 (2001)
Statistics and Quantitative Analysis Chemistry 321, Summer 2014.
Signal Detection Theory October 10, 2013 Some Psychometrics! Response data from a perception experiment is usually organized in the form of a confusion.
Stats 95.
10.2 Tests of Significance Use confidence intervals when the goal is to estimate the population parameter If the goal is to.
The Method of Constant Stimuli & Signal Detection Theory VISN2211 Sieu Khuu David Lewis.
Correlation Analysis. Correlation Analysis: Introduction Management questions frequently revolve around the study of relationships between two or more.
MEASURES OF TEST ACCURACY AND ASSOCIATIONS DR ODIFE, U.B SR, EDM DIVISION.
Signal detection theory Appendix Takashi Yamauchi Texas A&M University.
Research Design & Analysis 2: Class 23 Announcement re. Extra class: April 10th BAC 237 Discrete Trials Designs: Psychophysics & Signal Detection.
Signal Detection Theory I. Challenges in Measuring Perception II. Introduction to Signal Detection Theory III. Applications of Signal Detection Theory.
Behavioral: Basic Psychology of the Senses of the User IST 331 – Organization and Design of Information Systems: User and System Principles Instructor:
Bayesian Decision Theory (Classification) 主講人:虞台文.
Overconfidence in judgment: Why experience might not be a good teacher Tom Stewart September 24, 2007.
Biostatistics in Practice Peter D. Christenson Biostatistician Session 4: Study Size for Precision or Power.
Sensation Perception = gathering information from the environment 2 stages: –Sensation = simple sensory experiences and translating physical energy from.
Chapter 2: Signal Detection and Absolute Judgement
Bayesian Decision Theory Basic Concepts Discriminant Functions The Normal Density ROC Curves.
ISE Recall the HIP model. ISE Beyond sensing & perceiving …  You are sitting at lunch and hear a familiar ring tone. Is that your.
Psych 480: Fundamentals of Perception and Sensation
10 May Understanding diagnostic tests Evan Sergeant AusVet Animal Health Services.
Outline of Lecture I.Intro to Signal Detection Theory (words) II.Intro to Signal Detection Theory (pictures) III.Applications of Signal Detection Theory.
26134 Business Statistics Week 4 Tutorial Simple Linear Regression Key concepts in this tutorial are listed below 1. Detecting.
GRAPPLING WITH DATA Variability in observations Sources of variability measurement error and reliability Visualizing the sample data Frequency distributions.
Psy Psychology of Hearing Psychophysics and Detection Theory Neal Viemeister
Signal Detection Theory March 25, 2010 Phonetics Fun, Ltd. Check it out:
Signal Detection Theory October 5, 2011 Some Psychometrics! Response data from a perception experiment is usually organized in the form of a confusion.
How far away is the moon? ( An adventure in signal detection theory and allusive science) Harold E. Brooks NOAA/National Severe Storms Laboratory Norman,
Hypothesis Testing and Statistical Significance
Receiver Operator Characteristics What is it and where does it come from Statistical aspects Use of ROC.
Sensation and Perception Part 1: Psychophysics AP Psychology Zahuta.
26134 Business Statistics Week 4 Tutorial Simple Linear Regression Key concepts in this tutorial are listed below 1. Detecting.
King Saud University College of Engineering IE – 341: “Human Factors” Spring – 2016 (2 nd Sem H) Chapter 3. Information Input and Processing Part.
Fuzzy Signal Detection Theory: ROC Analysis of Stimulus and Response Range Effects J.L. Szalma and P.A. Hancock Department of Psychology and Institute.
Lecture 1.31 Criteria for optimal reception of radio signals.
Chapter 3. Information Input and Processing
Origins of Signal Detection Theory
SENSATION AND PERCEPTION
Swets et al (1961).
Information Units of Measurement
King Saud University College of Engineering IE – 341: “Human Factors Engineering” Fall – 2017 (1st Sem H) Chapter 3. Information Input and Processing.
Sensation & Perception
Sensing information ISE
Chapter 4 Section 2.
Volume 25, Issue 17, Pages R736-R739 (August 2015)
How do we make decisions about uncertain events?
Signal detection theory
Roc curves By Vittoria Cozza, matr
Volume 16, Issue 20, Pages (October 2006)
Presentation transcript:

SIGNAL DETECTION THEORY  A situation is described in terms of two states of the world: a signal is present ("Signal") a signal is absent ("Noise")  You have two possible responses: the signal is present ("Yes") the signal is absent ("No") SignalNoise Response Yes Hit P(H) False Alarm P(FA) No Miss P(M) Correct Rejection P(CR)

 The theory assumes that what you are doing is: l First, you collect sensory evidence concerning the presence or absence of the signal. l Next, you decide whether this evidence constitutes a signal. This means that you must have some criterion C that you use as a "cutoff": if the evidence is less than C, you decide "No"; if the evidence exceeds C, you decide "Yes".

Measures of Performance in SDT:  1. Response bias (  l We can describe performance in terms of response bias: you may be prone to say "yes" (which is "risky") or you may be prone to say "no" (which is "conservative"). l Response bias the ratio of the heights of the two curves at the cutoff point and is measured by the quantity: P(X/S) ß = * P(X/N) –whereX = "evidence variable” –S = signal –N = noise *Note: your book has a “simplified” equation for representing . You may refer to whichever best helps you understand the concept of response bias.

 Studies of human performance show that humans do change β in response to changes in probabilities and payoffs ‑‑ but not as much as they should! l This phenomenon is called sluggish beta.  Note: the terms “risky” and “conservative”refer only to a person’s propensity to say “yes (signal)” or “no (noise).” l Examples: radiologists reading x-rays for signs of tumors radar operators on a battle ship looking for incoming enemy aircraft scanning a parking lot for a parking space

 The cutoff (C) for determining the presence of a signal vs the response bias parameter (ß). l Not the same but correlated. “Risky“ strategy: ß ↓ and C ↓ More conservative: both C and ß ↑  Setting β l Strategy can be affected by relative costs and values assigned to outcomes. l Examples: radiologists reading x-rays for signs of tumors radar operators on a battle ship looking for incoming enemy aircraft

Measures of Performance in SDT: 2. Sensitivity (d’) l Signal detection theory distinguishes response bias from sensitivity a function of the keenness or sensitivity of the human's detection mechanisms and the relative strength of the signal in noise. –For example, a person may be "risky" (i.e., prone to say "Yes, I detect a signal") but may have bad eyesight (or be looking at a very fuzzy screen) and thus may often miss signals because of this low sensitivity. l Table 4.5 on page 84 of your textbook gives some possible values of d’ corresponding to observed P(H) and P(FA). This value may also be calculated from the probabilities of a hit and a false alarm.

 Plots the probability of a hit against the probability of a false alarm.  Each curve represents the same sensitivity at different levels of response bias. Receiver Operating Characteristic (ROC) curve

Your Turn ….  An experiment was performed to determine how students who participated in a distance learning course responded to a signal from the instructor indicating that they had been “called on” to respond to a question. The results for two of the students using a particular type of signal and with varying feedback (i.e., “rewards” for responding) are given in the table below. Plot the results for both students on the same ROC curve. Who is more sensitive? Identify “risky” and “conservative” behavior. Comment on the results. FeedbackP(fa)P(hit) Negative Student 1Neutral Positive Negative Student 2Neutral Positive