Comparison of Fuzzy and Signal Detection Theory L.L. Murphy, J.L. Szalma, and P.A. Hancock Department of Psychology Institute of Simulation and Training.

Slides:



Advertisements
Similar presentations
Sensitivity versus response bias: Psychophysical techniques.
Advertisements

A Comparison of Rule-Based versus Exemplar-Based Categorization Using the ACT-R Architecture Matthew F. RUTLEDGE-TAYLOR, Christian LEBIERE, Robert THOMSON,
Meredith Newlin, Research Fellow and PhD Candidate Centre for Mental Health Social Research This presentation presents independent research funded by the.
Mutual Aid for Public Health Emergencies: Lessons From the 2004 Hurricanes Tim Stephens Principal Director, Preparedness Policy ASTHO.
Comparison of Spatial and Temporal Discrimination Performance across Various Difficulty Levels J.E. THROPP, J.L. SZALMA, & P.A. HANCOCK Department of Psychology.
A Meta-Analysis of Periodic Noise Stress on Human Performance J.M. Ross, G.E. Conway, J.L. Szalma, B.M. Saxton, A. Braczyk, & P.A. Hancock University of.
Decision making as a model 5.a. more models and measures b. costs and benefits c. the optimal criterion (Bayes is back)
Coachfederation.org/ICFGlobal2012 Team Coaching: Get Results and Rave Reviews Catherine Carr, M.Ed., PCC, RCC (Canada) Jacqueline Peters, B.Sc., M.Ed.,
Short Notes on Theory of Signal Detection Walter Schneider
This material is based upon work supported by the U.S. Department of Homeland Security, Science and Technology Directorate, Office of University Programs,
Impact of different relation extraction methods on network analysis results Jana Diesner.
Results Performance The correct detection and false alarm rates for each participant were used to compute signal detection theory measures of sensitivity.
Research indicates that observers do not always estimate the pain of others accurately. Often, pain is underestimated. Given the important implications.
© Cambridge University Press 2013 Thomson_alphaem.
© Cambridge University Press 2013 Thomson_Fig
Information commitments, evaluative standards and information searching strategies in web-based learning evnironments Ying-Tien Wu & Chin-Chung Tsai Institute.
49 th Annual HFES Meeting, Orlando FL Application of Theories of Motivation and Emotion to Hedonomics J.L. Szalma University of Central Florida.
Signal detection theory Appendix Takashi Yamauchi Texas A&M University.
Signal Detection Theory I. Challenges in Measuring Perception II. Introduction to Signal Detection Theory III. Applications of Signal Detection Theory.
Disciplined Software Engineering Lecture #3 Software Engineering Institute Carnegie Mellon University Pittsburgh, PA Sponsored by the U.S. Department.
Right Hemifield Deficits in Judging Simultaneity: A Perceptual Learning Study Nestor Matthews 1, Michael Vawter 1, Jenna Kelly 2 Psychology, Denison University.
20-24 September 2004Szalma, Oron-Gilad, & Hancock – HFES Annual Meeting1 Examination of Attentional Mechanisms Underlying Stress and Performance J.L. Szalma,
The Influence of Dispositional Optimism and Pessimism on Task Engagement for Spatial and Temporal Discrimination J.L. Szalma, J.M. Ross, & P.A. Hancock.
Uncertainty Management in Rule-based Expert Systems
Individual differences play a dominant role in determining how well a job can be performed, accounting for more variability in performance than differences.
MIT2 Lab, UCF 1 The use of Meta-analysis to update the whole-body vibration stressor effects within IMPRINT Gareth Conway James Szalma MIT 2 Lab, University.
Sensation Perception = gathering information from the environment 2 stages: –Sensation = simple sensory experiences and translating physical energy from.
Chapter 2: Signal Detection and Absolute Judgement
EMPATH: A Neural Network that Categorizes Facial Expressions Matthew N. Dailey and Garrison W. Cottrell University of California, San Diego Curtis Padgett.
Performance Operating Characteristics for Spatial and Temporal Discriminations: Common or Separate Capacities? J. E. Thropp, J. L. Szalma, and P. A. Hancock.
USER INTERFACE USER INTERFACE January 12, 2006 Intern 박지현 Performance analysis of filtering software using Signal Detection Theory Ashutosh Deshmukh, Balaji.
Microanalysis & Coding: Grounded Theory Techniques Part I EDL 714: 12/1/10.
Psy Psychology of Hearing Psychophysics and Detection Theory Neal Viemeister
Szalma & Hancock HFES Europe, Fuzzy Signal Detection Theory and Human Performance: A Review of Empirical Evidence for Model Validity J.L. Szalma.
© Cambridge University Press 2013 Thomson_Fig
© 2001 Dr. Laura Snodgrass, Ph.D.1 Psychophysics Mathematical formula for relationship between changes in the physical stimulus and changes in conscious.
Copyright © 2012 Assessment and Accountability Comprehensive Center & North Central Comprehensive Center at McRel.
Presentation for the Class of 2008
James L. Szalma Department of Psychology and Institute for Simulation and Training University of Central Florida Analysis of Individual Differences Data:
Fuzzy Signal Detection Theory: ROC Analysis of Stimulus and Response Range Effects J.L. Szalma and P.A. Hancock Department of Psychology and Institute.
Center for Assessment and Improvement of Learning
Alison Burros, Kallie MacKay, Jennifer Hwee, & Dr. Mei-Ching Lien
AAS Business Analytics: Wake Tech CC
Effects of Working Memory on Spontaneous Recognition
Data Science and Statistical Agencies
© Cambridge University Press 2011
Alison Burros, Nathan Herdener, & Mei-Ching Lien
Effects of Oncoming Vehicle Size on Overtaking Judgments
Origins of Signal Detection Theory
Impacts of workload on trust in imperfect automated systems
Discussion and Conclusion
Jessie Bullens prof. dr. Albert Postma
Foundations of Institutional Research 2018 Data quality improvement
What is a False Dispatch?
How healthcare organisations respond to feedback
Thomson_eeWWtgc © Cambridge University Press 2013.
Human-Model Interaction Heuristics
علم النفس التحليلي كارل غوستاف يونغ
Evolution of fast familiarity and novelty decisions in aging
Thomson_atlascmsEventsAlt
Sergeant Joanne Archambault (Ret. ) CEO and Founder
Thomson_CandP © Cambridge University Press 2013.
Mental Health in the Correctional System
This material is based upon work supported by the National Science Foundation under Grant #XXXXXX. Any opinions, findings, and conclusions or recommendations.
This study/project is funded by/ supported by the National Institute for Health Research (NIHR) [name of NIHR programme (Grant Reference Number XXX)/name.
Thomson_AFBCartoon © Cambridge University Press 2013.
This study/project is funded by/ supported by the National Institute for Health Research (NIHR) [name of NIHR programme (Grant Reference Number XXX)/name.
This study/project is funded by/ supported by the National Institute for Health Research (NIHR) [name of NIHR programme (Grant Reference Number XXX)/name.
Title of Poster Usually Up Top (Recommend 80pt – 115 pt)
Presentation transcript:

Comparison of Fuzzy and Signal Detection Theory L.L. Murphy, J.L. Szalma, and P.A. Hancock Department of Psychology Institute of Simulation and Training University of Central Florida

Signal Detection Theory (SDT) SDT has provided an useful analytical tool SDT has provided an useful analytical tool the state of the world is divided into mutually exclusive categories the state of the world is divided into mutually exclusive categories which are not always evident in an uncertain world which are not always evident in an uncertain world

Fuzzy Signal Detection Theory (FSDT) FSDT combines SDT and Fuzzy Set Theory FSDT combines SDT and Fuzzy Set Theory category membership is not mutually exclusive category membership is not mutually exclusive

Objectives This is the first ever direct contrast between FSDT and SDT This is the first ever direct contrast between FSDT and SDT The purpose was to investigate the degree to which the FSDT model was sensitive to the classical SDT manipulations. The purpose was to investigate the degree to which the FSDT model was sensitive to the classical SDT manipulations. The same set of data from a discrimination task was analyzed using both FSDT and SDT methods of analysis The same set of data from a discrimination task was analyzed using both FSDT and SDT methods of analysis

FSDT and SDT Formulas d’ perceptual sensitivity and c response bias (same for both methods) d’ perceptual sensitivity and c response bias (same for both methods) Hit and false alarm rate formulae Hit and false alarm rate formulae FSDT FSDT Parasuraman et al. (2000) Parasuraman et al. (2000) SDT SDT McMillan and Creelman (1991) McMillan and Creelman (1991)

Discussion The surprise is in the very different results The surprise is in the very different results Evidence suggests that the methods provide different insights into system performance Evidence suggests that the methods provide different insights into system performance Further work is needed to investigate d’ and the FSDT model Further work is needed to investigate d’ and the FSDT model

References Hancock, P.A., Masalonis, A.J., & Parasuraman, R. (2000). On the theory of fuzzy signal detection: Theoretical and practical considerations. Theoretical Issues in Ergonomic Science, 1, Hancock, P.A., Masalonis, A.J., & Parasuraman, R. (2000). On the theory of fuzzy signal detection: Theoretical and practical considerations. Theoretical Issues in Ergonomic Science, 1, Macmillan, N.A., & Creelman, C.D. (1991). Detection theory: A user’s guide. New York: Cambridge University Press. Macmillan, N.A., & Creelman, C.D. (1991). Detection theory: A user’s guide. New York: Cambridge University Press. Parasuraman, R., Masalonis, A.J., & Hancock, P.A. (2000). Fuzzy signal detection theory: Basic postulates and formulas for analyzing human and machine performance. Human Factors, 42, Parasuraman, R., Masalonis, A.J., & Hancock, P.A. (2000). Fuzzy signal detection theory: Basic postulates and formulas for analyzing human and machine performance. Human Factors, 42,

Acknowledgements This work was facilitated by the Department of Defense Multidisciplinary University Research Initiative (MURI) program administered by the Army Research Office under Grant DAAD , Dr. P.A. Hancock, Principal Investigator. The assistance of the Department of Psychology at University of Central Florida is also gratefully acknowledged. The views expressed in this work are those of the authors and do not necessarily reflect official Army policy. This work was facilitated by the Department of Defense Multidisciplinary University Research Initiative (MURI) program administered by the Army Research Office under Grant DAAD , Dr. P.A. Hancock, Principal Investigator. The assistance of the Department of Psychology at University of Central Florida is also gratefully acknowledged. The views expressed in this work are those of the authors and do not necessarily reflect official Army policy.