Human Performance Modeling

Slides:



Advertisements
Similar presentations
How do we know when we know. Outline  What is Research  Measurement  Method Types  Statistical Reasoning  Issues in Human Factors.
Advertisements

10 / 31 Outline Perception workshop groups Signal detection theory Scheduling meetings.
Stats 95 Experimental Design –Experimental Design & Lady Tasting Tea –Type I and Type II Errors –Null Hypothesis an Research Hypothesis.
Threaded Cognition: An Integrated Theory of Concurrent Multitasking
What is Artificial Intelligence? –Depends on your perspective... Philosophical: a method for modeling intelligence Psychological: a method for studying.
Copyright 2008 by User Interface Lab Industrial Engineering Dept. of Industrial Systems & Information Engineering Korea University Serial Modules in Parallel.
Report on Intrusion Detection and Data Fusion By Ganesh Godavari.
Visual Attention More information in visual field than we can process at a given moment Solutions Shifts of Visual Attention related to eye movements Some.
Statistics for the Social Sciences Psychology 340 Fall 2006 Review For Exam 1.
Overview and History of Cognitive Science. How do minds work? What would an answer to this question look like? What is a mind? What is intelligence? How.
ACT-R.
Outline: Research Methodology: Case Study - what is case study
COMPUTATIONAL MODELING OF INTEGRATED COGNITION AND EMOTION Bob MarinierUniversity of Michigan.
Introduction to Theory & Research Design
Data Selection In Ad-Hoc Wireless Sensor Networks Olawoye Oyeyele 11/24/2003.
Section 2: Science as a Process
1.scientific method = approach taken to try to solve a problem, can include recognizing the problem, forming a hypothesis, testing the hypothesis, analyzing.
Testing Hypotheses I Lesson 9. Descriptive vs. Inferential Statistics n Descriptive l quantitative descriptions of characteristics n Inferential Statistics.
Chapter 5 Models and theories 1. Cognitive modeling If we can build a model of how a user works, then we can predict how s/he will interact with the interface.
Human Control of Systems Tracking Tasks Human Performance Considerations Measuring Tracking & Controlling Performance System Behaviors Representing System.
Scientific Process ► 1) Developing a research idea and hypothesis ► 2) Choosing a research design (correlational vs. experimental) ► 3) Choosing subjects.
Statistical Decision Making. Almost all problems in statistics can be formulated as a problem of making a decision. That is given some data observed from.
I NDUSTRIAL E NGINEERING C OGNITIVE E RGONOMICS L AB TOPIC 2: INFORMATION PROCESSING.
Cognitive Architectures: A Way Forward for the Psychology of Programming Michael Hansen Ph.D Student in Comp/Cog Sci CREST / Percepts & Concepts Lab Indiana.
Report on Intrusion Detection and Data Fusion By Ganesh Godavari.
110/19/2015CS360 AI & Robotics AI Application Areas  Neural Networks and Genetic Algorithms  These model the structure of neurons in the brain  Humans.
Advanced Decision Architectures Collaborative Technology Alliance A Computational Model of Naturalistic Decision Making and the Science of Simulation Walter.
Chapter 1 Introduction to Statistics. Statistical Methods Were developed to serve a purpose Were developed to serve a purpose The purpose for each statistical.
RE - SEARCH ---- CAREFUL SEARCH OR ENQUIRY INTO SUBJECT TO DISCOVER FACTS OR INVESTIGATE.
Signal Detection Theory I. Challenges in Measuring Perception II. Introduction to Signal Detection Theory III. Applications of Signal Detection Theory.
Korea Univ. Division Information Management Engineering UI Lab. Korea Univ. Division Information Management Engineering UI Lab. IMS 802 Cognitive Modeling.
Introduction to Earth Science Section 2 Section 2: Science as a Process Preview Key Ideas Behavior of Natural Systems Scientific Methods Scientific Measurements.
Review of the Scientific Method Chapter 1. Scientific Method – –Organized, logical approach to scientific research. Not a list of rules, but a general.
Overconfidence in judgment: Why experience might not be a good teacher Tom Stewart September 24, 2007.
Chapter 2: Signal Detection and Absolute Judgement
Science Terms TAKS Objective 1.
SCIENCE There is a method to the madness!! SCIENTIFIC METHOD State the Problem State the Problem Gather Information Gather Information Form a Hypothesis.
U SER I NTERFACE L ABORATORY Situation Awareness a state of knowledge, from the processes used to achieve that state (situation assessment) not encompass.
Major Science Project Process A blueprint for experiment success.
1.3 Scientific Thinking and Processes KEY CONCEPT Scientific Method Science is a way of thinking, questioning, and gathering evidence.
1 Chapter 18: Selection and training n Selection and Training: Last lines of defense in creating a safe and efficient system n Selection: Methods for selecting.
Dr. Fuchs. 1.1 What is Science What are the goals of Science and what procedures are at the core of scientific methodology?
RULES Patty Nordstrom Hien Nguyen. "Cognitive Skills are Realized by Production Rules"
Scientific Method. 1. Identify Problem Written as a question. No pronouns.
Scientific Method Review. Scientific Method Ask a Question: –state the purpose of what you are trying to figure out Form a Hypothesis: –a tentative explanation.
Introduction to ScienceSection 1 Section 1: The Nature of Science Preview Key Ideas Bellringer How Science Takes Place The Branches of Science Scientific.
SIGNAL DETECTION THEORY  A situation is described in terms of two states of the world: a signal is present ("Signal") a signal is absent ("Noise")  You.
Introduction to ScienceSection 1 SCSh8 Students will understand important features of the process of scientific inquiry.
Steps in the Scientific Method 1.Observations - quantitative - qualitative 2.Formulating hypotheses - possible explanation for the observation 3.Performing.
Data Analysis. Qualitative vs. Quantitative Data collection methods can be roughly divided into two groups. It is essential to understand the difference.
Unit 1 Methods of Science: Hypothesis Law Theory Model.
What is Psychology? Pages What is Psychology? Give me your own personal definition of Psychology.
Introduction to Research. Objectives Introduction to Research (continued) Recap important concepts from previous class Quantitative vs. Qualitative Research.
Demand Management and Forecasting Chapter 11 Portions Copyright © 2010 by The McGraw-Hill Companies, Inc. All rights reserved. McGraw-Hill/Irwin.
Chapter 11 – With Woodruff Modications Demand Management and Forecasting Copyright © 2010 by The McGraw-Hill Companies, Inc. All rights reserved.McGraw-Hill/Irwin.
Cognitive Modeling Cogs 4961, Cogs 6967 Psyc 4510 CSCI 4960 Mike Schoelles
Research Methods in I/O Psychology
What is cognitive psychology?
Psychology Notes 1.1.
SEEV Model of Visual Attention Allocation
Scientific Method.
Section 2: Science as a Process
Human Factors Issues Chapter 8 Paul King.
Scientific Method.
Scientific Inquiry Unit 0.3.
Scientific Method Integrated Sciences.
The Method of Science.
How do we make decisions about uncertain events?
A logical approach to problem solving.
Testing Hypotheses I Lesson 9.
Presentation transcript:

Human Performance Modeling Model – ‘a simplified representation of a system or phenomenon, as in the sciences or economics, with any hypotheses required to describe the system or explain the phenomenon, often mathematically’ Perception and attention, action or motor control, and cognition

General Issues Misconception -- construction of “intelligent system”  AI predictions of human performance on human factors problems not necessarily from basic psychological processes All models are abstractions and by necessity omit certain details Accuracy and generality

General Issues Simplicity and understandability Free parameters – how to set and interpret Validation – correlation, mean deviation Gains Specificity vs. qualitative and vague Modeler independent Quantitative predictions Explanation for observed differences

Perception and Attention Signal Detention Theory (SDT) Make a binary judgment btn signal and noise Hit, False Alarm, Correct Rejection, Miss p(H) + p(FA) =1; p(CR) + p(M) =1 Type I error (FA) & Type II error (Miss) Decompose performance into detection efficiency (d’) and criterion parameter (β)

Perception and Attention

Perception and Attention Visual Search Models Feature integration theory (Treisman and Gelade, 1980)  Salience map (Itti and Koch, 2000)

Perception and Attention Visual Sampling Models Senders (1964, 1983) – a signal at W Hz can be reconstructed by sampling every 1/W s Wickens (2008) – Salience, Effort, Expectancy, Value (SEEV) Model p(A) = sS – efEF + (exEX)(vV)

Perception and Attention Workload Modeling Neither commonly accepted definition nor how to measure it Psychological refractory period (PRP) paradigm – response selection bottleneck model (Pashler, 1994): perception, response selection & action Multiple resource theory (Wickens, 2002 and 2008) – the stages, the codes and modalities

Action & Motor Performance Hick-Hyman Law Information entropy H = log2(n+1) RT = a + bH 𝐻= 𝑖=1 𝑛 𝑝 𝑖 log⁡( 1 𝑝 𝑖 +1)

Action & Motor Performance Fitts’s Law MT = a + b*ID ID = log2(2A/W) – Fitts (1954)

Action & Motor Performance Manual Control Theory Continuous tracking task Between the desired and their actual behavior Transfer function As system frequency increases, the gain decreases and the lag increases

Action & Motor Performance Manual Control Theory Crossover model (McRuer & Jex, 1967) Two crossover points: the frequency at which the gain is zero and the frequency at which the lag reaches 180° Optimal control model (Pew & Baron, 1978)

Action & Motor Performance

Memory & Cognition Historical Perspective GPS (Newell & Simon, 1963) computational models could effectively capture key elements of human cognitive behavior “modal” model of memory (Atkins & Shiffrin, 1968)

Action & Motor Performance Routine Cognitive Skill and GOMS KLM-GOMS CPM-GOMS NGOMSL

Action & Motor Performance Models of Judgment and Decision Making Optimal behavior – A baseline of comparison for human performance  SEUT, Prospective theory, EBA Lens model (policy capturing)

Integrated Models Task Network Modeling Network model – a modeling procedure involving Monte Carlo simulation Decomposition of the Task into discrete subtasks; PERT chart Nodes represented by a statistically specified completion time and a probability of completion SAINT, Micro Saint Sharp, IMPRINT

Integrated Models Cognitive Architecture an embodiment of “a scientific hypothesis about those aspects of human cognition that are relatively constant over time and relatively independent of task” The mid-1990’s when including mechanisms for perception and action as well EPIC (1995 & 1997), ACT-R (1998) & QN-MHP

Integrated Models Cognitive Architecture Several modules in ACT-R 두정엽 전두엽 후두엽 측두엽 소뇌

Integrated Models Cognitive Architecture Drawbacks Knowledge in ACT-R code S/W integration problem with a rich simulation environment Setting free parameters Exposition of ACT-R not always straightforward