Presentation is loading. Please wait.

Presentation is loading. Please wait.

Testing the influence of autonomous system input on human perceptual categorization of speech Joseph D. W. Stephens, Ph.D. Associate Professor Psychology.

Published byDwight Eugene Byrd Modified over 9 years ago

Similar presentations

Presentation on theme: "Testing the influence of autonomous system input on human perceptual categorization of speech Joseph D. W. Stephens, Ph.D. Associate Professor Psychology."— Presentation transcript:

1

2 Testing the influence of autonomous system input on human perceptual categorization of speech Joseph D. W. Stephens, Ph.D. Associate Professor Psychology Department North Carolina A&T State University TECHLAV Seminar Series JDW Stephens Influence of autonomy on perception 25 September 2015 1

3 Overview JDW Stephens Influence of autonomy on perception 25 September 2015 2 1.The importance of Situation Awareness (SA) 2.SA with large-scale autonomous systems 3.The question of uncertainty 4.Pilot study: Testing the influence of uncertain info. 5.Future directions

4 Overview JDW Stephens Influence of autonomy on perception 25 September 2015 3 1.The importance of Situation Awareness (SA) 2.SA with large-scale autonomous systems 3.The question of uncertainty 4.Pilot study: Testing the influence of uncertain info. 5.Future directions

5 The importance of Situation Awareness JDW Stephens Influence of autonomy on perception 25 September 2015 4 What is Situation Awareness? Endsley’s framework (e.g., Endsley, 1995): Level 1 - Perception of elements in environment Level 2 - Comprehension of current situation Level 3 - Projection of future status Importance of Level 1 is not to be underestimated

6 Overview JDW Stephens Influence of autonomy on perception 25 September 2015 5 1.The importance of Situation Awareness (SA) 2.SA with large-scale autonomous systems 3.The question of uncertainty 4.Pilot study: Testing the influence of uncertain info. 5.Future directions

7 SA with large-scale autonomous systems JDW Stephens Influence of autonomy on perception 25 September 2015 6 Let’s consider a light-hearted scenario… Note: This film is being used for illustrative purposes and its use should not be construed as an endorsement!

8 SA with large-scale autonomous systems JDW Stephens Influence of autonomy on perception 25 September 2015 7 Carl Spackler wants to know where the gophers are … but it’s a big golf course ?

9 SA with large-scale autonomous systems JDW Stephens Influence of autonomy on perception 25 September 2015 8 What if Carl had a system of robots? …could assist SA Note that there is automation involved in ID

10 Overview JDW Stephens Influence of autonomy on perception 25 September 2015 9 1.The importance of Situation Awareness (SA) 2.SA with large-scale autonomous systems 3.The question of uncertainty 4.Pilot study: Testing the influence of uncertain info. 5.Future directions

11 The question of uncertainty JDW Stephens Influence of autonomy on perception 25 September 2015 10 What if the automation is wrong?

12 The question of uncertainty JDW Stephens Influence of autonomy on perception 25 September 2015 11 What if the automation is wrong? False Alarm: Not actually a gopher

13 The question of uncertainty JDW Stephens Influence of autonomy on perception 25 September 2015 12 What if the automation is wrong? Miss: An undetected gopher

14 The question of uncertainty JDW Stephens Influence of autonomy on perception 25 September 2015 13 Errors (i.e. false alarms, misses) can potentially negate the benefits of automation (Wickens & Dixon, 2007) However, potential for errors cannot be eliminated In dynamic environment, always some uncertainty Current research question: How can human operators interpret information about the uncertainty? Goal: maximize accuracy in Level 1 SA

15 The question of uncertainty JDW Stephens Influence of autonomy on perception 25 September 2015 14 How does Carl’s SA change if the system tells him about its own uncertainty? 80% 50% 90% 70%

16 Overview JDW Stephens Influence of autonomy on perception 25 September 2015 15 1.The importance of Situation Awareness (SA) 2.SA with large-scale autonomous systems 3.The question of uncertainty 4.Pilot study: Testing the influence of uncertain info. 5.Future directions

17 Pilot Study JDW Stephens Influence of autonomy on perception 25 September 2015 16 As a first step, we are adding uncertain information to a basic categorization task: Consonant identification “Indicate whether you heard ABA or ADA” Can be influenced by visual information from the face of a speaker (e.g., McGurk & MacDonald, 1976) Can also be influenced by artificial visual cues (Stephens & Holt, 2010) What if a computer provides information about the probability of each consonant?

18 Pilot Study JDW Stephens Influence of autonomy on perception 25 September 2015 17 Stimuli: Five utterances along a series ranging from /aba/ to /ada/ (From the set created by Stephens & Holt, 2011)

19 Pilot Study JDW Stephens Influence of autonomy on perception 25 September 2015 18 Uncertain information presented on screen “The automated system estimates…” 10% ABA; 90% ADA 30% ABA; 70% ADA 50% ABA; 50% ADA 70% ABA; 30% ADA 90% ABA; 10% ADA XX% ABA; XX% ADA (no information condition) Intermediate sounds were paired with multiple percentages; each combination occurred 15 times

20 Pilot Study JDW Stephens Influence of autonomy on perception 25 September 2015 19 Preliminary results from n=8 participants No influence of on-screen percentages

21 Overview JDW Stephens Influence of autonomy on perception 25 September 2015 20 1.The importance of Situation Awareness (SA) 2.SA with large-scale autonomous systems 3.The question of uncertainty 4.Pilot study: Testing the influence of uncertain info. 5.Future directions

22 Future directions JDW Stephens Influence of autonomy on perception 25 September 2015 21 Speech categories are extremely familiar Little need to rely on automated system Next experiments will use less familiar categories Explicitly labeled percentages may be ineffective as cues for perception Further experiments will represent uncertain information using other types of visualizations for uncertainty Eventual goal: more realistic SA tasks

23 Acknowledgments JDW Stephens Influence of autonomy on perception 25 September 2015 22 Christopher Moody TECHLAV NC A&T Psychology Department

Download ppt "Testing the influence of autonomous system input on human perceptual categorization of speech Joseph D. W. Stephens, Ph.D. Associate Professor Psychology."

Similar presentations

Guidebook for Risk Analysis Tools and Management Practices to Control Transportation Project Costs Keith R. Molenaar, PhD Stuart D. Anderson, PhD, PE Transportation.

Guidebook for Risk Analysis Tools and Management Practices to Control Transportation Project Costs Keith R. Molenaar, PhD Stuart D. Anderson, PhD, PE Transportation.
Data Mining Methodology 1. Why have a Methodology  Don’t want to learn things that aren’t true May not represent any underlying reality ○ Spurious correlation.

Data Mining Methodology 1. Why have a Methodology  Don’t want to learn things that aren’t true May not represent any underlying reality ○ Spurious correlation.
Systems Analysis and Design Feasibility Study. Introduction The Feasibility Study is the preliminary study that determines whether a proposed systems.

Systems Analysis and Design Feasibility Study. Introduction The Feasibility Study is the preliminary study that determines whether a proposed systems.
Effects of pronunciation problems on ESL learners’ listening comprehension Introduction * The importance of listening comprehension * Overview of ESL listeners.

Effects of pronunciation problems on ESL learners’ listening comprehension Introduction * The importance of listening comprehension * Overview of ESL listeners.
Bivariate Analysis Cross-tabulation and chi-square.

Bivariate Analysis Cross-tabulation and chi-square.
1 Situation Awareness for CFIs Donna Forsyth Wilt, Ph.D. Florida Institute of Technology Presented at CFI Workshop FAA Safety Center, Lakeland, FL May.

1 Situation Awareness for CFIs Donna Forsyth Wilt, Ph.D. Florida Institute of Technology Presented at CFI Workshop FAA Safety Center, Lakeland, FL May.
Speech Perception Overview of Questions Can computers perceive speech as well as humans? Does each word that we hear have a unique pattern associated.

Speech Perception Overview of Questions Can computers perceive speech as well as humans? Does each word that we hear have a unique pattern associated.
Elements of Decision Problems

Elements of Decision Problems
SA-1 Probabilistic Robotics Probabilistic Sensor Models Beam-based Scan-based Landmarks.

SA-1 Probabilistic Robotics Probabilistic Sensor Models Beam-based Scan-based Landmarks.
Cognitive Processes PSY 334 Chapter 2 – Perception April 9, 2003.

Cognitive Processes PSY 334 Chapter 2 – Perception April 9, 2003.
Chapter 12 - Forecasting Forecasting is important in the business decision-making process in which a current choice or decision has future implications:

Chapter 12 - Forecasting Forecasting is important in the business decision-making process in which a current choice or decision has future implications:
Instructor: Vincent Duffy, Ph.D. Associate Professor of IE Lecture 9 – Selection & Training Tues. Feb. 13, 2007 IE 486 Work Analysis & Design II.

Instructor: Vincent Duffy, Ph.D. Associate Professor of IE Lecture 9 – Selection & Training Tues. Feb. 13, 2007 IE 486 Work Analysis & Design II.
PSY 369: Psycholinguistics

PSY 369: Psycholinguistics
Organizational Behavior, 9/E Schermerhorn, Hunt, and Osborn Prepared by Michael K. McCuddy Valparaiso University John Wiley & Sons, Inc.

Organizational Behavior, 9/E Schermerhorn, Hunt, and Osborn Prepared by Michael K. McCuddy Valparaiso University John Wiley & Sons, Inc.
Perceptual Inference and Information Integration in Brain and Behavior PDP Class Jan 11, 2010.

Perceptual Inference and Information Integration in Brain and Behavior PDP Class Jan 11, 2010.
Cognitive Processes PSY 334 Chapter 2 – Perception.

Cognitive Processes PSY 334 Chapter 2 – Perception.
1 MTN-003 Training General Interviewing Techniques Some specific tips for administering the Screening interviewer-administered CRFs SSP Section 14.

1 MTN-003 Training General Interviewing Techniques Some specific tips for administering the Screening interviewer-administered CRFs SSP Section 14.
Measures of Central Tendency

Measures of Central Tendency
Creating Empirical Models Constructing a Simple Correlation and Regression-based Forecast Model Christopher Oludhe, Department of Meteorology, University.

Creating Empirical Models Constructing a Simple Correlation and Regression-based Forecast Model Christopher Oludhe, Department of Meteorology, University.
Mood and Modality Rajat Kumar Mohanty rkm[AT]cse[DOT]iitb[DOT]ac[DOT]in Centre for Indian Language Technology Department of Computer Science and Engineering.

Mood and Modality Rajat Kumar Mohanty rkm[AT]cse[DOT]iitb[DOT]ac[DOT]in Centre for Indian Language Technology Department of Computer Science and Engineering.

Similar presentations

Ads by Google