C T I Metacognitive Processes for Uncertainty Handling Marvin S. Cohen, Ph.D. Bryan B. Thompson Cognitive Technologies, Inc. 4200 Lorcom Lane Arlington,

Slides:



Advertisements
Similar presentations
Pat Langley Computational Learning Laboratory Center for the Study of Language and Information Stanford University, Stanford, California USA
Advertisements

TeachMed Clinical reasoning learning with simulated patients Guy Bisson M.D., Faculté de médecine Froduald Kabanza Ph.D., Faculté des sciences, département.
The Logic of Intelligence Pei Wang Department of Computer and Information Sciences Temple University.
Basic Concepts of Strategic Management
© 2009 McGraw-Hill Higher Education. All rights reserved. McGraw-Hill P.O.W.E.R. Learning: Becoming an Expert Student Chapter 1.
Intelligent systems Lecture 6 Rules, Semantic nets.
Introduction of Probabilistic Reasoning and Bayesian Networks
The Art and Science of Teaching (2007)
© 2002 by Bryan B. ThompsonPresentation to SWIG, November 1 st, 2002 Critical Thinking On the Web The Cognitive Web Presentation to the Semantic Web Interest.
Show Me an Evidential Approach to Assessment Design Michael Rosenfeld F. Jay Breyer David M. Williamson Barbara Showers.
Psychological Aspects of Risk Management and Technology – G. Grote ETHZ, Fall09 Psychological Aspects of Risk Management and Technology – Overview.
Meaningful Learning in an Information Age
AIMS & OBJECTIVES AIM: To allow delegates an opportunity to practise Teamwork in a practical way using a series of outdoor activities OBJECTIVE: To develop.
Tutoring and Learning: Keeping in Step David Wood Learning Sciences Research Institute: University of Nottingham.
Organizational Behavior, 9/E Schermerhorn, Hunt, and Osborn
Decision Making Dr Vasuprada Kartic NAC Batch IX PGDCPM.
Information Seeking Processes and Models Dr. Dania Bilal IS 530 Fall 2007.
Mike Rospenda Math practices, mike rospenda 1. students actually do math use mathematics using math knowledge engaging in mathematical thinking investigate.
Copyright © 2002 by The McGraw-Hill Companies, Inc. Information Technology & Management 2 nd Edition, Thompson Cats-Baril Chapter 8 I/S and Organizational.
Higher-Level Cognitive Processes
Standards-Based Science Instruction. Ohio’s Science Cognitive Demands Science is more than a body of knowledge. It must not be misperceived as lists of.
SLB /04/07 Thinking and Communicating “The Spiritual Life is Thinking!” (R.B. Thieme, Jr.)
11 C H A P T E R Artificial Intelligence and Expert Systems.
Copyright 2004 Compsim LLC The Right Brain Architecture of a Holonic Manufacturing System Application of KEEL ® Technology to Holonic Manufacturing Systems.
T 7.0 Chapter 7: Questioning for Inquiry Chapter 7: Questioning for Inquiry Central concepts:  Questioning stimulates and guides inquiry  Teachers use.
CS :: Fall 2003 Media Scaling / Content Adaptation Ketan Mayer-Patel.
Feb 24, 2003 Agent-based Proactive Teamwork John Yen University Professor of IST School of Information Sciences and Technology The Pennsylvania State University.
Synthetic Cognitive Agent Situational Awareness Components Sanford T. Freedman and Julie A. Adams Department of Electrical Engineering and Computer Science.
Ontology Summit 2015 Track C Report-back Summit Synthesis Session 1, 19 Feb 2015.
LEARNING DISABILITIES IMPACTING MATHEMATICS Ann Morrison, Ph.D.
Integrated Risk Management Charles Yoe, PhD Institute for Water Resources 2009.
Abbasian, Phd Ch 1 -1 Chapter 1 The Nature of Strategic Management Strategic Management: Concepts & Cases 13 th Edition Fred David.
MURI: Integrated Fusion, Performance Prediction, and Sensor Management for Automatic Target Exploitation 1 Dynamic Sensor Resource Management for ATE MURI.
Construct-Centered Design (CCD) What is CCD? Adaptation of aspects of learning-goals-driven design (Krajcik, McNeill, & Reiser, 2007) and evidence- centered.
PowerPoint Presentation by Charlie Cook The University of West Alabama Copyright © 2005 Prentice Hall, Inc. All rights reserved. Chapter 4 Foundations.
1 What is OO Design? OO Design is a process of invention, where developers create the abstractions necessary to meet the system’s requirements OO Design.
LANGUAGE MODELS FOR RELEVANCE FEEDBACK Lee Won Hee.
Spring 2011 Tutor Training Modern Learning Theories and Tutoring Designed and Presented by Tem Fuller.
Crisis “Management”: A Way Forward David S. Alberts presented to Crisis Management 3.0: Social Media and Governance in Times of Transition.
산업경영공학과 IMEN 315 인간공학 7. Decision Making DEFINITION OF DECISION MAKING qa decision-making task (a)number of alternatives (b)information available to the.
Advanced Decision Architectures Collaborative Technology Alliance An Interactive Decision Support Architecture for Visualizing Robust Solutions in High-Risk.
Cognitive Processes Chapter 8. Studying CognitionLanguage UseVisual CognitionProblem Solving and ReasoningJudgment and Decision MakingRecapping Main Points.
Uncertainty Management in Rule-based Expert Systems
PAINT RAPID : Representation and Analysis of Probabilistic Intelligence Data Carnegie Mellon University DYNAM i X Technologies PI: Jaime Carbonell Eugene.
Decision Making Chapter 7. Definition of Decision Making Characteristics of decision making: a. Selecting a choice from a number of options b. Some information.
Chapter 6 DECISION MAKING: THE ESSENCE OF THE MANAGER’S JOB 6.1 © 2003 Pearson Education Canada Inc.
1 The Way Ahead Dr. Ed Smith Boeing Effects-Based Operations: The “how to”
1-1 Copyright  2009 McGraw-Hill Australia Pty Ltd PPTs t/a Managerial Problem Solving by Wood Slides prepared by Robert Wood, Julie Cogin and Jens Beckmann.
Jhu-hlt-2004 © n.j. belkin 1 Information Retrieval: A Quick Overview Nicholas J. Belkin
LEARNING DISABILITIES IMPACTING MATHEMATICS Ann Morrison, Ph.D.
International Conference on Fuzzy Systems and Knowledge Discovery, p.p ,July 2011.
How people learn different ways to think about learning.
Chapter 7 Making Better Decisions Management 1e 7- 2 Management 1e Learning Objectives  Describe the seven steps of the decision making.
RULES Patty Nordstrom Hien Nguyen. "Cognitive Skills are Realized by Production Rules"
Artificial Intelligence: Research and Collaborative Possibilities a presentation by: Dr. Ernest L. McDuffie, Assistant Professor Department of Computer.
Unclassified//For Official Use Only 1 RAPID: Representation and Analysis of Probabilistic Intelligence Data Carnegie Mellon University PI : Prof. Jaime.
Wagner Associates NCSD-ADS-DOC ARO Workshop on Cyber Situation Awareness RPD-inspired Hypothesis Reasoning for Cyber Situation Awareness.
Presented by Ms. Vayas At Bancroft MS March 25, 2008.
Decision Making ET 305, Spring 2016
© 2008 Thomson South-Western. All Rights Reserved Slides by JOHN LOUCKS St. Edward’s University.
Information Aids for Diagnosis Tasks Based on Operators’ Strategies 김 종 현.
IE 545, Human Factors Engineering
Organizational Behavior, 9/E Schermerhorn, Hunt, and Osborn
Using Cognitive Science To Inform Instructional Design
Scenario Specification and Problem Finding
Object-Oriented Software Engineering Using UML, Patterns, and Java,
Principle 3: Develop DM Processes to Fit the Context and Business Environment in Which They Will Be Performed Learning Objectives: Understand how DM can.
An epistemology of practice
Information Seeking Models
LEARNER-CENTERED PSYCHOLOGICAL PRINCIPLES. The American Psychological Association put together the Leaner-Centered Psychological Principles. These psychological.
Presentation transcript:

C T I Metacognitive Processes for Uncertainty Handling Marvin S. Cohen, Ph.D. Bryan B. Thompson Cognitive Technologies, Inc Lorcom Lane Arlington, VA March 2005 Army Research Institute: DASW01-97-C-0038 Office of Naval Research: N M0070 National Science Foundation: DMI Connectionist Implementation of a Cognitive Model

C T I Cognitive - Computational Architecture An Integration of Two Research Areas Recognition - Metacognition model: Critical reflection in recognition-based decision making Thanks to our collaborator, Dr. Lokendra Shastri, ICSI, Berkeley. SHRUTI, a connectionist model: Rapid parallel reasoning about belief and utility, with relations & dynamic variable binding

C T I The Recognition / Metacognition Model Naturalistic Decision Making Empirical investigation of how experienced, effective decision makers make decisions And – how they differ from less experienced, less effective decision makers Proficient Decision Makers combine pattern recognition with strategies for facilitating recognition, verifying & improving its results, when familiar patterns don’t fit.

C T I Meta-Recognition System Recognition System Reflection about Recognition External Environment Perceptual Encoding Activation of Domain Mental Models Action Immediate action Information collection Wait Monitor Recognition Costs of delay? Costs of errors? Novel task or situation? Regulate Recognition Inhibit action, allow reflective processes Permit action on current best model Monitor Uncertainty in Mental Models Regulate Uncertainty in Mental Models Shift attention, clamp assumptions -- to activate information in long-term memory & test hypotheses Incomplete Evidence (0,0) Conflicting Evidence (1,1) Accepted (1,0) Rejected (0,1) Assumptions Low Resolution (.5,.5)

C T I Control Critical Dialogue Inner Dialogue among Three Perspectives First person point of view: Proponent Second person point of view: Critic Third person point of view: Facilitator - Judge Evolving mental models of alternative possible states of affairs Dynamic challenge & response Regulation of pragmatic tradeoffs, to achieve objectives

C T I Control Cycle Longer temporal scope –Comparable to “task analysis” and “strategy selection” –But more continuous, incremental, & local

C T I Critiquing & Correcting Cycle Shorter temporal scope –Comparable to simple judgments (e.g., “Feeling of knowing”)

C T I Advantages of R-M Strategy Proponent: Utilizes experience & intuition in novel & uncertain situations –No need to convert to “analytical” mode of thinking –A small number of concrete, visualizable scenarios, not an unrealizable statistical aggregation (e.g., 70% hostile, 30% friendly) Critiquing & correcting cycle: Improves on experience & intuition –Stimulates retrieval & use of implicit knowledge –Helps understand solution’s strengths and weaknesses – by reflective annotation of mental models Control cycle: Can stop process any time and go with the best solution so far –Adapt to available time vs potential benefits

C T I The Recognitional Model: SHRUTI Rapid, parallel, and relational inference Processing time is independent of size of long-term knowledge base Space linear in size of long term knowledge base Supports complex relational reasoning involving multiple objects and n-ary predicates –Has representational and inferential capability of predicate calculus, within processing limitations

C T I Keeping Track of Object Roles in Rules Represents same object throughout a chain of inferences by assigning a different phase of neural activation to each object & using temporal pattern matching Neurally plausible

C T I Limitations on Reflexive Reasoning Limits number of different objects that can be distinguished in a particular incident of reasoning (based on temporal resolution for assigning objects to phases) Limits length of reasoning/retrieval chain (based on increasing error with length of propagation) Limits number of instances of same predicate that can be used in an incident of reasoning These limitations provide context in which metacognitive skills may improve both performance and learning

C T I Limits of Working Memory Taxon Fact = Prior probability of being surprised Specific information is not attended to Predicates at edge of network have impact equal to average of activation in previous situations. This is in effect the assumption that everything is normal (i.e., average) and results in low resolution.

C T I Compensation for Limitations by Reflective System Not all relevant information in long term knowledge base may be retrieved in first cycle of attention New information propagates effects through network Results of successive attention shifts are integrated through priming Control cycle monitors changes in uncertainty, and (possibly) estimate of time available & costs of errors. Balances advantages of thinking more versus risks of delaying action Critiquing & correcting cycle activates additional relevant information by shifting attention &/or clamping

C T I Clamp: Assume we will attack. What-if? Automatic Query: Will we defeat enemy? Returning activation suggests we will defeat enemy.

C T I Metacognitive critic recognizes uncertainty pattern corresponding to incomplete information (low activation of both + and -) Critiquing & Correcting Shift attention to culprit – low resolution taxon fact. Automatic Query: Will attack be unexpected? Returning activation provides no support for success of attack! Changes center of activation.

C T I Effects of Metacognition on Learning Decision makers acquire domain-specific metacognitive skills –Which predicates to scrutinize when trouble arises –Basic associative learning of weights on links between relations, e.g., by backpropagation Decision makers acquire general metacognitive skills –Strategies for shifting attention based on conflict, gaps, resolution, & instability (assumptions). Result 1: More effective working memory Result 2: Speeded compilation of domain knowledge –Extends reach of backpropagation learning for domain