Using Expectations to Drive Cognitive Behavior Unmesh Kurup Christian Lebiere, Tony Stentz, Martial Hebert Carnegie Mellon University.

Slides:



Advertisements
Similar presentations
A Comparison of Rule-Based versus Exemplar-Based Categorization Using the ACT-R Architecture Matthew F. RUTLEDGE-TAYLOR, Christian LEBIERE, Robert THOMSON,
Advertisements

Sander Klous on behalf of the ATLAS Collaboration Real-Time May /5/20101.
ACT-R 6.0 Updates Summer 2013 Dan Bothell Carnegie Mellon University
SAL: A Hybrid Cognitive Architecture Y. Vinokurov 1, C. Lebiere 1, D. Wyatte 2, S. Herd 2, R. O’Reilly 2 1. Carnegie Mellon University, 2. University of.
The International Technology Alliance in Network and Information Sciences ITA Annual Fall Meeting September 2014 Socially-Distributed Cognition and Cognitive.
1 Modeling the N-back-M-pitch paradigm Ion Juvina*, Michael Qin^, & Christian Lebiere* *Department of Psychology, Carnegie Mellon University ^Naval Submarine.
Cognitive Colonization The Robotics Institute Carnegie Mellon University Bernardine Dias, Bruce Digney, Martial Hebert, Bart Nabbe, Tony Stentz, Scott.
Carla P. Gomes CS4700 CS 4700: Foundations of Artificial Intelligence Carla P. Gomes Module: Nearest Neighbor Models (Reading: Chapter.
A Robust Real Time Face Detection. Outline  AdaBoost – Learning Algorithm  Face Detection in real life  Using AdaBoost for Face Detection  Improvements.
Cognitive Colonization Tony Stentz, Martial Hebert, Bruce Digney, Scott Thayer Robotics Institute Carnegie Mellon University.
A Robust Real Time Face Detection. Outline  AdaBoost – Learning Algorithm  Face Detection in real life  Using AdaBoost for Face Detection  Improvements.
Software Defect Modeling at JPL John N. Spagnuolo Jr. and John D. Powell 19th International Forum on COCOMO and Software Cost Modeling 10/27/2004.
ACT-R.
Hidden Process Models Rebecca Hutchinson Tom M. Mitchell Indrayana Rustandi October 4, 2006 Women in Machine Learning Workshop Carnegie Mellon University.
Regression Diagnostics - I
Psychology of Music Learning Miksza Memory Processes.
DDMLab – September 27, ACT-R models of training Cleotilde Gonzalez and Brad Best Dynamic Decision Making Laboratory (DDMLab)
CRASH IMMINENT SAFETY: A TIER 1 UNIVERSITY TRANSPORTATION CENTER PROFESSOR UMIT OZGUNER TRC INC. CHAIR ON INTELLIGENT TRANSPORTATION SYSTEMS DIRECTOR,
COMPUTATIONAL MODELING OF INTEGRATED COGNITION AND EMOTION Bob MarinierUniversity of Michigan.
Analysing and Supporting Students’ Interactions in Synthesized Learning Environments: A Case Study with a Microworld and a Discussion Tool Toby Dragon.
Intrusion Detection Jie Lin. Outline Introduction A Frame for Intrusion Detection System Intrusion Detection Techniques Ideas for Improving Intrusion.
Proceedings of the Twenty-Sixth AAAI Conference on Artificial Intelligence Using Expectations to Drive Cognitive Behavior Unmesh Kurup, Christian Lebiere,
IIT Indore © Neminah Hubballi
Carnegie Mellon University © Robert T. Monroe Management Information Systems Business Analytics Management Information Systems.
Modeling meditation ?! Marieke van Vugt.
A Data Mining Approach for Building Cost-Sensitive and Light Intrusion Detection Models PI Meeting - July, 2000 North Carolina State University Columbia.
Data Mining Approaches for Intrusion Detection Wenke Lee and Salvatore J. Stolfo Computer Science Department Columbia University.
Introduction to ACT-R 5.0 ACT-R Post Graduate Summer School 2001 Coolfont Resort ACT-R Home Page: John R. Anderson Psychology Department.
Observation of W decay in 500GeV p+p collisions at RHIC Kensuke Okada for the PHENIX collaboration Lake Louise Winter Institute February 20, /20/20101.
P-1 © 2005 NeuralWare. All rights reserved. Using Neural Networks in Decision Support Systems Introduction Core Technology Building and Deploying Neural.
Pebble game extensions- Detecting relevant regions, protein hinge motions, allostery … Adnan Sljoka, York University Work with Walter Whiteley.
 Conversation Level Constraints on Pedophile Detection in Chat Rooms PAN 2012 — Sexual Predator Identification Claudia Peersman, Frederik Vaassen, Vincent.
The Change Collector by Rafael Garcia 08/07/07. Overview Features Circuit Hierarchy Behavior Cycle Pictures (Resolved) Demo Day Issues Coin Detection.
April 28, 2003 Early Fault Detection and Failure Prediction in Large Software Systems Felix Salfner and Miroslaw Malek Department of Computer Science Humboldt.
Boundary Detection in Tokenizing Network Application Payload for Anomaly Detection Rachna Vargiya and Philip Chan Department of Computer Sciences Florida.
1/28 Unit 3. Attention 3.1 Visual Locations 3.2 The Sperling Task 3.3 Visual Attention 3.4 Auditory Attention 3.5 Typing and Control 3.6 Declarative Finsts.
What Is Blended Learning??? BL Expectations: Daily classroom practices that incorporate differentiated instruction and personalized learning (regardless.
Cross-task Prediction of Working Memory Performance: Working Memory Capacity as Source Activation Larry Z. Daily, Marsha C. Lovett, and Lynne M. Reder.
Dynamic Decision Making Laboratory Carnegie Mellon University 1 Social and Decision Sciences Department ACT-R models of training Cleotilde Gonzalez and.
8. What are the advantages and disadvantages of using a virtual reality environment to study the brain and behavior? 9.Give examples of the way that virtual.
ACT-R 6.0 Software Updates Summer ‘08 – Summer ‘09 Dan Bothell Carnegie Mellon University
Using decision trees to build an a framework for multivariate time- series classification 1 Present By Xiayi Kuang.
Large Vocabulary Data Driven MT: New Developments in the CMU SMT System Stephan Vogel, Alex Waibel Work done in collaboration with: Ying Zhang, Alicia.
A Binary Agent Technology for COTS Software Integrity Anant Agarwal Richard Schooler.
Tracking Groups of People for Video Surveillance Xinzhen(Elaine) Wang Advisor: Dr.Longin Latecki.
Incident Management A disruption in normal or standard business operation that affects the quality of service Goal: restore normal service as quickly as.
Layer00 Efficiency Studies Stephen Levy, UChicago.
ACT-R 5.0 Architecture Christian Lebiere Human-Computer Interaction Institute Carnegie Mellon University
Real-Time Hierarchical Scene Segmentation and Classification Andre Uckermann, Christof Elbrechter, Robert Haschke and Helge Ritter John Grossmann.
3D Motion Classification Partial Image Retrieval and Download Multimedia Project Multimedia and Network Lab, Department of Computer Science.
Unsupervised Classification
Millisecond Time Interval Estimation in a Dynamic Task Jungaa Moon & John Anderson Carnegie Mellon University.
ACT-R 6.0 Software Updates Summer ‘09 – Summer ‘10 Dan Bothell Carnegie Mellon University
Monitoring Systems Richard Newman. Security in Depth Layered Security – Physical access control – Identification and Authentication – know who is using.
3D Motion Classification Partial Image Retrieval and Download
Data Driven Attributes for Action Detection
Week 9 Emily Hand UNR.
Tracking parameter optimization
John Laird, Nate Derbinsky , Jonathan Voigt University of Michigan
Obstacle avoidance using a Multi-Layer Perception
Symbolic cognitive architectures
Multitasking Emergency Stop Computer Integrated Manufacturing
Fusion of deep learning models of MRI scans, Mini–Mental State Examination, and logical memory test enhances diagnosis of mild cognitive impairment  Shangran.
Approaching an ML Problem
Total Variation and Hypothesis Testing for Segmentation
Cognitive Dynamic System
Obstacle avoidance using a Multi-Layer Perception
ADVANCED ANOMALY DETECTION IN CANARY TESTING
Sample Question Styles
ACT-R models of training
Presentation transcript:

Using Expectations to Drive Cognitive Behavior Unmesh Kurup Christian Lebiere, Tony Stentz, Martial Hebert Carnegie Mellon University

Cognitive Decision Cycle t+1 Calculate Mismatch World High-level Cognition Retrieve Response World Action Prediction t-1t Cognition Cognition is driven by Expectations/Predictions.

Pedestrian Tracking & Behavior Classification Goals: Investigate use of expectations Integrate with perception Run both offline & real-time

Integrated System

Partial Matching & Blending Chunk2 isa location- chunk id person2 nextx 1010 nexty 500 Chunk3 isa location- chunk id person3 nextx 187 nexty 313 Chunk4 isa location- chunk id person1 nextx 299 nexty 100 +retrieval> isa location- chunk id person1 nextx 300 Chunk1 isa location- chunk id person1 nextx 255 nexty 100 Chunk4 isa location- chunk id person1 nextx 299 nexty 100 Declarative Memory Partial Matches Chunk5 isa location- chunk id person1 nextx nexty 100 Blended result Chunk1 isa location- chunk id person2 nextx 255 nexty 100

Using Expectations: Tracking Chunk-type visual-location idX YDxDyNextxNexty Foreach Object o: +blending> isa visual-location id o compare to (x,y)s from perception pick thresholded closest match, calculate newdx, newdy, newx, newy +imaginal> isa visual-location id o …

Features straight1 straight2detourleftstraight3veer Features: BehaviorFeatures Normal – Straightstraight1, straight2, straight3 Normal – Leftstraight1, straight2, left Peekstraight1, detour, left, no-chk-pt BehaviorFeatures Detourstraight1, detour, straight3, chk-pt Veerstraight1, straight2, left, veer, chk-pt Walkbackstraight1, straight2, left, straight2, straight1, chk-pt

Using Expectations: Detecting Features from Data Straight & Left Deviation from expected location indicates a point of interest

Foreach location +blending> isa visual-location x =x y =y compare to (x,y)s from perception if path deviates more than threshold, mismatch! +imaginal> isa visual-location id o … Cluster points into regions

Detected Features

Data Combined Arms Collective Training Facility(CACTF) at Fort Indiantown Gap, PA. 4 examples. 3/1 split. Multiple behavior set – 10 behaviors.

Behaviors Straight & Left Peek Detour Veer Walkback

Results Hand-coded Model (Single Behavior Set) Hand-coded Model (Multiple Behavior Set) Made99.3%Made46.5% Correct99.15%Correct30.2% Incorrect0.15%Incorrect16.3% Learning Model (Single Behavior Set) Learning Model (Multiple Behavior Set) Made86.1%Made82.4% Correct68%Correct43.8% Incorrect18.1%Incorrect38.6%

Future Work – Semantic Labels

Future Work – Using Semantic Labels BehaviorFeatures (Spatial)Features (Semantic) Normal – Straightstraight1, straight2, straight3 Sidewalk, Pavement Normal – Leftstraight1, straight2, left Sidewalk Peekstraight1, detour, left, no-chk-pt Pavement, Sidewalk Detourstraight1, detour, straight3, chk-pt Pavement Veerstraight1, straight2, left, veer, chk-pt Sidewalk, Pavement Walkbackstraight1, straight2, left, straight2, straight1, chk- pt Sidewalk

Future Work Generic model of monitoring using expectations Learn expectations Monitor for deviations from expectations – Signal failure – Provide for recovery

Collaborators Max Bajracharya, JPL Bob Dean, GDRS Brad Stuart, GDRS FMS lab, CMU